User-agent:linkCheck
Disallow:/_private/
Disallow:/cgi-bin/
Disallow:/musical/
Disallow:/test/
Disallow:/probe/
User-agent:*
Disallow:/cgi-bin/
Disallow:/webalizer/
Disallow:/search/
Disallow:/popup/
Disallow:/musical/
revisit-after:5 days