#  robot.txt

User-agent: *
Disallow:/cgi-bin/
Disallow:/css/
Disallow:/dat/
Disallow:/images/
Disallow:/js/