# Robots.txt file # For domain: http://www.booksofthebible.com/ # All robots will spider the domain User-agent: * Allow: / Disallow: /cgi-bin/ Disallow: /MusicStore/ Disallow: /data/ Disallow: /html/ Disallow: /gfx/ Disallow: /images/ Disallow: /scgi-bin/