# this file directs web crawlers to avoid certain areas| * = all crawlers User-agent: * Disallow: /webstats/ Disallow: /_private/ Disallow: /_vti_script/ Disallow: /cgi_pub/ Disallow: /CSS/ Disallow: /data/ Disallow: /downloads/ Disallow: /generateditems/ Disallow: /Holding/ Disallow: /Illustrator files/ Disallow: /Images/ Disallow: /Visual Menus Base Folder/ Disallow: /logs/ Disallow: /java script/ Disallow: Goliath.html Disallow: referrals.html