# robots.txt for http://www.igc.org User-agent: * Disallow: /cgi-bin/ User-agent: webinator Disallow: /gifs/ Disallow: /order/ Disallow: /members/ Disallow: /docs95/ Disallow: /docs96/ Disallow: /docs97/ # Important: there should be no blank lines between the above directives. # Except you must use a blank before a User-agent record. # Documentation: http://info.webcrawler.com/mak/projects/robots/norobots.html # Notes: # /webtest/ /xwebtest/ /test/ don't let anything into test areas # /scripts/ added 03/30/99/ by madebeer # /conferences/ robots shouldn't be scouring conf2html postings # /audubon/ added 04/03/97 by aalm at request of # Chris Pepper, NAS Webmaster # /ehj/ EHJ has been suspended 7/18/97 -scott