User-agent: * Disallow: /cgi-bin/ Disallow: /immedia/ Disallow: /Infobase/ Disallow: /CFDOCS/ Disallow: /cfide/ Disallow: /_utils/ Disallow: /_notes/ Disallow: /inside_disd/depts/demos/ Disallow: /inside_disd/depts/curr_cntr/ Disallow: /manual/ Disallow: /newsletter/ Disallow: /classes/ Disallow: /connections/ Disallow: /icore/ Disallow: /test/ Disallow: /qformslib/ Disallow: /schinfo/ Disallow: /spanish/ Disallow: /v2flashslideshow/ Disallow: /pie/ Disallow: /js/ Disallow: /gwstyles/ Disallow: /includes/ Disallow: /css/ Disallow: /images/ Disallow: /images2/ Disallow: /safetyzone/ Disallow: /calinst/ Disallow: /schools/calendars/ Disallow: /mccoy/ Disallow: /muratest/ #idiot-bot; generates tons of 404 and malformed urls User-agent: wget Disallow: / User-agent: ExtractorPro Disallow: /