# http://www.petfrenzy.com/robots.txt User-agent: Googlebot Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /config/ Disallow: /includes/ Disallow: /intranet/ Disallow: /js/ Disallow: /L8/ Disallow: /WebService1/ Disallow: /content/ Disallow: /catid/ Disallow: /search/ Disallow: /*? Disallow: /*.asp$ Disallow: /*.asa$ Disallow: /*.js$ Disallow: /*.exe$ Disallow: /*.gif$ Disallow: /pages/JUNK/ Disallow: /Product Pages/ Disallow: /JUNK/ User-agent: * Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /config/ Disallow: /includes/ Disallow: /intranet/ Disallow: /js/ Disallow: /L8/ Disallow: /WebService1/ Disallow: /content/ Disallow: /search/ Disallow: /catid/