Here is a sample from our robot.txt file: # robots.txt for http://www.hotalternatives.com/ User-agent: * Disallow: /mcart/ Disallow: /cgi-bin/