User-agent: * # directed to all spiders Disallow: /cgi-bin Disallow: /clients Disallow: /images Disallow: /includes Disallow: /orders Disallow: /templates