# This Robots Text file allows different types of permissions to spiders/crawlers User-agent: * Disallow: /htdocs/admin/ Disallow: /htdocs/private/ Disallow: /admin/ Disallow: /private/