# robots.txt file tells search engines what not to index User-agent: * Disallow: /tmp/ Disallow: /foobar.html