# Do not allow any robot to crawl the entire site
User-Agent: *
Disallow: /