User-agent: * Allow: / # Point to dynamic sitemap Sitemap: /sitemap.xml # Directories to exclude Disallow: /private/ Disallow: /admin/ # Crawl-delay to be respectful of server resources Crawl-delay: 10