User-Agent: Twitterbot Allow: / Disallow: /admin User-Agent: * Allow: / Disallow: /admin Sitemap: /sitemap.xml