Robots.txt Generator

Generate a robots.txt file to control how search engines crawl your website.

robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /private/
Sitemap: https://example.com/sitemap.xml

Related Tools