← ← All Tools

🤖 Robots.txt Generator

Generate robots.txt rules, sitemap declarations, and common crawler directives.

This generator creates a base `User-agent: *` policy by default. Use the extra rules block to add separate sections for Googlebot, Bingbot, or other crawlers.

Free online robots.txt generator for building crawler rules, allow and disallow paths, sitemap declarations, and optional crawl-delay settings. Useful for new site launches, SEO setup, and quick creation of a ready-to-copy robots.txt file.