robots.txt Generator

Build a valid robots.txt — agents, paths, crawl-delay, sitemap

User-agent

Allow paths — one per line

Disallow paths — one per line

Crawl-delay (seconds, optional)

Sitemap URL (optional)

Also block AI crawlers (GPTBot, CCBot, Google-Extended)