← All Tools
Free · no sign-up

robots.txt Generator

Build a robots.txt with per-user-agent allow/disallow rules, crawl-delay and sitemap lines.

  1. Add rules per user-agent
  2. Add your sitemap URL
  3. Copy the robots.txt
Group 1
User-agent: *
Disallow:

Sitemap: https://example.com/sitemap.xml