Robots.txt Generator

Configure crawler rules and generate a robots.txt file for your website instantly.

Quick Presets

Rules

Sitemap URL (optional)

robots.txt