Robots.txt Generator
Example input
https://example.com/sitemap.xmlWhat to check
Generated markup is a starting point. Confirm real page URLs and content before publishing it.
Create a clean robots.txt file with common crawl directives and sitemap entries.
https://example.com/sitemap.xmlGenerated markup is a starting point. Confirm real page URLs and content before publishing it.