robots.txt Generator

Create a robots.txt file with custom crawl rules for search engine bots. Add allow/disallow rules and sitemap URL.