Build a robots.txt file with rules for search engine crawlers.
Free · Runs in your browser · Last updated
Visually create a robots.txt file: pick user-agents, allow/disallow paths, set crawl delay and sitemap URL. Copy or download the result.
All processing for robots.txt happens locally inside your browser using JavaScript. Your input is never uploaded to a server, logged, or shared with third parties.
Yes. robots.txt is completely free for both personal and commercial projects. There are no usage limits, no sign-up, and no premium tier.
All processing happens locally in your browser using JavaScript. Your input is never uploaded to our servers, logged, or shared with any third party.
Once the page has loaded, the tool runs entirely client-side. You can disconnect from the internet and it will keep working in the same browser tab.
robots.txt works in all modern browsers, including the latest versions of Chrome, Firefox, Safari, Edge, Brave, and Opera, on desktop and mobile.
No. robots.txt runs in any modern web browser with no installation, browser extension, or account required.