ToolBoxy
Sign up free
🔍

Robots Txt Generator

robots · seo · crawler · webmaster

User-agent: *
Disallow: /admin
Disallow: /cart
Disallow: /api

How to use

  1. 1

    Choose allow or block policy.

  2. 2

    Enter disallow paths and sitemap URL.

  3. 3

    Copy the generated robots.txt.

FAQ

Is this tool free?

Yes — no sign-up, no installation, completely free to use right away.

What is this tool?

This tool builds a robots.txt file that tells search engines which pages they can crawl. Set your rules with a few clicks and copy the file to your site's root. It runs entirely in your browser.

Where do I put robots.txt?

Place it at the root of your domain, e.g. example.com/robots.txt.