π
Robots Txt Generator
NEWrobots Β· seo Β· crawler Β· webmaster
User-agent: * Disallow: /admin Disallow: /cart Disallow: /api
Choose a crawl policy, add disallow paths and your sitemap to generate robots.txt.
Is it free?
Yes β completely free, no account or installation.
Where do I put robots.txt?
Place it at the root of your domain, e.g. example.com/robots.txt.