Infinio Tools

Recent Tools

No recent tools yet.

Robots.txt Generator

Generate robots.txt files to guide search engine crawlers. Add rules, sitemaps, and crawl delays.

Embed this tool

Add this free tool to your site in one line. Please keep the attribution link — it's how we keep the tools free.

Loading preview…
<iframe src="https://tools.infiniolabs.com/seo/robots-txt-gen?embed=1" width="100%" height="600" frameborder="0" allowtransparency="true" loading="lazy" title="robots-txt-gen"></iframe>
<p><a href="https://tools.infiniolabs.com/seo/robots-txt-gen" target="_blank" rel="noopener">Powered by Infinio Tools</a></p>
Open tool

User-Agent Block

Rules

Global Settings

robots.txt

User-agent: *
Disallow: /admin
Disallow: /api

Tips:

  • Use Disallow: / to block everything
  • Leave rules empty to allow all crawling
  • Paths should start with /
  • Specific user-agent blocks override the generic * block
Infinio Tools
© 2026 Infinio Labs