Robots.txt Generator — Fast & Responsive Tool

Robots.txt Generator

Generate, preview and download a custom robots.txt — fast, mobile-first and SEO-ready.

Light

How to use

Create your robots.txt

Use presets or build custom rules. You can download the file, copy to clipboard or share it.

User-agent

Directive

Path

Extra rules

# Generated robots.txt preview will appear here

Tip: Add `Sitemap:` line to improve indexing, eg. Sitemap: https://example.com/sitemap.xml

Choose a preset or enter a User-agent and directive.
Click Add rule to add it to the preview, or click Generate to build final content including extra lines.
Use Copy to copy the file text, or Download to save as robots.txt.

Replace the content inside the adHeader, adSidebar and adFooter divs with your Adsterra ad code snippet. Example:

 
<!-- Adsterra example (paste your ad code) -->
<div id="ad-zone">
  <script src="https://example.adsterra.com/ad.js"></script>
</div>

Do not forget to follow Adsterra policies and use the correct unit ID from your Adsterra dashboard.