Robots.txt Generator

Name: Robots.txt Generator | Free SEO Tools | Australian Internet Advertising
Brand: Australian Internet Advertising
SKU: https://aiad.com.au/seo-tools/robots-txt/
Price: 2000 AUD
Availability: InStock
Rating: 5 (145 reviews)

Control how search engine bots crawl and index your website.

Sitemap URL

Point search engines to your XML sitemap

Rule #1

Configure crawling rules for specific bots

User Agent

Quick Disallow Patterns

Custom Disallow Paths

Allow Paths (override disallow)

Generated robots.txt

User-agent: *
Allow: /