Free AI robots.txt Generator
Free AI robots.txt generator. Choose which AI crawlers may read your website, keep your private pages blocked, and copy a ready robots.txt. free, with no fees. Nothing to upload, and nothing is stored.
- ✓ 100% free
- ✓ Email and phone to start
- ✓ No fees, ever
- ✓ Nothing to install
Search and browsing bots: these send shoppers to you
Training bots: these collect pages to train models
Other crawlers
Your site
robots.txt
Save as robots.txt at the root of your site.
# robots.txt User-agent: * Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: OAI-SearchBot Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: ChatGPT-User Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: Claude-User Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: PerplexityBot Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: Googlebot Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: Bingbot Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: GPTBot Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: ClaudeBot Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: Google-Extended Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: CCBot Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: Applebot-Extended Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: Bytespider Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: Amazonbot Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: / User-agent: meta-externalagent Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /admin Allow: /
Want the full picture?
Run the free AI visibility checker: bots, firewall, SEO, answer-readiness and fix prompts in one report.
Open the AI visibility checkerHow it works
- Choose a starting pointAllow everything, block AI training only, or block all AI bots.
- Adjust each botAllow or block the bots one by one. Search and browsing bots are the ones that send shoppers to you.
- Copy the fileSave it as robots.txt at the root of your site, then re-check it with the free AI visibility checker.
Questions, answered
How do I block ChatGPT from my website?
Add a rule for each OpenAI bot: GPTBot (training), OAI-SearchBot (search) and ChatGPT-User (browsing for a user), each with Disallow: /. Blocking the search and browsing bots also removes you from ChatGPT answers, so many sites block only GPTBot.
What is the difference between training bots and search bots?
Training bots (GPTBot, ClaudeBot, Google-Extended, CCBot, Applebot-Extended) collect pages to train models. Search and browsing bots (OAI-SearchBot, ChatGPT-User, Claude-User, PerplexityBot) fetch pages live to answer a shopper. Block the first group to opt out of training and still be found.
Does robots.txt actually stop AI crawlers?
Well-behaved crawlers follow it, but it is a request, not a lock. A firewall rule is the way to enforce it. The free AI visibility checker tests both.
Where do I put the robots.txt file?
At the top level of your domain, so it loads at yourstore.com/robots.txt. On Shopify, WordPress and similar platforms there is a robots setting or template to edit.
Is this tool really free? Do I need to register?
The tools are free, with no account, no password and no fees. Before a tool runs we ask for your email and phone number, so we can send your results and follow up if you ask for help. Nothing is uploaded from your computer.