robots.txt checker for AI bots

No. GPTBot collects training data. ChatGPT search uses OAI-SearchBot, and ChatGPT-User fetches a page when someone asks about it.

A robots.txt line that states how your content may be used: for search, AI answers and AI training.

Enter a domain to see what its robots.txt tells AI crawlers, AI search bots and browsing agents.

AI companies run several bots with different jobs. Some collect training data, others fetch pages for AI search or when someone asks about a page.

Blocking one does not block the others. GPTBot collects training data, while ChatGPT search uses OAI-SearchBot, so check them separately.

Questions

No. GPTBot collects training data. ChatGPT search uses OAI-SearchBot, and ChatGPT-User fetches a page when someone asks about it.

A robots.txt line that states how your content may be used: for search, AI answers and AI training.