Agent Grade / AI bots by site / oxylabs.io
Does oxylabs.io block ChatGPT?
oxylabs.io lets Google and AI search in. ChatGPT search is allowed, and OpenAI's training bot is allowed. From its public robots.txt, checked 23 to 24 October 2026. It ranks #1,079 on the Tranco list of top sites.
| Bot | What it does | Home page | Deciding rule |
|---|---|---|---|
| Googlebot | Google Search | Allowed | User-agent: * / Allow: / |
| Bingbot | Bing / Copilot | Allowed | User-agent: * / Allow: / |
| OAI-SearchBot | ChatGPT search | Allowed | User-agent: OAI-SearchBot / Allow: / |
| ChatGPT-User | ChatGPT (user asks) | Allowed | User-agent: ChatGPT-User / Allow: / |
| GPTBot | OpenAI training | Allowed | User-agent: GPTBot / Allow: / |
| Claude-SearchBot | Claude search | Allowed | User-agent: Claude-SearchBot / Allow: / |
| Claude-User | Claude (user asks) | Allowed | User-agent: Claude-User / Allow: / |
| ClaudeBot | Anthropic training | Allowed | User-agent: ClaudeBot / Allow: / |
| PerplexityBot | Perplexity search | Allowed | User-agent: PerplexityBot / Allow: / |
| Perplexity-User | Perplexity (user asks) | Allowed | User-agent: Perplexity-User / Allow: / |
| Google-Extended | Gemini training | Allowed | User-agent: Google-Extended / Allow: / |
| Applebot-Extended | Apple AI training | Allowed | User-agent: Applebot-Extended / Allow: / |
| CCBot | Common Crawl | Allowed | User-agent: CCBot / Allow: / |
| meta-externalagent | Meta AI | Allowed | User-agent: meta-externalagent / Allow: / |
| Bytespider | ByteDance | Allowed | User-agent: Bytespider / Allow: / |
"Blanket rule": oxylabs.io never names that bot; a rule for every bot (User-agent: *) applies. llms.txt: Yes. robots.txt is what a site asks bots to do; some sites also block bots at the network edge.
Questions
Does oxylabs.io block ChatGPT search?
No. In its robots.txt as checked 23 to 24 October 2026, oxylabs.io lets OAI-SearchBot, the crawler behind ChatGPT search, read its home page.
Does oxylabs.io block GPTBot?
No. oxylabs.io lets GPTBot, OpenAI's training crawler, read its home page.
Does oxylabs.io block Claude?
ClaudeBot (Anthropic training): allowed. Claude-SearchBot (Claude search): allowed. Claude-User (fetches for a person): allowed.
Does oxylabs.io have an llms.txt file?
Yes, oxylabs.io serves an llms.txt file.
What about your site?
Agent Grade checks the same 15 bots against your robots.txt, loads your page as each AI bot, and checks what attack agents look for first. Free, under a minute.
Grade my site