Agent Grade / AI bots by site / dagbladet.no

Does dagbladet.no block ChatGPT?

dagbladet.no is open to Google but blocks ChatGPT search, Claude search, Perplexity. ChatGPT search is blocked, and OpenAI's training bot is blocked. From its public robots.txt, checked 23 to 24 October 2026. It ranks #1,375 on the Tranco list of top sites.

BotWhat it doesHome pageDeciding rule
GooglebotGoogle SearchAllowedUser-agent: * / Allow: /
BingbotBing / CopilotAllowedUser-agent: * / Allow: /
OAI-SearchBotChatGPT searchBlockedUser-agent: OAI-SearchBot / Disallow: /
ChatGPT-UserChatGPT (user asks)BlockedUser-agent: ChatGPT-User / Disallow: /
GPTBotOpenAI trainingBlockedUser-agent: GPTBot / Disallow: /
Claude-SearchBotClaude searchBlockedUser-agent: Claude-SearchBot / Disallow: /
Claude-UserClaude (user asks)BlockedUser-agent: Claude-User / Disallow: /
ClaudeBotAnthropic trainingBlockedUser-agent: ClaudeBot / Disallow: /
PerplexityBotPerplexity searchBlockedUser-agent: PerplexityBot / Disallow: /
Perplexity-UserPerplexity (user asks)BlockedUser-agent: Perplexity-User / Disallow: /
Google-ExtendedGemini trainingBlockedUser-agent: Google-Extended / Disallow: /
Applebot-ExtendedApple AI trainingBlockedUser-agent: Applebot-Extended / Disallow: /
CCBotCommon CrawlBlockedUser-agent: CCBot / Disallow: /
meta-externalagentMeta AIBlockedUser-agent: meta-externalagent / Disallow: /
BytespiderByteDanceBlockedUser-agent: Bytespider / Disallow: /

"Blanket rule": dagbladet.no never names that bot; a rule for every bot (User-agent: *) applies. llms.txt: No. robots.txt is what a site asks bots to do; some sites also block bots at the network edge.

Questions

Does dagbladet.no block ChatGPT search?

Yes. dagbladet.no's robots.txt keeps OAI-SearchBot, the crawler behind ChatGPT search, off its home page (User-agent: OAI-SearchBot / Disallow: /), as checked 23 to 24 October 2026.

Does dagbladet.no block GPTBot?

Yes. dagbladet.no blocks GPTBot, OpenAI's training crawler (User-agent: GPTBot / Disallow: /).

Does dagbladet.no block Claude?

ClaudeBot (Anthropic training): blocked. Claude-SearchBot (Claude search): blocked. Claude-User (fetches for a person): blocked.

Does dagbladet.no have an llms.txt file?

We did not find an llms.txt file on dagbladet.no, or its robots.txt did not allow us to fetch it.

What about your site?

Agent Grade checks the same 15 bots against your robots.txt, loads your page as each AI bot, and checks what attack agents look for first. Free, under a minute.

Grade my site

How the top 100,000 websites treat AI bots