AI Search Readiness report · 2026-05-30
56/ 100
nytimes.com
Grade F
nytimes.com scores 56/100 (F) for AI search readiness. Biggest wins: unblock major ai engines; publish /llms.txt; add faqpage schema.
AI Crawler Access0.5 / 25
Blocked AI engines. Blocked from major AI engines: ChatGPT Search, ChatGPT live browsing, OpenAI GPTBot, Perplexity, Claude (Anthropic), Google Gemini / AI, Common Crawl (feeds many LLMs). Fix: Add explicit Allow rules (or remove the Disallow) for these crawlers.
Blocked secondary AI bots. Also blocked: Perplexity live fetch, Anthropic (legacy UA), Claude Web, Apple Intelligence, ByteDance / TikTok AI, Meta AI, Cohere. Fix: Decide intentionally whether to allow these secondary AI crawlers.
Content Extractability20 / 20
Server-rendered content. 1284 words of readable text are present in the initial HTML.
Structured Data8 / 15
Structured data. Found 2 JSON-LD block(s): website, imageobject, searchaction, entrypoint, itemlist, listitem, newsmediaorganization, organization.
Metadata & Semantics12 / 15
Core metadata. Title, description and a single H1 are present.
Answer-Ready Content2 / 12
llms.txt. No /llms.txt found. Fix: Publish an /llms.txt summarizing your site for AI assistants.
Crawl Infrastructure8 / 8
Crawl infrastructure. HTTPS, robots.txt and a sitemap are all in place.
Technical Hygiene5 / 5
Technical hygiene. Responds 200 OK in 191ms, indexable.

Top fixes, in priority order

Unblock major AI engines

robots.txt blocks ChatGPT Search, ChatGPT live browsing, OpenAI GPTBot, Perplexity, Claude (Anthropic), Google Gemini / AI, Common Crawl (feeds many LLMs). These are primary sources for AI answers — allow them to crawl.

Publish /llms.txt

The emerging llms.txt standard gives AI assistants a clean, curated summary of your site. Add one at /llms.txt.

Add FAQPage schema

FAQPage markup is one of the strongest signals for AI answer engines. Add it to your most-asked questions.

Add an FAQ section

Answer-engine queries are questions. A clear FAQ (ideally with FAQPage schema) gives them ready-made answers to quote.

Close these gaps for nytimes.com
Get the exact JSON-LD, llms.txt and AI-crawler robots config this report calls for — generated for nytimes.com and emailed in minutes, one time. Or put it on autopilot with weekly re-scans and an email alert the moment the score drops.
Get the Fix Pack → $49 Monitor weekly → $29/mo
Is this your site? Keep it from slipping.
Get nytimes.com re-scanned automatically and emailed the moment its AI readiness drops.
Show off your AI readiness
Embed this badge on your site or README — it links back to this live report and helps AI engines discover it.
Oraql AI Search Readiness F 56/100
Audit your own site free →