AI crawlers allowed
0/20 pts
Blocks one or more AI crawlers in robots.txt. AI engines cannot index pages they cannot fetch.
Fix: Remove Disallow rules for AI user-agents in robots.txt, or add explicit Allow lines.
AI Readiness Report
How visible theguardian.com is to AI engines like ChatGPT, Perplexity, Gemini, and Claude, based on a technical scan of crawler access, structured data, and citation signals.
Summary
theguardian.com has an AI Readiness score of 40/100, placing it at Maturity Level 0: Invisible. The site was scanned on April 27, 2026 across 7 technical signals that influence whether AI engines like ChatGPT, Perplexity, Gemini, and Claude can discover, parse, and cite content from theguardian.com.
Maturity Level 0
Based on 40 out of 100 points across 7 technical signals that influence whether AI engines can discover, parse, and cite theguardian.com.
Content-level signals were checked on: https://www.theguardian.com/news/gallery/2026/apr/24/wild-horses-marathon-runne…
0/20 pts
Blocks one or more AI crawlers in robots.txt. AI engines cannot index pages they cannot fetch.
Fix: Remove Disallow rules for AI user-agents in robots.txt, or add explicit Allow lines.
0/10 pts
No /llms.txt file. AI engines have no curated guide to the site's purpose and key pages.
Fix: Publish /llms.txt with a short site description and links to your most important pages.
0/15 pts
Homepage lacks JSON-LD Organization markup. AI engines cannot identify the entity behind the site.
Fix: Add JSON-LD Organization with name, url, logo, and sameAs links to social profiles.
15/15 pts
Article, BlogPosting, or NewsArticle markup is present on content pages.
0/15 pts
No FAQPage schema detected on homepage, content pages, or /faq endpoints.
Fix: Add a FAQ section with FAQPage JSON-LD. This is one of the most AI-cited schema types.
10/10 pts
JSON-LD Person schema with sameAs or url to verifiable identity is present.
15/15 pts
A Sitemap: directive in robots.txt points to the sitemap.xml file.
The score above measures technical readiness. The next step is measuring whether ChatGPT, Perplexity, Gemini, and Claude currently mention theguardian.com for the queries that matter. The free AI Visibility Audit runs live queries against the engines and reports back.
Run free AI Visibility Audit →Re-scan theguardian.com →
Run a fresh AI Readiness scan now.
Maturity model →
The 5-level framework behind this score.
2026 report →
How theguardian.com compares to the top 500.
theguardian.com scored 40 out of 100 on the Appearly AI Readiness scan, placing it at Maturity Level 0 (Invisible).
No. Blocks one or more AI crawlers in robots.txt. AI engines cannot index pages they cannot fetch. Remove Disallow rules for AI user-agents in robots.txt, or add explicit Allow lines.
No. No /llms.txt file. AI engines have no curated guide to the site's purpose and key pages. Publish /llms.txt with a short site description and links to your most important pages.
No. Homepage lacks JSON-LD Organization markup. AI engines cannot identify the entity behind the site. Add JSON-LD Organization with name, url, logo, and sameAs links to social profiles.
Yes. Article, BlogPosting, or NewsArticle markup is present on content pages.
No. No FAQPage schema detected on homepage, content pages, or /faq endpoints. Add a FAQ section with FAQPage JSON-LD. This is one of the most AI-cited schema types.
Yes. JSON-LD Person schema with sameAs or url to verifiable identity is present.
Yes. A Sitemap: directive in robots.txt points to the sitemap.xml file.
Appearly scans up to 8 pages per domain (homepage, robots.txt, /llms.txt, sitemap, and a discovered content page) to evaluate 7 signals weighted from 10 to 20 points each. The maturity model maps total score to one of 5 levels: Invisible (0), Discoverable (1), Indexable (2), Retrievable (3), Cited (4).
Sources and references:
Published: · Last updated: · Publisher: Appearly (AI Visibility Platform)