theguardian.com
Grade D
Audited Nov 10
49 checks
SEO, GEO and AEO audit · home page score ·
SEO audit for theguardian.com
theguardian.com scored 64 out of 100 (grade D) in the ratemysite.ai audit of 49 checks across technical SEO, content, answer engines, AI readiness and speed, with 19 issues to fix.
Email me about this score
Compare with another site
Show your score on your site
Audit complete. This site needs work
Summary
Site health score
Grade D64 out of 100
This site needs work. 19 things to improve.
First audit of this domain
Technical SEO
85
14 checks · 2 failed, 1 warning
Content
88
8 checks · 2 warnings
Answer engines
31
9 checks · 4 failed, 2 warnings
AI readiness
55
12 checks · 2 failed, 6 warnings
Speed
n/a
6 checks · no issues
Fix first
19 of 42 checksFailed: AI crawler accessAI readiness (GEO)
robots.txt blocks tier 1 AI crawlers: ClaudeBot, PerplexityBot
High impactHow to fix: AI crawler access
Failed: Direct answer after the H1Answer engines (AEO)
no H1 found, so no direct-answer paragraph (0 words)
High impactHow to fix: Direct answer after the H1
Core Web Vitals
Largest Contentful Paint not measured
Cumulative Layout Shift not measured
Time to First Byte not measured
Site health
The other pages were not scanned in this audit.
AI crawler access
6 of 16 allowedGPTBotAllowedOAI-SearchBotAllowedChatGPT-UserAllowedClaudeBotBlockedClaude-SearchBotBlockedClaude-UserBlocked
Google preview
Desktoptheguardian.com › us
Latest news, sport and opinion from the Guardian
Latest US news, world news, sports, business, opinion, analysis and reviews from the Guardian, the world's leading liberal voice
Every check, by category
Technical SEO
Technical SEO is good
Whether search engines can crawl, index and understand the page: title, meta description, headings, canonical, HTTPS, robots.txt and sitemap.
Failed: Single H1Medium impact
What we found
no H1 found
Why it matters
An H1 is the top-level heading that says what a page is about. This check passes with exactly 1 H1, fails with none, and warns when a page has 2 or more.
Warning: Canonical URLLow impact
What we found
canonical points to https://www.theguardian.com/, page is https://www.theguardian.com/us
Why it matters
A canonical tag is a link in the page head that names the main URL of a page. A missing tag fails, and one that points to another URL gets a warning.
Passed: Title tag length
title is 48 characters
Passed: Meta description
meta description is 128 characters
Passed: Heading hierarchy
216 headings in order
Passed: Mobile viewport
viewport: width=device-width,minimum-scale=1,initial-scale=1
Passed: HTML lang attribute
lang="en"
Passed: HTTPS and redirect
https with http redirecting to https
Passed: robots.txt
robots.txt present and allows crawling
Passed: XML sitemap
sitemap.xml reachable
Passed: Indexable (no noindex)
page is indexable
Passed: Image alt text
all 130 images have an alt attribute, 3 decorative (alt="")
Passed: Internal links
346 internal links
Content and E-E-A-T
Content and E-E-A-T is good
Trust and depth signals: a named author, a visible date, contact and privacy pages, enough readable text and sources linked out.
Warning: ReadabilityLow impact
What we found
Flesch reading ease 6, aim for 50 or more
Why it matters
Flesch reading ease is a score from 0 to 100 that rates how easy text is to read. This check scores the whole page: 50 points or more passes, and lower gets a warning.
Passed: Content length
3567 words of visible text
Passed: Visible date
<time datetime> element found (2026-11-09T19:31:36.000Z)
Passed: Links to sources
12 external domains linked: support.theguardian.com, profile.theguardian.com, app.adjust.com, theguardian.newspapers.com, licensing.theguardian.com, wordiply.com, manage.theguardian.com, uploads.guim.co.uk, bsky.app, threads.com, usadvertising.theguardian.com, workwithus.theguardian.com
Passed: Contact or about page
contact or about page linked (/about)
Passed: Privacy policy
privacy policy linked (/info/privacy)
Not applicable: Title differs from H1
title or H1 missing, covered by other checks
Keyword consistency
The most used words on the page and where they appear.
| Keyword | Title | Meta description | Headings | On the page |
|---|---|---|---|---|
| ago | No | No | No | 36 |
| hide | No | No | No | 36 |
| comments | No | No | No | 23 |
| trump | No | No | Yes | 22 |
| double | No | No | Yes | 18 |
| quotation | No | No | Yes | 17 |
| guardian | Yes | Yes | Yes | 16 |
| news | Yes | Yes | Yes | 15 |
| world | No | Yes | Yes | 15 |
| review | No | No | Yes | 13 |
Answer engines (AEO)
Answer engines (AEO) has serious issues
How easily answer engines can lift an answer from the page: a direct answer up top, question headings, definitions and structured data.
Failed: Direct answer after the H1High impact
What we found
no H1 found, so no direct-answer paragraph (0 words)
Why it matters
A direct answer is a short paragraph right under the H1 that answers the page's question. This check fails under 10 words, warns from 10 to 24, and passes at 25 words or more.
Failed: FAQ schemaMedium impact
What we found
no FAQ section or FAQPage schema
Why it matters
FAQPage is a Schema.org type that marks up questions and answers as JSON-LD. This check passes with FAQPage markup, warns on an FAQ heading without it, and fails with neither.
Failed: Organization and WebSite schemaMedium impact
What we found
no Organization, WebSite or Article structured data
Why it matters
Core schema is the structured data that says who runs a site. This check needs 2 of 7 types, such as Organization and WebSite: 1 gets a warning and 0 fails.
Warning: DefinitionsLow impact
What we found
no definition-style sentence ("X is a ...")
Why it matters
A definition is a sentence that says what a term is, in the form X is a category. This check passes when the page has one and warns when it has none.
Warning: HowTo schemaLow impact
What we found
step list found but no HowTo schema
Why it matters
HowTo is a Schema.org type that marks up the steps of a task. This check applies when a page has a numbered list of 3 or more items, and warns if HowTo markup is missing.
Passed: Question-style headings
26 question-style headings
Passed: Lists and tables
66 lists, 0 tables in the main content
Passed: Data points
26 data points (2026, 2026, 8m)
AI readiness (GEO)
AI readiness (GEO) has serious issues
Whether AI assistants such as ChatGPT, Claude and Perplexity can reach, read and cite the site: crawler access, llms.txt and content that works without JavaScript.
Failed: AI crawler accessHigh impact
What we found
robots.txt blocks tier 1 AI crawlers: ClaudeBot, PerplexityBot
Why it matters
AI search crawlers like OAI-SearchBot, Claude-SearchBot and PerplexityBot fetch pages for ChatGPT, Claude and Perplexity search answers. If robots.txt blocks them, your pages can drop out of those answers. Blocking training bots alone does not.
Failed: llms.txtHigh impact
What we found
no /llms.txt
Why it matters
llms.txt is a plain Markdown file at the root of your site. It tells AI assistants what your site is about and which pages matter most. Writing one takes about 10 minutes.
Warning: Brand name consistencyLow impact
What we found
no og:site_name or WebSite/Organization name; AI engines cannot confirm the brand name
Why it matters
Brand consistency means spelling your site name the same way everywhere. This check compares your title tag, og:site_name and Organization schema. Matching names help search engines and AI assistants link every mention to you.
Warning: ai.txtLow impact
What we found
no /.well-known/ai.txt
Why it matters
ai.txt is a plain text file that states how AI systems may use your content. It lives at /.well-known/ai.txt. It is optional and support is uneven, but some crawlers and agents read it.
Warning: Citable entity linksLow impact
What we found
no sameAs links (Wikipedia, LinkedIn, Crunchbase) in structured data
Why it matters
sameAs links are profile URLs listed in your Organization schema, such as LinkedIn or Wikidata. They let search engines and AI assistants confirm who you are. This check looks for at least 1.
Warning: HTML sizeLow impact
What we found
HTML is 1429 KB, keep it under 1 MB
Why it matters
HTML size is how big the page file is, not counting images or scripts. Our audit warns above 1 MB and fails above 2 MB. Googlebot documents a limit of 15 MB per file.
Warning: llms-full.txtLow impact
What we found
no /llms-full.txt (optional, gives AI the full content in one file)
Why it matters
llms-full.txt is an optional companion to llms.txt that holds the full text of your key pages. AI assistants can load it in one request. This check looks for it at your site root.
Warning: Markdown versionLow impact
What we found
no Markdown version via Accept: text/markdown (optional)
Why it matters
A Markdown version is a plain text copy of a page that your server returns when an AI agent asks for text/markdown. This check sends 1 such request and looks for a Markdown reply.
Passed: Content without JavaScript
3567 words available without JavaScript
Passed: Cache headers
Cache-Control "max-age=60, stale-while-revalidate=6, stale-if-error=864000, private"
Passed: No paywall or interstitial
no paywall or interstitial detected
Passed: X-Robots-Tag for AI
no AI restriction in X-Robots-Tag
Speed
Score not available
How fast the page loads and responds on a phone, from Google PageSpeed and real Chrome user data when Google has it.
Not applicable: Largest Contentful Paint
Largest Contentful Paint not measured
Not applicable: Interaction to Next Paint
Interaction to Next Paint not measured
Not applicable: Cumulative Layout Shift
Cumulative Layout Shift not measured
Not applicable: Time to First Byte
Time to First Byte not measured
Not applicable: Page weight
total page weight not measured
Not applicable: Request count
request count not measured
Site details
Technology
Software and libraries we could identify from the page and its headers.
- Cloudflare(CDN)
- HSTS(Security)
Social
Profiles linked from the page, and tracking pixels.
- Facebookfacebook.com/theguardian
- Instagraminstagram.com/guardian
- X (Twitter)Not linked
- LinkedInlinkedin.com/company/theguardian
- YouTubeyoutube.com/user/TheGuardian
- TikToktiktok.com/@guardian
- PinterestNot linked
- Tracking pixelsNone found
Local SEO
Only matters for businesses with a place customers visit.
- Phone on the pageNot found
- Address on the pageNot found
- LocalBusiness schemaNot found
- Google Maps or Business Profile linkNot found
Site insights
What we found on the page beyond the checks. None of it changes the score.
AI crawler access
Which AI crawlers your robots.txt lets in, and the rule that decides.
6 of 16 allowed, 10 blocked, 0 partly blocked
GPTBotOpenAIAllowedCollects content to train OpenAI models
Disallow: /sendarticle/(applies to all crawlers)OAI-SearchBotOpenAIAllowedIndexes pages for ChatGPT search answers
Disallow: /sendarticle/(applies to all crawlers)ChatGPT-UserOpenAIAllowedFetches a page when a ChatGPT user asks for it
Disallow: /sendarticle/(applies to all crawlers)ClaudeBotAnthropicBlockedCollects content to train Claude models
Disallow: /Claude-SearchBotAnthropicBlockedIndexes pages for Claude search answers
Disallow: /Claude-UserAnthropicBlockedFetches a page when a Claude user asks for it
Disallow: /PerplexityBotPerplexityBlockedIndexes pages for Perplexity answers
Disallow: /Perplexity-UserPerplexityAllowedFetches a page when a Perplexity user asks for it
Disallow: /sendarticle/(applies to all crawlers)Google-ExtendedGoogleAllowedA control token, not a crawler: tells Google whether Gemini may use your content
Disallow: /sendarticle/(applies to all crawlers)Applebot-ExtendedAppleBlockedA control token, not a crawler: tells Apple whether its AI models may use your content
Disallow: /AmazonbotAmazonBlockedIndexes pages for Alexa and Amazon answers
Disallow: /meta-externalagentMetaBlockedCollects content for Meta AI
Disallow: /CCBotCommon CrawlBlockedBuilds the open web dataset many AI models train on
Disallow: /BytespiderByteDanceBlockedCollects content for ByteDance AI models
Disallow: /DuckAssistBotDuckDuckGoBlockedFetches pages for DuckDuckGo AI answers
Disallow: /MistralAI-UserMistralAllowedFetches a page when a Le Chat user asks for it
Disallow: /sendarticle/(applies to all crawlers)
ChatGPT-User, Claude-User, Perplexity-User and MistralAI-User fetch pages when a person asks, and may not follow robots.txt rules.
Let AI assistants reach you
These crawlers are blocked. Blocking training crawlers can be a deliberate choice; to let AI assistants find and cite your pages, add these lines to your robots.txt:
User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot-Extended Allow: /
Google search preview
An approximate preview of how this page can look in Google results.
theguardian.com › us
Latest news, sport and opinion from the Guardian
Latest US news, world news, sports, business, opinion, analysis and reviews from the Guardian, the world's leading liberal voice
theguardian.com › us
Latest news, sport and opinion from the Guardian
Latest US news, world news, sports, business, opinion, analysis and reviews from the Guardian, the world's leading liberal voice
Google PageSpeed
PageSpeed data is not available for this audit.
Headings
H2 36, H3 160, H4 20
- H3OpinionFive thinkers on what Democrats should do now
- H3NvidiaWho is Alice Huang, the woman linked to Nvidia’s CEO?
- H3The FilterThe joy of advent calendars
- H3Petsdouble quotation markMae the labrador, who keeps me safe
- H3AIParents and teachers on Google's threat to block search
- H3Guns and liesBlack girls in LA are speaking up on female homicide victims
- H2News
- H3Trump administrationRepublican Thomas Massie moves to force vote to impeach Pete Hegseth
- H3US politics liveDonald Trump doubles down on defense of Pete Hegseth and attacks fresh effort to impeach him
- H3DemocratsProgressives head to US House in record numbers after winning red districts
- H3Stephen MillerHardline Trump aide Stephen Miller takes over as White House chief of staff
- H3Trump administrationFormer RFK Jr adviser accuses Trump officials of prioritizing special interest groups over voters
- H3CaliforniaCalifornia voters fail to pass proposed one-time tax on billionaires’ wealth
- H3PoliticsSenate advances bill to speed up projects from gas pipelines to clean energy
- H3Trump administrationUS supreme court clears way for Trump’s border wall in Texas’s Big Bend
- H3ICEUS citizen shot by ICE officer near children’s bus stop sues government for $25m
- H3Donald TrumpTrump admits deportation policy was ‘too tough’ despite promotion of Stephen Miller
- H3IranTrump says US war in Iran ‘effectively over’ as he plays down escalation concerns
- H3EnvironmentSlight fall in carbon emissions from fossil fuels as Iran war drives renewables push
- H3CaliforniaPolice investigate as nearly 30 Santa Barbara half-marathon runners fall ill with ‘unusual symptoms’
- H3NvidiaSilicon Valley and Trump rally behind Nvidia CEO after his affair with alleged Chinese spy
- H3NvidiaJensen Huang, the ‘Chinese spy’ and Trump: how an affair may have harmed US security
- H3NvidiaWho is Alice Huang, the woman linked to Nvidia’s CEO?
- H3AnalysisJensen Huang’s image has been shattered. Could he be pushed out at Nvidia?
- H3ExplainerWhy is Nvidia’s Jensen Huang at the center of a US-China dispute?
- H3OhioOhio State fraternity suspended after viral video shows two men on fire
- H3Booker prizeM John Harrison becomes first science fiction author to win the Booker prize
- H2US politics
- H3VideoDemocrats' big blue wave wins you may have not heard about
- H3PennsylvaniaJohn Fetterman to be challenged for Senate seat by democratic socialist born in Gaza
- H3US SenateSenate advances bill to speed up projects from gas pipelines to clean energy
- H3Joe BidenJoe Biden to limit White House memoir promotion due to advancing cancer
- H2Special report
- H3Los AngelesBlack girls in LA keep seeing women around them getting killed. They’re driving change
- H2In focus
- H3The Latest Will Russell Brand’s 10-year jail term be a tipping point?
- H3Stateside with Kai and CarterStephen Miller is in. Is Pete Hegseth out? With Ben Rhodes
- H3ExplainerStephen Miller, immigration hardliner, in his own words
- H3FarmingThe rise and rise of the family farm
- H2West coast
- H3ObituaryDolores Huerta: American activist who fought for the rights of farm workers
- H3CaliforniaCruise ship pianist rescued after nine hours treading water miles from shore
- H3San FranciscoDid the Bay Area just save its transit system from the brink of certain death?
- H3Washington state‘The blue wave isn’t applicable to trans people’: advocates in Washington state prepare to fight ban
- H2Features
- H3The pet I'll never forgetdouble quotation markMae the labrador, who keeps me safe with her keen nose and piercing stare
- H3My feelgood movie‘Sadistic, forbidden pleasure’: why Gone Girl is my feelgood movie
- H2More features
- H3double quotation markTrump’s pathetic Dana White gambit could not mask his midterm humiliation
- H3Well actuallyIt’s not too late to get it: what to know about getting the flu vaccine this year
- H3The FilterWhether you’re into makeup, cats or museums, our vetted 2026 Advent calendars have a daily surprise for all
- H3USParents and teachers decry Google pledge to yank Search if schools block AI: ‘This threat is nothing but extortion’
- H3Sports bettingDraftKings and other betting sites urge parents to talk to kids about gambling – but disavow role in incre
- H3Late night recapJohn Oliver on Pete Hegseth’s military plans: ‘Dr Seuss for concussed bigots’
- H2Opinion
- H3How we windouble quotation markTime to fight back: five leading thinkers on what Democrats should do post-midterms
- H3double quotation markNvidia’s board needs to do some succession planning – sharpish
- H3double quotation markTrump is humiliated and angry – and Europe is where he’s free to lash out
- H3double quotation markDiversity, decency and a new south: who were the real winners in the US midterms?
- H2More opinion
- The page has no H1.
- The first heading is an H3, not an H1.
and 156 more
Links on this page
369 links: 346 internal, 23 external, 0 nofollow.
- US politics liveDonald Trump doubles down on defense of Pete Hegseth and attacks fresh effort to impeach him https://www.theguardian.com/us-news/live/2026/nov/09/donald-trump-stephen-miller-immigration-midterms-iran-qatar-economy-latest-news-updatesHard to read address
- EnvironmentSlight fall in carbon emissions from fossil fuels as Iran war drives renewables push https://www.theguardian.com/environment/2026/nov/10/slight-fall-in-carbon-emissions-from-fossil-fuels-as-iran-war-drives-renewables-pushHard to read address
- https://www.theguardian.com/commentisfree/2026/nov/09/the-guardian-view-on-jensen-huangs-affair-why-did-trump-ignore-the-warningsHard to read address
- Soccer with Jonathan Wilson: The latest on the global game https://www.theguardian.com/football/2023/jul/20/sign-up-for-soccer-with-jonathan-wilson-his-free-weekly-newsletter-on-european-soccerHard to read address
- https://www.theguardian.com/australia-news/2026/nov/10/teen-planned-sydney-terror-attack-using-chatgpt-radicalised-tiktok-ntwnfbHard to read address
- https://www.theguardian.com/environment/2026/nov/09/high-fossil-fuel-prices-spread-inflation-like-cancer-cop31egotiator-tells-cop31Hard to read address
- https://www.theguardian.com/environment/ng-interactive/2026/nov/09/extreme-heat-mecca-hajj-pilgrimage-this-is-climate-breakdown-saudi-arabiaHard to read address
- https://www.theguardian.com/science/2026/nov/09/medical-breakthrough-offers-hope-to-people-with-same-stiff-person-syndrome-as-celine-dionHard to read address
- https://www.theguardian.com/music/2026/nov/06/the-weeks-best-new-tracks-and-the-act-you-need-to-know-crowd-pleasing-anticapitalist-rockers-sans-froidHard to read address
- https://www.theguardian.com/music/2026/nov/06/its-a-new-world-its-a-little-fascistic-and-it-needs-a-different-response-u2-on-50-years-together-and-their-undimmed-faith-in-humanityHard to read address
- https://www.theguardian.com/books/2026/nov/07/narrative-threads-how-to-write-a-booker-shortlisted-novel-by-marlon-james-douglas-stuart-elizabeth-strout-and-moreHard to read address
- https://www.theguardian.com/artanddesign/gallery/2026/nov/10/faceless-workers-and-a-tsunami-of-post-it-notes-the-surreal-world-of-japans-salarymen-in-picturesHard to read address
- https://www.theguardian.com/artanddesign/2026/nov/09/the-legacy-of-south-africas-first-black-showjumper-and-his-horse-riding-school-in-soweto-photo-essayHard to read address
- https://www.theguardian.com/lifeandstyle/2026/nov/09/a-job-that-changed-me-as-a-bookseller-i-realised-reading-is-about-connection-and-communityHard to read address
- …… comments https://www.theguardian.com/lifeandstyle/2026/nov/09/a-job-that-changed-me-as-a-bookseller-i-realised-reading-is-about-connection-and-community#commentsHard to read address
Email security
SPF and DMARC records stop others from sending email that pretends to come from this domain.
- SPFFound: only the listed servers may send email (strict)
v=spf1 include:_spf.google.com include:spf_c.oraclecloud.com include:_spf.salesforce.com include:_spf1.theguardian.com ip4:199.255.192.0/22 ip4:199.127.232.0/22 ip4:54.240.0.0/18 ip4:69.169.224.0/20 ip4:23.249.208.0/20 ip4:23.251.224.0/19 ip4:76.223.176.0/20 ip4:54.240.64.0/18 ip4:76.223.128.0/19 ip - DMARCFound: fake emails are rejected
v=DMARC1;p=reject;rua=mailto:dmarcreporting@theguardian.comat _dmarc.theguardian.com
Score history
The overall score of each audit of this site, oldest first.
First audit of this domain
Questions about this report
What is the SEO score of theguardian.com?
theguardian.com scored 64 out of 100, grade D, with technical SEO 85, content 88, answer engines 31, AI readiness 55 and speed not scored.
What should theguardian.com fix first?
Start with AI crawler access: robots.txt blocks tier 1 AI crawlers: ClaudeBot, PerplexityBot. This report has 19 issues to fix in total.
How is the site health score calculated?
Site health is a score from 0 to 100 that combines five category scores. Technical SEO counts for 25%, content counts for 15%, answer engines counts for 20%, AI readiness counts for 25% and speed counts for 15%.
How often can this report be updated?
A new audit can run 24 hours after the last one. To run it, use the Re-analyze button at the top of this page.
Is this audit free?
Yes. Audits are free and need no account.