Free audit
Menu

SEO, GEO and AEO audit · home page score ·

SEO audit for theguardian.com

theguardian.com scored 64 out of 100 (grade D) in the ratemysite.ai audit of 49 checks across technical SEO, content, answer engines, AI readiness and speed, with 19 issues to fix.

Share this score

theguardian.com

64/100

  • Technical SEO: 85
  • Content and E-E-A-T: 88
  • Answer engines (AEO): 31
  • AI readiness (GEO): 55
  • Speed: not available

Email me about this score

What to email

One email to confirm. Stop any time.

Compare with another site

Show your score on your site

theguardian.com SEO, GEO and AEO score on ratemysite.ai

Audit complete. This site needs work

Summary

Site health score

Grade D

64 out of 100

This site needs work. 19 things to improve.

First audit of this domain

Fix first

19 of 42 checks
Show all 19 issues

Core Web Vitals

  • Largest Contentful Paint not measured

  • Cumulative Layout Shift not measured

  • Time to First Byte not measured

Site health

The other pages were not scanned in this audit.

AI crawler access

6 of 16 allowed
  • GPTBotAllowed
  • OAI-SearchBotAllowed
  • ChatGPT-UserAllowed
  • ClaudeBotBlocked
  • Claude-SearchBotBlocked
  • Claude-UserBlocked
See all 16 crawlers

Google preview

Desktop

theguardian.com › us

Latest news, sport and opinion from the Guardian

Latest US news, world news, sports, business, opinion, analysis and reviews from the Guardian, the world's leading liberal voice

See phone and desktop
See this week's leaderboard

Every check, by category

Technical SEO: grade B+, 85 out of 100

Technical SEO

Technical SEO is good

Whether search engines can crawl, index and understand the page: title, meta description, headings, canonical, HTTPS, robots.txt and sitemap.

Failed: Single H1Medium impact

What we found

no H1 found

Why it matters

An H1 is the top-level heading that says what a page is about. This check passes with exactly 1 H1, fails with none, and warns when a page has 2 or more.

Read the step by step fix guide: Single H1
Failed: Open Graph and Twitter cardsMedium impact

What we found

no Open Graph or Twitter card tags

Why it matters

Open Graph tags are meta tags that control how a link looks when shared. This check needs 4 tags: og:title, og:description, og:image and twitter:card. With none it fails, and with some missing it warns.

Read the step by step fix guide: Open Graph and Twitter cards
Warning: Canonical URLLow impact

What we found

canonical points to https://www.theguardian.com/, page is https://www.theguardian.com/us

Why it matters

A canonical tag is a link in the page head that names the main URL of a page. A missing tag fails, and one that points to another URL gets a warning.

Read the step by step fix guide: Canonical URL
  • Passed: Title tag length

    title is 48 characters

  • Passed: Meta description

    meta description is 128 characters

  • Passed: Heading hierarchy

    216 headings in order

  • Passed: Mobile viewport

    viewport: width=device-width,minimum-scale=1,initial-scale=1

  • Passed: HTML lang attribute

    lang="en"

  • Passed: HTTPS and redirect

    https with http redirecting to https

  • Passed: robots.txt

    robots.txt present and allows crawling

  • Passed: XML sitemap

    sitemap.xml reachable

  • Passed: Indexable (no noindex)

    page is indexable

  • Passed: Image alt text

    all 130 images have an alt attribute, 3 decorative (alt="")

Site insights

What we found on the page beyond the checks. None of it changes the score.

6 of 16 allowed

AI crawler access

Which AI crawlers your robots.txt lets in, and the rule that decides.

6 of 16 allowed, 10 blocked, 0 partly blocked

  • GPTBot OpenAIAllowed

    Collects content to train OpenAI models

    Disallow: /sendarticle/(applies to all crawlers)
  • OAI-SearchBot OpenAIAllowed

    Indexes pages for ChatGPT search answers

    Disallow: /sendarticle/(applies to all crawlers)
  • ChatGPT-User OpenAIAllowed

    Fetches a page when a ChatGPT user asks for it

    Disallow: /sendarticle/(applies to all crawlers)
  • ClaudeBot AnthropicBlocked

    Collects content to train Claude models

    Disallow: /
  • Claude-SearchBot AnthropicBlocked

    Indexes pages for Claude search answers

    Disallow: /
  • Claude-User AnthropicBlocked

    Fetches a page when a Claude user asks for it

    Disallow: /
  • PerplexityBot PerplexityBlocked

    Indexes pages for Perplexity answers

    Disallow: /
  • Perplexity-User PerplexityAllowed

    Fetches a page when a Perplexity user asks for it

    Disallow: /sendarticle/(applies to all crawlers)
  • Google-Extended GoogleAllowed

    A control token, not a crawler: tells Google whether Gemini may use your content

    Disallow: /sendarticle/(applies to all crawlers)
  • Applebot-Extended AppleBlocked

    A control token, not a crawler: tells Apple whether its AI models may use your content

    Disallow: /
  • Amazonbot AmazonBlocked

    Indexes pages for Alexa and Amazon answers

    Disallow: /
  • meta-externalagent MetaBlocked

    Collects content for Meta AI

    Disallow: /
  • CCBot Common CrawlBlocked

    Builds the open web dataset many AI models train on

    Disallow: /
  • Bytespider ByteDanceBlocked

    Collects content for ByteDance AI models

    Disallow: /
  • DuckAssistBot DuckDuckGoBlocked

    Fetches pages for DuckDuckGo AI answers

    Disallow: /
  • MistralAI-User MistralAllowed

    Fetches a page when a Le Chat user asks for it

    Disallow: /sendarticle/(applies to all crawlers)

ChatGPT-User, Claude-User, Perplexity-User and MistralAI-User fetch pages when a person asks, and may not follow robots.txt rules.

Let AI assistants reach you

These crawlers are blocked. Blocking training crawlers can be a deliberate choice; to let AI assistants find and cite your pages, add these lines to your robots.txt:

User-agent: ClaudeBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: Claude-User
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Applebot-Extended
Allow: /

How to fix AI crawler access

Phone and desktop

Google search preview

An approximate preview of how this page can look in Google results.

Phone

theguardian.com › us

Latest news, sport and opinion from the Guardian

Latest US news, world news, sports, business, opinion, analysis and reviews from the Guardian, the world's leading liberal voice

Desktop

theguardian.com › us

Latest news, sport and opinion from the Guardian

Latest US news, world news, sports, business, opinion, analysis and reviews from the Guardian, the world's leading liberal voice

Google PageSpeed

PageSpeed data is not available for this audit.

SPF and DMARC

Email security

SPF and DMARC records stop others from sending email that pretends to come from this domain.

  • SPFFound: only the listed servers may send email (strict)
    v=spf1 include:_spf.google.com include:spf_c.oraclecloud.com include:_spf.salesforce.com include:_spf1.theguardian.com ip4:199.255.192.0/22 ip4:199.127.232.0/22 ip4:54.240.0.0/18 ip4:69.169.224.0/20 ip4:23.249.208.0/20 ip4:23.251.224.0/19 ip4:76.223.176.0/20 ip4:54.240.64.0/18 ip4:76.223.128.0/19 ip
  • DMARCFound: fake emails are rejected
    v=DMARC1;p=reject;rua=mailto:dmarcreporting@theguardian.com

    at _dmarc.theguardian.com

1 audit

Score history

The overall score of each audit of this site, oldest first.

First audit of this domain

5 questions

Questions about this report

What is the SEO score of theguardian.com?

theguardian.com scored 64 out of 100, grade D, with technical SEO 85, content 88, answer engines 31, AI readiness 55 and speed not scored.

What should theguardian.com fix first?

Start with AI crawler access: robots.txt blocks tier 1 AI crawlers: ClaudeBot, PerplexityBot. This report has 19 issues to fix in total.

How is the site health score calculated?

Site health is a score from 0 to 100 that combines five category scores. Technical SEO counts for 25%, content counts for 15%, answer engines counts for 20%, AI readiness counts for 25% and speed counts for 15%.

How often can this report be updated?

A new audit can run 24 hours after the last one. To run it, use the Re-analyze button at the top of this page.

Is this audit free?

Yes. Audits are free and need no account.

This report is older than 24 hours