How to keep your HTML under 1 MB for crawlers
The ratemysite.ai audit caps HTML at 2 MB and warns above 1 MB; these are our thresholds, not Google's. Googlebot documents a limit of 15 MB per file. Move inline JSON and CSS to external files and paginate long lists to stay well under both.
By ratemysite.ai editorial team. Updated .
How do you fix it?
- Measure the HTML size with curl -s https://yourdomain/page | wc -c, or look at the document row in browser Network panel.
- Look for large inline blocks: embedded JSON state, base64 images, big inline CSS and repeated markup.
- Move scripts, styles and data to external files, and replace base64 images with normal image files.
- Paginate or lazy-load very long lists and tables so each page stays under 1 MB.
- Enable gzip or Brotli compression, then re-run the audit.
Why does HTML size matter to crawlers?
HTML size is the number of bytes in the document itself, not counting images, scripts or styles loaded separately. Crawlers fetch a limited amount per page, and anything beyond the limit may be ignored. If your structured data or footer links sit after a 3 MB block of inline data, they may never be read. Large documents also take longer to parse, which delays rendering for visitors on slow phones.
What usually makes HTML too big?
The biggest offenders are framework state dumped into the page as JSON, base64 encoded images, huge inline style blocks, and very long tables or comment threads rendered all at once. View the source and look for lines with thousands of characters. Move shared styles into a cached stylesheet, serve images as files, and split long lists across pages of 20 to 50 items. After the cleanup, most pages land well under 200 KB. Re-measure after each release, because a single new widget can add hundreds of kilobytes of inline data without anyone noticing.
How much does this check matter?
- This check is worth about 1.2% of the overall score.
- A finished report is reused for 24 hours before you can re-analyze it.
- Each page is fetched with a timeout of 10 seconds, and HTML larger than 2 MB is not audited.
What else do people ask?
- Is the size measured before or after compression?
- Crawler limits apply to the uncompressed HTML, so measure the raw size, even though compression helps transfer time.
- What is a healthy HTML size?
- Most content pages are under 100 KB. Anything over 500 KB deserves a look at what is inlined.