How to find and remove an accidental noindex tag
A stray noindex directive, in a robots meta tag or an X-Robots-Tag header, removes the page from search results entirely. It is usually left over from a staging site. Search the HTML and response headers, remove the directive, and request indexing again.
By ratemysite.ai editorial team. Updated .
How do you fix it?
- View the page source and search for "noindex" in any <meta name="robots"> or <meta name="googlebot"> tag.
- Run curl -I on the URL and look for an X-Robots-Tag header that contains noindex.
- Remove the tag in your CMS setting, template or server config; also check your CDN rules and SEO plugin.
- Make sure the page is not blocked in robots.txt, or Google will never see that the tag was removed.
- Use Search Console URL Inspection to request indexing, then re-run the audit.
What is a noindex directive?
A noindex directive is an instruction to search engines to leave a page out of their index. It can be a meta tag in the HTML or an X-Robots-Tag HTTP header. When Google finds it, the page drops from results after the next crawl. The most common cause is a site built on a staging server with "discourage search engines" switched on, then launched with the setting unchanged. One forgotten checkbox can hide an entire site. Google has supported the noindex rule in the robots meta tag for many years, and a fix needs only 3 steps: find the directive, remove it and request a recrawl.
Where do accidental noindex tags hide?
Check four places: the page template, the SEO plugin settings for that post type, the server or CDN headers, and the CMS global visibility option. Header based directives are easy to miss because they do not appear in the source. Compare a few key pages, because a rule may apply only to one section such as a blog category. After fixing it, wait for a recrawl and confirm in Search Console that the page status changes from excluded to indexed.
How much does this check matter?
- This check is worth about 2.9% of the overall score.
- A finished report is reused for 24 hours before you can re-analyze it.
- Each page is fetched with a timeout of 10 seconds, and HTML larger than 2 MB is not audited.
What else do people ask?
- How long until the page returns to Google?
- Usually days to a few weeks after the next crawl. Requesting indexing in Search Console can speed it up.
- When is noindex the right choice?
- Use it for thank-you pages, internal search results, login pages and thin duplicates that should not appear in search.