Skip to content

Audit noindex Pages

Checks whether pages are wrongly hidden from search engines via noindex tags or headers

Stars
74,632
Licence
MIT
Files
2 files

What it does

This skill teaches an AI agent to review a website for pages marked with a noindex directive, which tells search engines not to list a page. The agent checks whether important pages such as products or articles are accidentally blocked, and whether noindex is correctly used on admin, utility, or thin-content pages. It asks the agent to verify the final rendered HTML and HTTP headers rather than trusting source files alone, and to flag the exact routes or templates that cause problems.

Great for

  • Front-end or SEO developers preparing a site for launch or after a redesign
  • Marketers investigating why pages have dropped out of search results
  • Teams running a periodic metadata or indexability review

Skip it if

  • Sites where you cannot share the URLs or code with the agent, since it needs real page output to check; results from guesses would be unreliable
  • Making live changes to production SEO settings without a human reviewing the findings, because a wrong noindex fix can affect search visibility

Try asking

  • “Audit my site's pages for noindex tags and tell me which important pages are blocked from search”
  • “Check the rendered HTML and response headers of my product pages for accidental noindex directives”
  • “Explain the difference between noindex and disallow in robots.txt for my blog and recommend which to use”
Step-by-step guide: how to use Audit noindex PagesInstall, first run, examples, tips and FAQs

Install in 3 steps

  1. 1

    Download the skill

    The ZIP contains the 2 original files, the MIT licence and an attribution note.

    all-noindex-pages.zip
  2. 2

    Add it to your agent

    Claude Code (all projects)

    mkdir -p ~/.claude/skills && unzip all-noindex-pages.zip -d ~/.claude/skills/

    Claude Code / Agent SDK (this project only)

    mkdir -p .claude/skills && unzip all-noindex-pages.zip -d .claude/skills/

    Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.

  3. 3

    Ask for the task

    No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.

Get better results

  • Give the agent the list of important URLs or the site's sitemap so it can check the rendered output of each one.
  • Ask for a route-by-route report with the exact template or file responsible, then review fixes yourself before deploying.
  • Read references/rule.md for framework-specific examples if your stack is unusual.

What's inside

  • references/rule.md
  • SKILL.md

Redistributed unmodified from thedaviddias/Front-End-Checklist under the MIT licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.