
Audit noindex Pages
Checks whether pages are wrongly hidden from search engines via noindex tags or headers
- Repository
- thedaviddias/Front-End-Checklist
- Stars
- 74,632
- Licence
- MIT
- Files
- 2 files
What it does
This skill teaches an AI agent to review a website for pages marked with a noindex directive, which tells search engines not to list a page. The agent checks whether important pages such as products or articles are accidentally blocked, and whether noindex is correctly used on admin, utility, or thin-content pages. It asks the agent to verify the final rendered HTML and HTTP headers rather than trusting source files alone, and to flag the exact routes or templates that cause problems.
Great for
- Front-end or SEO developers preparing a site for launch or after a redesign
- Marketers investigating why pages have dropped out of search results
- Teams running a periodic metadata or indexability review
Skip it if
- Sites where you cannot share the URLs or code with the agent, since it needs real page output to check; results from guesses would be unreliable
- Making live changes to production SEO settings without a human reviewing the findings, because a wrong noindex fix can affect search visibility
Try asking
- “Audit my site's pages for noindex tags and tell me which important pages are blocked from search”
- “Check the rendered HTML and response headers of my product pages for accidental noindex directives”
- “Explain the difference between noindex and disallow in robots.txt for my blog and recommend which to use”
Install in 3 steps
- 1
Download the skill
The ZIP contains the 2 original files, the MIT licence and an attribution note.
all-noindex-pages.zip - 2
Add it to your agent
Claude Code (all projects)
mkdir -p ~/.claude/skills && unzip all-noindex-pages.zip -d ~/.claude/skills/Claude Code / Agent SDK (this project only)
mkdir -p .claude/skills && unzip all-noindex-pages.zip -d .claude/skills/Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.
- 3
Ask for the task
No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.
Get better results
- Give the agent the list of important URLs or the site's sitemap so it can check the rendered output of each one.
- Ask for a route-by-route report with the exact template or file responsible, then review fixes yourself before deploying.
- Read references/rule.md for framework-specific examples if your stack is unusual.
What's inside
- references/rule.md
- SKILL.md
Redistributed unmodified from thedaviddias/Front-End-Checklist under the MIT licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.