Skip to content
Get packs

Test Flakiness Detective

Finds intermittently failing tests from CI logs and recommends quarantine or fixes

Source Download skill
Repository
Donchitos/Claude-Code-Game-Studios
Stars
32,965
Licence
MIT
Files
1 file

What it does

When installed, the agent can read saved test-run logs from several game engines (Godot, Unity, Unreal) and compare results across multiple runs to find tests that sometimes pass and sometimes fail with no code change. For each one it suggests a likely cause, such as timing, test order, random seeds, or floating-point comparisons, and recommends whether to skip the test temporarily or fix it. It can update a quarantine section in a regression-suite file and optionally write a flakiness report.

Great for

  • Game development teams in a late polish phase with many test runs in their CI history
  • Developers who have started ignoring red CI builds as 'probably flaky'
  • Teams that already keep a list of quarantined tests and want help diagnosing them

Skip it if

  • Projects with fewer than three runs of history: the skill itself treats every finding as only 'suspected' with that little data, so results are weak
  • Non-game or non-supported engine projects: the file only covers Godot (gdUnit4), Unity and Unreal log formats, and parts of the Godot C# guidance are marked as not sourceable
  • Anyone expecting it to fix code automatically: it recommends fixes and can edit the quarantine file, but the root-cause work is still the developer's

Try asking

  • “/test-flakiness scan to look through available CI logs for intermittently failing tests”
  • “/test-flakiness path/to/run-log.xml to analyse one specific test result file”
  • “/test-flakiness registry to get remediation advice for tests already listed as quarantined”
Step-by-step guide: how to use Test Flakiness DetectiveInstall, first run, examples, tips and FAQs

Install in 3 steps

  1. 1

    Download the skill

    The ZIP contains the 1 original files, the MIT licence and an attribution note.

    test-flakiness.zip
  2. 2

    Add it to your agent

    Claude Code (all projects)

    mkdir -p ~/.claude/skills && unzip test-flakiness.zip -d ~/.claude/skills/

    Claude Code / Agent SDK (this project only)

    mkdir -p .claude/skills && unzip test-flakiness.zip -d .claude/skills/

    Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.

  3. 3

    Ask for the task

    No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.

Get better results

  • Save CI logs from several separate runs into test-results/ before running, since the skill needs history to work reliably
  • Review the suggested quarantine and skip changes before accepting them, especially for high-flakiness tests
  • Choose collaborative automation mode if you want to be asked before any file is written

What's inside

  • SKILL.md

Redistributed unmodified from Donchitos/Claude-Code-Game-Studios under the MIT licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.