Skip to content
Get packs

Caveman Experiment Manager

Reads and reviews Caveman Cloud experiments and blocks unsafe lifecycle changes

Source Download skill
Repository
JuliusBrussee/caveman
Stars
116,835
Licence
Apache-2.0
Files
1 file

What it does

This skill teaches an AI agent to inspect experiments in Caveman Cloud, a hosted service, by reading their state and results. The agent summarizes the evidence (sample sizes, quality, cost and guardrail metrics) and proposes one next action, but according to the file it is not allowed to actually start, approve, cancel, promote or roll back an experiment. Requests to change experiments are reported as blocked until the server enforces safety gates.

Great for

  • Operators reviewing whether a Caveman experiment has enough evidence to be considered
  • Teams who want an AI assistant to read experiment data without being able to change production settings
  • Developers auditing how an agent handles production control actions

Skip it if

  • Anyone expecting the agent to actually start, approve, cancel or roll back experiments; the file says execution is intentionally blocked
  • Use without a Caveman Cloud account, since the skill needs a logged-in identity and server access to read anything
  • Making savings claims: the file forbids treating experiment lift as verified savings, so the output should not be used as proof of savings

Try asking

  • “Show me the results for experiment 7f... and tell me whether it is ready to approve”
  • “List the experiments in my current project and their lifecycle states”
  • “Explain why this experiment was rolled back and what the guardrail numbers were”
  • “Is the evidence for this candidate complete, or is anything missing?”
Step-by-step guide: how to use Caveman Experiment ManagerInstall, first run, examples, tips and FAQs

Install in 3 steps

  1. 1

    Download the skill

    The ZIP contains the 1 original files, the Apache-2.0 licence and an attribution note.

    caveman-manage.zip
  2. 2

    Add it to your agent

    Claude Code (all projects)

    mkdir -p ~/.claude/skills && unzip caveman-manage.zip -d ~/.claude/skills/

    Claude Code / Agent SDK (this project only)

    mkdir -p .claude/skills && unzip caveman-manage.zip -d .claude/skills/

    Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.

  3. 3

    Ask for the task

    No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.

Get better results

  • Name a specific experiment id so the agent reads one experiment instead of listing everything
  • If the agent reports evidence incomplete, check the source data before deciding anything, since it will not propose approval in that case
  • After a human runs a change in the Caveman CLI, ask the agent to re-read the experiment so it reports the actual server state rather than assuming success

What's inside

  • SKILL.md

Redistributed unmodified from JuliusBrussee/caveman under the Apache-2.0 licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.