Skip to content
Get packs

Add Product E2E Eval

Adds or extends full-stack end-to-end eval workflows for the Paperclip runner, with evidence and reporting.

Source Download skill
Repository
paperclipai/paperclip
Stars
110,078
Licence
MIT
Files
1 file

What it does

This skill guides an AI agent through adding or changing a Product E2E eval inside the Paperclip repository. These evals run a real browser (Chromium), the Paperclip server, a database, the runner and a model provider, optionally on Daytona cloud sandboxes, and check whether a user workflow actually succeeded. The agent is told to follow the repo's existing catalog, fixture, matcher and report patterns, keep credentials out of tracked files, and run credential-free checks before any paid or live run.

Great for

  • Engineers maintaining Paperclip's runner end-to-end test suite
  • Contributors adding a new user-journey eval case with grading and evidence
  • Maintainers reviewing how Product E2E results are classified and reported

Skip it if

  • Users who just want general web testing: it is specific to the Paperclip repository and its test layout (tests/runner-e2e, packages/paperclip-runner).
  • Live runs without authorization: the skill describes full campaigns as paid, and live runs need provider and Daytona credentials, so they can incur cost and expose secrets if handled carelessly.
  • Protocol-level runner tests against the mock control plane: the skill says those belong to a different skill (add-runner-eval).

Try asking

  • “Add a new everyday workflow eval for creating a project and verifying the result in the UI”
  • “Extend the fixture registry and matcher for an existing Product E2E case”
  • “Run the credential-free typecheck, unit and list checks for the runner e2e suite”
  • “Investigate why a Product E2E attempt failed and attribute it to product, provider or infrastructure”
Step-by-step guide: how to use Add Product E2E EvalInstall, first run, examples, tips and FAQs

Install in 3 steps

  1. 1

    Download the skill

    The ZIP contains the 1 original files, the MIT licence and an attribution note.

    add-product-e2e-eval.zip
  2. 2

    Add it to your agent

    Claude Code (all projects)

    mkdir -p ~/.claude/skills && unzip add-product-e2e-eval.zip -d ~/.claude/skills/

    Claude Code / Agent SDK (this project only)

    mkdir -p .claude/skills && unzip add-product-e2e-eval.zip -d .claude/skills/

    Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.

  3. 3

    Ask for the task

    No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.

Get better results

  • Start with the credential-free commands (typecheck, unit, --list) and only then move to a single explicit --id live run.
  • Ask the agent to name the nearest existing case and matcher to copy, so new work matches the suite's structure.
  • Review the README, FIXTURES, SECURITY and EVERYDAY-WORKFLOWS docs in the repo, since the skill defers to them as authoritative.

What's inside

  • SKILL.md

Redistributed unmodified from paperclipai/paperclip under the MIT licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.