AutoGineer
Generated banner for Reproduce Regression
Generated logo for Reproduce Regression

Reproduce Regression

Trail of BitsOfficialPublished by Trail of Bits

  • Skill
  • Workflow
  • Security
  • CC-BY-SA-4.0
  • No issues found
Download ZIP

From the author

Use when deploying before/after systems and building a live-system PoC for a regression candidate.
— the description by Trail of Bits

AutoGineer summary

Written by AutoGineer from the skill’s own files, not by the author

The reproduce-regression skill provides a structured procedure for validating potential software regressions by deploying and comparing before and after system states. It emphasizes the use of live environments rather than synthetic tests or mocks to ensure accurate observation of failure conditions. The process requires careful documentation of setup, dependencies, and configurations to create a verifiable record of the regression candidate's behavior.

What it does

  • Verifies input prerequisites against established project standards and security guidance.
  • Deploys live S0 and S1 system versions to trace candidate behavior.
  • Executes a portable proof-of-concept against both deployments to compare results.
  • Records detailed logs, configurations, and tool versions in a structured format.
  • Releases temporary resources while preserving evidence for further analysis.
  • Reports the final status, observed behaviors, and any blockers encountered.

When to use it

  • When you need to validate a regression candidate using live-system deployments.
  • When you have sealed preparation and discovery packages ready for analysis.
  • When you need to confirm if a failure occurs in a real environment rather than a unit test.
  • When you are tasked with creating a reproducible PoC for a regression.

Advantages

  • Ensures high-fidelity results by avoiding mocks and simulated systems.
  • Standardizes the documentation of regression evidence for consistent reporting.
  • Provides a clear path for handling blocked attempts and missing prerequisites.
  • Maintains a strict separation between experimental setup and final evidence.

Usage examples

“Reproduce the regression candidate identified in the latest security audit.”
The agent will verify the input packages, deploy the S0 and S1 environments, execute the PoC, and return a status report with the observed behavior.
“I need to confirm if the recent update introduced a regression in the authentication module.”
The agent will follow the workflow to build the live systems, run the comparative PoC, and document the findings in a sealed package.

Install

  1. Download the skill as a ZIP:

    https://mp-staging.autogineer.com/agent-skills/trailofbits/reproduce-regression/download

  2. Unzip it into the cross-client skills folder of your project:

    mkdir -p .agents/skills && unzip reproduce-regression.zip -d .agents/skills

Documentation by Trail of Bits

Reproduce a candidate

When to Use

Input: sealed preparation/discovery packages, candidate and registry assignment. Follow project guidance before target work.

When NOT to Use

Independent verification of an existing PoC; use replay.

Reproduce

  1. Read the standard and file contract. Verify inputs; read security guidance. Stop execution if prerequisites fail.

  2. Build and run actual S0/S1 with required services. Trace the candidate to a real user/attacker entry point. Build/install CLIs and libraries; exercise supported interfaces. For build findings, execute the supported build workflow.

  3. Create and execute a portable PoC against both live deployments with identical input and comparable configuration. Record whether S0 behaves correctly and S1 exhibits the claimed failure. No mocks, extracted functions or simulated systems.

  4. Save setup, tool/dependency versions, sanitized configuration, input, PoC, revisions, commands and separate logs. Record observations and false-positive checks in reproduce.json. If blocked, retain attempted setup and exact prerequisites. Build and deploy only inside your attempt directory, and list every build directory in build_dirs.

  5. Release temporary resources without deleting evidence. Record their disposition, then seal the package.

Report Back

Keep detailed evidence in the sealed package. Return only:

  • Status: complete or blocked, matching the record.

  • Record: sealed reproduce.json path, or why none was produced.

  • Result: one sentence describing observed S0/S1 behavior.

  • Blocker: missing prerequisite or required caller action, if blocked.

Completion means the experiment finished, not that the regression is confirmed.

Rationalizations to Reject

  • “The unit test proves it”: synthetic tests cannot establish a regression.

Files

ATTRIBUTION.md

Attribution

This folder is an unmodified copy of the Agent Skill "reproduce-regression", distributed by AutoGineer (https://autogineer.com/agent-skills).

The skill's own files are unmodified copies. AutoGineer is not affiliated with or endorsed by the author or the publisher.

Files added by AutoGineer

  • ATTRIBUTION.md: this file, written by AutoGineer

  • LICENSE: copied from LICENSE

Requirements and compatibility

Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta

“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.

Security

No issues found by our static scan· No issues found

A static scan is not a guarantee. Skills are third-party content: review a skill before you let an agent use it.

Attribution and licence

Published by
Trail of Bits
Publisher
Trail of Bits (Official)
Source
trailofbits/skills · plugins/regression-hunt/skills/reproduce-regression · commit e4dd0bb
Licence
Creative Commons Attribution-ShareAlike 4.0 International (redistribution allowed)
  • LICENSE (added by AutoGineer from LICENSE)
  • ATTRIBUTION.md (written by AutoGineer)
Synced

AutoGineer is not affiliated with or endorsed by Trail of Bits.

Download ZIP

The ZIP holds the skill’s files, its licence files and an ATTRIBUTION.md. Download reproduce-regression.zip