Testing with Specimens
What are specimens?
Section titled “What are specimens?”Specimens are real project snapshots stored on orphan branches. Any skill that operates on source code can use them for testing.
Available specimens
Section titled “Available specimens”| Specimen | Description |
|---|---|
specimen/python/fastapi |
FastAPI REST API service |
specimen/ts/express |
Express.js TypeScript REST API |
Delta branches
Section titled “Delta branches”Delta branches add small, targeted changes with intentional findings:
| Delta | Description |
|---|---|
specimen/python/fastapi-delta-docs |
FastAPI with intentional missing documentation |
specimen/ts/express-delta-docs |
Express with intentional missing documentation |
Running tests
Section titled “Running tests”Agent-assisted (recommended)
Section titled “Agent-assisted (recommended)”/test-resource document specimen/python/fastapiThe /test-resource meta-skill:
- Checks out the specimen branch to a temp directory
- Runs the skill against the specimen
- Validates output against expected structure
- Reports pass/fail with details
Manual
Section titled “Manual”python3 scripts/list_specimens.py # list all specimens and deltasCreating a new specimen
Section titled “Creating a new specimen”-
Create an orphan branch:
Terminal window git checkout --orphan specimen/<lang>/<framework> -
Add a real project snapshot (not toy code — real dependencies, real structure)
-
Commit and push the orphan branch
-
Optionally create delta branches for targeted test scenarios:
Terminal window git checkout -b specimen/<lang>/<framework>-delta-<name> specimen/<lang>/<framework># make targeted changesgit commit -m "delta: <description>"
See the How to Add a Specimen guide for details.