rubrica
Skill-based test suite generator for agentic systems.
- LanguagePython 3.13+
- Statusearly
- LicenseApache-2.0
Rubrica builds an agent test suite for a target system out of whatever artifacts describe it, by chaining AI skills over a schema-validated, on-disk artifact contract. It proposes scenarios that test the system’s claims, turns surviving scenarios into concrete test cases, attacks the cases to weed out the ones that don’t hold up, and compiles the rest into a runnable suite.
Five phases — select → understand → cover → build → compile — with a human-held gate between them.
Highlights
- Bring any artifact — specs, captured trajectories or source code become a single world model of claims.
- Every arrow is a file on disk — each stage reads and writes schema-validated artifacts you can open and diff.
- Traceable tests — every test traces to a claim, and every claim to the evidence it came from.
- Human gates — you sign off between phases; nothing past a gate runs until you do.