Home /Benchmarks, evals and calibration /cultivar
cultivar
Pinecone's skill-testing CLI, with a Jev grading backend it reports at about 30 times cheaper than the LLM grader.
From the readme
cultivar A CLI tool to help you write tests for skills, test them across agents, and iterate until they work, from the Pinecone DevRel team. Test how well skills work against tasks, across agents, locally and remotely. Customize sandboxes for how agents should start, and graders for how agents should work. Use traces to iteratively refine skills and …
Details
- Section
- Benchmarks, evals and calibration
- owner
- pinecone-io
- stars
- 40
- forks
- 2
- pushed
- 2026-09-18
- Language
- Python
- License
- MIT
What it is
- Form
- CLI
- Host agent
- Any agent
- Audience
- Agent builders
Maturity
Docs
reports measured numbers