Home /Code review and quality /pytest-jev
pytest-jev
Pytest plugin that asks Jev whether plain-English claims about a test's text hold, all in one request, and fails the test with each claim's probability unless Jev is at least 80 percent sure.
From the readme
pytest-jev Test what your LLM app's output means, not the exact words. Semantic assertions for pytest, judged by TypeSafe's Jev, a model that returns calibrated probabilities instead of text. Same verdicts as Claude Sonnet 5 on the example tests, 5× faster and 110× cheaper. Benchmark · real runs of jev-1.13 through OpenRouter Quick start · Usage · Benchmark …
pip install pytest-jevDetails
- Section
- Code review and quality
- owner
- allebee
- stars
- 8
- forks
- 1
- pushed
- 2026-09-21
- Language
- Python
- License
- MIT
What it is
- Form
- Hook or plugin
- Host agent
- Standalone
- Audience
- App developers
Maturity
Docs
reports measured numbers