Home /Benchmarks, evals and calibration /jev-fanout-bench
jev-fanout-bench
Measures what a Jev request is billed and how its answers hold up under batching, translation, and rewording, from 3,455 billed requests with public raw logs.
From the readme
jev-fanout-bench A reproducible measurement of one claim about Jev, TypeSafe AI's System One decision model: Jev ingests the state once and evaluates every question against it in parallel. — TypeSafe, Models If that holds on the bill, asking N questions in one request should cost the state once, and asking them in N requests should cost it N times. …
Details
- Section
- Benchmarks, evals and calibration
- owner
- blowxian
- stars
- 0
- forks
- 1
- pushed
- 2026-10-01
- Language
- Python
- License
- MIT
What it is
- Form
- Dataset or benchmark
- Host agent
- Standalone
- Audience
- Researchers
Maturity
Docs
reports measured numbers