Home /Benchmarks, evals and calibration /jev-phishing-bench
jev-phishing-bench
Jev against Claude Haiku on 2,000 phishing emails: accuracy, calibration, latency, cost.
From the readme
Jev vs LLM: a phishing decision benchmark with a calibration audit By Anisse Lebadi · X @Lbdev · LinkedIn · first published 17 September 2026 Cited by Sophos, beri.net, AWS Builders on dev.to and 80+ pages in 7 languages. Public, reproducible comparison of Jev (TypeSafe AI's System One model, launched 15 September 2026) against a classic LLM on one security …
Details
- Section
- Benchmarks, evals and calibration
- owner
- anisselbd
- stars
- 10
- forks
- 1
- pushed
- 2026-10-20
- Language
- Python
- License
- MIT
What it is
- Form
- Dataset or benchmark
- Host agent
- Standalone
- Audience
- Researchers
Maturity
Docs
reports measured numbers