Home /Benchmarks, evals and calibration /jev-phishing-bench

jev-phishing-bench

Jev against Claude Haiku on 2,000 phishing emails: accuracy, calibration, latency, cost.

From the readme

Jev vs LLM: a phishing decision benchmark with a calibration audit By Anisse Lebadi · X @Lbdev · LinkedIn · first published 17 September 2026 Cited by Sophos, beri.net, AWS Builders on dev.to and 80+ pages in 7 languages. Public, reproducible comparison of Jev (TypeSafe AI's System One model, launched 15 September 2026) against a classic LLM on one security …

Details

Section
Benchmarks, evals and calibration
owner
anisselbd
stars
10
forks
1
pushed
2026-10-20
Language
Python
License
MIT

What it is

Form
Dataset or benchmark
Host agent
Standalone
Audience
Researchers
Maturity
Docs
reports measured numbers

Useful for

Best intent matches