Home /Safety, moderation and verification /jev-secret-detection
jev-secret-detection
Measures how well Jev spots real credentials in file snippets, with the hard config-shaped cases scored separately.
From the readme
jev-secret-detection Measures how well TypeSafe's Jev model spots real secret credentials in file snippets. Each test case is sent to Jev as a single Noul question ("does content contain a real secret credential that someone reading it could use?"), and the returned probability is compared with the expected label. There is deliberately no regex matching or …
Details
- Section
- Safety, moderation and verification
- owner
- teyhouse
- stars
- 0
- forks
- 0
- pushed
- 2026-09-18
- Language
- Python
What it is
- Form
- Dataset or benchmark
- Host agent
- Standalone
- Audience
- Researchers
Maturity
Docs
reports measured numbers