Home /Open models and replicas /mini-jev

mini-jev

Preregistered experiment on a frozen Qwen3-4B: read the option letter's logits, skip the JSON.

From the readme

mini-Jev · read the letter What a Jev-style interface looks like on a frozen model: classify against a schema that arrives with the request by reading next-token logits, not by generating JSON. Measured on Qwen3-4B. TypeSafe's Jev is trained for typed decisions without open generation. mini-Jev asks how much of that interface an ordinary frozen model …

Details

Section
Open models and replicas
owner
r-ms
stars
26
forks
2
pushed
2026-09-18
Language
Python
License
MIT

What it is

Form
Dataset or benchmark
Host agent
Standalone
Audience
Researchers
Maturity
Docs
mocked or unclear Jev call

Useful for

Best intent matches