Home /Open models and replicas /von
von
Non-autoregressive open decision model reporting under 15 ms locally, as a drop-in alternative to Jev.
From the readme
Von An Open-Source, Non-Autoregressive System One Decision Model. Calibrated discrete, probabilistic, and ordinal inference in sub-25ms. Overview Autoregressive large language models (LLMs) decode token-by-token to perform classification, intent routing, and guardrail validation. This generation mechanism introduces substantial key-value cache memory …
Details
- Section
- Open models and replicas
- owner
- wfzyx
- stars
- 62
- forks
- 11
- pushed
- 2026-09-20
- Language
- Python
- License
- Apache-2.0
What it is
- Form
- Library or SDK
- Host agent
- Standalone
- Audience
- App developers
Maturity
Docs
reports measured numbersmocked or unclear Jev call