typesafe-sdk-js
TypeScript and JavaScript client with answer types inferred from your questions.
SDK or client libraryOutput verification
Home / All projects
All projects
Search and filter every project on the list. Local search finds candidates; Jev reorders the top 30.
/ to search
system-one-adapter-python
Same `TypeSafeClient` interface backed by an LLM API, so you can compare Jev against a chat model on identical questions.
Benchmarks and evalsSDK or client library
skills
Agent skills for designing questions, building workflows, and evaluating them.
Output verificationClassification and extraction
Agent skill
How to install the official skill in Claude Code, Cursor, and friends.
Vercel AI SDK provider
`@ai-sdk/typesafe-ai` exposes Jev through `experimental_evaluate`.
Output verificationBenchmarks and evals
eve
Vercel's agent framework; Jev is the typed judge in its evaluate step.
Output verificationPlaygrounds and demos
ai-cli
The Vercel AI SDK in your terminal, with an evaluate path that runs on Jev.
Output verificationBenchmarks and evals
fast-jev-compaction
Replaces the compaction summary with Jev decisions: every tool call and result scored in one request, stale ones dropped, everything kept stays verbatim.
Context compactionSDK or client library
jev-router
Routes each task to the cheapest Claude model that can handle it.
Model routingCommand line tooling
winnow
Judges every tool result before it enters context, so the window fills slower instead of being cleaned later.
Context compactionTool gating and guardrails
yoshi
Context-pruning proxy for Claude Code and Codex, with the savings measured rather than claimed.
Context compactionPlaygrounds and demos
skillranker
Rust CLI and hooks that rank installed skills for the next step using live session context, with abstention.
Playgrounds and demosCommand line tooling
jcm-router
Local proxy that picks model and effort per message and leaves the cached main chat alone.
Model routingPlaygrounds and demos
jev-skillful
Per-prompt router over skills, MCP servers, agents, and commands, and it measures whether the injection helped.
Context compactionBenchmarks and evals
limpet
A Stop hook that keeps the agent from stopping too early, judged against plain-language rules.
Tool gating and guardrails
jevwire
MCP server, embeddable decision model, and an escalate-only plugin that can make the harness stricter but never looser.
Tool gating and guardrailsMCP and agent integration
jev-code
Command-line toolkit that coding agents hand judgment-heavy work to, one typed Jev workflow per request.
Code reviewOutput verification
vexjoy-agent
Agent toolkit whose `/d` command picks the specialist agent, skill, and pipeline with one Jev call, plus an optional Jev auto-compact plugin.
Tool gating and guardrailsModel routing
save-token-jev
Compaction that asks Jev which tool calls still matter and keeps the rest verbatim, with adapters for Claude Code, Codex, OpenCode, and raw API transcripts.
Context compactionSDK or client library
jev-pruner
Trims long Bash output with Jev after the command runs and before the model sees it; short output, errors, and structured formats pass untouched.
Context compaction
jev-rules
Scores your standing rules against each prompt and delivers only the ones that apply, once per session.
Context compactionPlaygrounds and demos
jev-belay
Stop hook that blocks an unverified "done": reads the transcript for evidence and, only when files changed with no passing check since, spends one four-question Jev call; fails open on every error path.
Output verificationTool gating and guardrails
jev-use
Hands the Claude Code, Codex and pi steps that need no text output to Jev, with a typed escalation contract for everything it should not decide.
Context compactionTool gating and guardrails
jev-codex-router
Picks model, thinking depth, and speed mode for every Codex turn.
Model routingPlaygrounds and demos
pi-jev by y0usaf
A measured tool-call gate plus a `jev_ask` tool for typed answers inside Pi.
Tool gating and guardrailsOutput verification
pi-warden
Guardrails that steer instead of interrupt: irreversible calls, off-task calls, stuck loops, unverified done claims, about 250 ms each.
Tool gating and guardrailsOutput verification
pi-jev-auto-mode
Auto-approves bash, write, and edit calls semantically and fails closed when it cannot decide.
Tool gating and guardrailsOutput verification
pi-jev by TheoOliveira
Semantic tool routing and typed decisions as Pi tools.
Output verificationPlaygrounds and demos
pi-jev-router
Automatic model routing for Pi through the Vercel AI Gateway.
Playgrounds and demosModel routing
pi-fast-jev-compaction
The verbatim compaction idea, ported to Pi.
Context compactionPlaygrounds and demos
bicameral
Hybrid harness for Pi: an LLM writes the code, Jev reflexes gate every call as allow, confirm, block, warn, or steer.
Tool gating and guardrailsOutput verification
pi-quiet-ask
Jev as the Pi coding agent's quiet decision layer.
Tool gating and guardrailsOutput verification
pi-typesafe-jev
Pi extension exposing Jev judgments as five Pi tools.
Output verificationTool gating and guardrails
pi-typesafe
Batched evaluation tool, terminal playground, and a typed API for Pi extension authors.
Playgrounds and demosOutput verification
pi-heed
Checks every side-effecting tool call against what you said earlier in the session, so "review only" still holds after compaction.
Tool gating and guardrailsContext compaction
pi-jev-sentinel
Checks Pi tool calls, tool outputs, and replies for risky actions and prompt injection, with user approvals, context re-checks, secret scrubbing, and optional task pinning.
Tool gating and guardrailsOutput verification
pi-mcp-adapter
Opt-in typed evaluation and semantic search over MCP tool results, behind a per-server data-egress allowlist.
Context compactionTool gating and guardrails
typesafe-skill-router
Names the one skill worth loading before the model call; stdlib only, about a tenth of a cent per turn.
Context compactionPlaygrounds and demos
jev-agent-skill-router
Confidence-aware skill routing with an abstain path.
Tool gating and guardrailsModel routing
hermes-jev
Typed decisions, ranking, verification, and an opt-in tool gate.
Tool gating and guardrailsContext compaction
ask-jev-skill
Lets Hermes and similar agents ask Jev directly.
Output verificationTool gating and guardrails
hermes-jev-plugin
Four Hermes tools for atomic checks, routing, and rubric scoring; listed in the Hermes plugin catalog.
Output verificationTool gating and guardrails
hermes-jev-approvals
Approves, denies, or escalates flagged shell commands before they run; vendor-reported speedups.
Tool gating and guardrails
a0-typesafe-ai
Typed tools and probability cards for Agent Zero.
Output verificationPlaygrounds and demos
skillbox
Self-hosted, versioned skills library served over MCP, with Jev recommending which skill to load.
MCP and agent integrationPlaygrounds and demos
jev-mcp by jkudish
The first MCP server for Jev, and still the most linked.
MCP and agent integrationClassification and extraction
jev-mcp by blakestone-x
Classify, score, check, match, and screen, with confidence on every answer.
MCP and agent integrationOutput verification
Jevbridge
ACP and MCP adapter that pairs Jev with any LLM for computer use and typed decisions.
MCP and agent integrationTool gating and guardrails
jev-eval-mcp
Eval-first MCP server: prototype a question, map it over many items, then measure variants against labeled examples with a threshold sweep.
Benchmarks and evalsOutput verification
azdaja
Recursive language model layer for Claude Code, Codex, Gemini, and OpenCode that keeps full sources in a local evaluator; Jev is an optional leaf for reranking, verification, classification, and semantic joins, with budgeted, checkpointed batches.
Output verificationClassification and extraction
building-with-jev-skill
Skill for writing and improving programs that call Jev.
Output verificationSDK or client library
jev-system-architect
Finds the fuzzy judgment in a system and turns it into small Choice, Score, and Noul primitives.
Classification and extractionOutput verification
jev-judgment
Sends a coding agent's closed judgments to Jev instead of the chat model.
Output verificationTool gating and guardrails
skills by fabricioctelles
Agent-skill directory that can score subjective evaluation criteria with Jev.
Output verificationBenchmarks and evals
Augustus
Skill for deciding where a typed judgment belongs at all and what stays in code; a companion to the official skill, not a replacement.
Output verificationModel routing
jev-ultrafast
One request picks both the operation and the target element from an indexed DOM table; a small LLM only writes typed text. Zürich to London booked in 7.1 seconds.
Playgrounds and demosBrowser and computer use
typesafe-computer-use
OCR the screen, classify the next action, click; about $0.0002 a step on macOS.
Browser and computer useTool gating and guardrails
mobile-jev
The same loop on a real Android phone; nine Uber actions in 21 seconds in the demo.
Playgrounds and demosMobile automation
jev-browser by jkudish
The first community browser agent on Jev, with a demo GIF.
Playgrounds and demosMCP and agent integration
jev-voice-browser
Intent and target decided per spoken word in about 300 ms, often before the sentence ends.
Voice and realtimePlaygrounds and demos
jev-browser by Ying-Kai-Liao
An LLM plans, Jev decides; library, CLI, and MCP server.
MCP and agent integrationTool gating and guardrails
jev-browser by tontoko
One grounded Jev and Playwright core behind a typed SDK, a persistent CLI, and an MCP server.
MCP and agent integrationSDK or client library
jev-mobile
Android sub-agent over USB running observe, normalize, decide, mutate, verify, with Jev deciding.
Mobile automationTool gating and guardrails
jev-ego
Browser agent that spends one Jev request per step to pick the action.
Playgrounds and demosBrowser and computer use
jev-browser-use
Codex skill and plugin where Jev handles navigation, clicks, and scrolling and Codex keeps typing and verification; reports browser steps 5 to 10 times faster.
Playgrounds and demosBrowser and computer use
Jev-cu
Codex computer use where Jev picks the element, action, completion, and risk from on-screen text, no screenshots sent; Chinese readme.
Tool gating and guardrailsBrowser and computer use
JevScout
Job-hunting skill that drives Chrome over CDP and has Jev score every link and listing.
Browser and computer usePlaygrounds and demos
SemIf
Semantic ifs from open models on a single 3090; the most starred independent replica, formerly openjev.
Tool gating and guardrailsClassification and extraction
jevlike
Open option scorer that reads candidate logits instead of generating JSON.
Tool gating and guardrailsPlaygrounds and demos
NanoJev
0.6B replica with parallel decisions, dynamic candidates, and an end-to-end training pipeline.
Benchmarks and evalsPlaygrounds and demos
openjev-sglang
Jev-compatible API endpoint on SGLang, prefill only.
SDK or client libraryPlaygrounds and demos
jev-visual
Educational visual-inference variant on Apple Silicon: shared context, direct candidate scoring.
Command line toolingSDK or client library
reflex
Small open decision model on Qwen3.5: state plus typed questions to calibrated probabilities.
Open-model replicasPlaygrounds and demos
jevmlx
Parallel constrained decisions for any MLX model on Apple Silicon, one forward pass.
Classification and extractionPlaygrounds and demos
mini-jev
Preregistered experiment on a frozen Qwen3-4B: read the option letter's logits, skip the JSON.
Benchmarks and evalsClassification and extraction
system-one-open
Typed calibrated decisions in one forward pass on Gemma 4 E2B and Gemma 3 270M.
Classification and extractionPlaygrounds and demos
Verdict-open-jev
Non-autoregressive decision engine on ModernBERT with calibrated uncertainty and an in-browser WebGPU playground.
Benchmarks and evalsClassification and extraction
jevfire
Parallel decisions for CUDA LLMs through a vLLM API, with game-agent examples and benchmarks.
Playgrounds and demosGames and simulation
jevbetter
A stronger one-pass scorer with a head-to-head benchmark against the jevlike starter design.
Model routingBenchmarks and evals
open-alternative-jev
Typed, calibrated decisions from any open-weights model in one forward pass, on Hugging Face and vLLM.
Open-model replicasBenchmarks and evals
openjev by zhihz
Bilingual local decisions from context, questions, and candidate answers.
Output verificationBenchmarks and evals
jev-on-a-laptop
Study of Jev-style decisions on stock 1.5B to 8B models on a laptop, with a Hugging Face demo.
Benchmarks and evalsPlaygrounds and demos
typesafe-ai-benchmark
LLM gateway that mimics the TypeSafe response shape, useful as a stand-in while you wait for a key.
Benchmarks and evalsOutput verification
Parallel constrained decoding
Hugging Face Space demonstrating RLCD-style parallel decoding on Qwen2.5-1B.
openvons
Open decision layer answering a finite option set with probabilities split into execute, confirm, and reject. Independent replica, not TypeSafe weights.
Tool gating and guardrailsVoice and realtime
von
Non-autoregressive open decision model reporting under 15 ms locally, as a drop-in alternative to Jev.
Classification and extractionOpen-model replicas
litjev
Turns any off-the-shelf LLM into a Jev-style decision layer.
SDK or client libraryPlaygrounds and demos
open-jev
Typed JSON inference with DiffusionGemma, benchmarked against Jev.
Benchmarks and evalsOutput verification
kev
LoRA adapter and readout head on Qwen2.5-0.5B that answers many typed questions in one prefill; trains in under two hours on a MacBook, held-out ECE 0.065, speaks the TypeSafe wire format.
Playgrounds and demosOpen-model replicas
simple-jev
Reads next-token logits from any Hugging Face model for choice, rubric, and support questions; public demo API with no key.
Playgrounds and demosClassification and extraction
OpenJev by razorback16
Jev-compatible decision server on DiffusionGemma 26B through vLLM, images included, hosted free on [Codiv](https://codiv.ai).
Open-model replicasSDK or client library
openjev by daseinlabs
Prefills once and scores every option in one padded pass on Gemma 3 4B with MLX; plays Doom from the terminal in the demo.
Playgrounds and demosBenchmarks and evals
jeff by logan-markewich
Self-hosted System One API on the 400M GLiFormer, with benchmarks that say where it trails Jev.
SDK or client libraryOpen-model replicas
JevForge
End-to-end stack for auditable data construction, Qwen3.5-0.8B training, fixed Mind2Web and OOD evaluation, local serving, and a preliminary RLCD baseline.
Benchmarks and evalsPlaygrounds and demos
PlayJev
Plays ten browser games from the frame alone on a fine-tuned Qwen3.5-0.8B, one forward pass per move, open weights and a browser demo.
Playgrounds and demosBenchmarks and evals
jev-review by devagrawal09
Staged code-review workflow with a local dashboard.
Code reviewOutput verification
jev-review by NiazMorshed2007
Local-first MCP plugin for continuous quality review by coding agents.
MCP and agent integrationOutput verification
foreman
Supervises a software factory of agents, with Jev making the go and no-go calls.
Output verificationPlaygrounds and demos
clean-code-review
Every file in a PR judged against Clean Code rules, then reviewed by an LLM.
Code reviewPlaygrounds and demos
commit-miner
Classifies commit diffs and messages: bug fixes, security fixes with CWEs, change types.
Code reviewPlaygrounds and demos
jev-review-action
GitHub Action for submission review and PR classification with Jev, no text-generation model in the loop.
Code reviewPlaygrounds and demos
jev-triage
Pulls large repositories and triages their issues with typed Jev questions.
Output verificationPlaygrounds and demos
perch
Semantic linting: rules in plain language, each file judged by Jev, run locally or in CI.
Code reviewPlaygrounds and demos
jeff by Alurith
Read-only Go CLI that checks files against coded rules such as hidden side effects and weak error handling.
Code reviewPlaygrounds and demos
jev-pref
Turns the preferences in your AGENTS.md into a linter that runs on code changes and reports back to the agent.
Code reviewOutput verification
jev-commit
Pre-commit hook: one Jev call judges whether the commit message matches the staged diff, plus debug leftovers, unmentioned work, and a credential belt; warns except on a secret, which it blocks.
Output verificationPlaygrounds and demos
tiershift
Shifts every LLM call to the cheapest model that can handle it, policy in YAML, decision in about 180 ms.
Model routingPlaygrounds and demos
agent-router
Picks Cursor, Claude Code, Codex, or OpenCode plus model and effort for a task, then launches it.
Model routingCommand line tooling
Janus
Measures on your data when Jev beats other models, then routes accordingly.
Benchmarks and evalsModel routing
JevRouter
Models, subagents, skills, MCP tools, and CLIs as one candidate set; Jev picks, the router enforces permissions and risk; reports 44 percent first-five tool-call hits against 24 for DeepSeek on Toolathlon.
Tool gating and guardrailsModel routing
jev-gateway
Local gateway for Codex and Claude Code that sends the "which tool next" decision to Jev and everything else to your usual model.
Tool gating and guardrailsPlaygrounds and demos
jev-search
Source selection, query understanding, and relevance ranking for web search.
Search rerankingPlaygrounds and demos
reranker
Jev as a calibrated reranker: one call, up to 30 documents, a probability per document.
Search rerankingBenchmarks and evals
llama-index-jev
LlamaIndex reranker and router, cheaper than an LLM judge.
Search rerankingModel routing
jev-folio-recursive-classifier
Classifies OCR'd legal agreements through the FOLIO Document Types ontology with recursive Jev Choices, beam search, confidence-gated leaf stopping, and context-length benchmarking.
Classification and extractionBenchmarks and evals
jev-sift
MCP tool that scores a batch of files, URLs, or snippets for relevance so the agent opens only what matters.
MCP and agent integrationContext compaction
jev-scout
Rust CLI and MCP server that finds real, maintained repos and crates for a plain-language request, with Jev scoring the candidates.
Command line toolingMCP and agent integration
pg-jev
PostgreSQL extension that answers plain-language questions about your tables.
Data pipelines and SQLPlaygrounds and demos
vgi-typesafe
DuckDB worker that exposes choice, noul, and score as lateral-joinable table functions in SQL.
Data pipelines and SQLClassification and extraction
jevsql
SQL with natural-language predicates over SQLite: filter, rank, and classify rows by meaning, batched and cost-guarded.
Output verificationSearch reranking
sqlite-jev
Adds Jev Noul, Choice, and Score judgments to SQLite through a loadable C extension and Python wrapper, with scalar functions and batched virtual-table queries.
Classification and extractionData pipelines and SQL
jevlogs
Scores OpenTelemetry log signal before paying for LLM analysis.
SDK or client libraryModel routing
jev-curate
Sifts Parquet and JSONL training data at more than 1,500 rows a second.
Output verificationCommand line tooling
HA-Jev
Home Assistant integration: ask a question about your house, get a probability, choice, or score as an entity.
Playgrounds and demosVoice and realtime
jev-for-engineers
Eight small examples from mechanical and electrical engineering: CAD routing, FEM triage, DFM screening, BOM alignment.
Playgrounds and demosClassification and extraction
jlink
Links records across two datasets from a match rule written in plain English, from Python, the shell, Stata, or R, and reports F1 0.73 against 0.69 for tuned string matching on NBER patent assignees to Compustat.
Command line toolingOutput verification
pg_typesafe
Pre-alpha PostgreSQL extension for categorical classification with Jev.
Data pipelines and SQLPlaygrounds and demos
jev-mode
Ticket triage and file tagging on a typed-judgment model; reports 78 percent fewer tokens and 96.1 percent accuracy against a 93.7 percent baseline.
Classification and extractionContext compaction
jev-reviewer
Asks a clinical trial report for systematic-review data by voice, text, or a questions file; every answer is a verbatim quote with its file and place.
Classification and extractionOutput verification
tax-doc-classifier
One request per page picks among 261 IRS forms and seven page kinds; reports 100 percent on its corpus at $0.001 a page, 34 times cheaper than the LLM pipeline it replaced.
Playgrounds and demosSDK or client library
jevql
Semantic SQL for PostgreSQL, with Jev answering the predicates.
Playgrounds and demosData pipelines and SQL
duckdb-jev
DuckDB extension that asks a question of every row and returns a real SQL type.
Data pipelines and SQLClassification and extraction
invalidate
Gives every stored agent memory a lease and asks Jev whether new evidence ends it; [live demo](https://invalidate-playground.vercel.app).
Playgrounds and demosOutput verification
jev-shield
Semantic MCP firewall that screens every tool call, result, and description; reports 94 percent block recall at about $0.00002 a check.
Tool gating and guardrailsMCP and agent integration
jev-guard
Auto mode for Claude Code, Codex, Cursor, Gemini CLI, Pi, and OpenCode: risk-scores each tool call as deny, ask, or allow and flags prompt injection in results.
Tool gating and guardrailsModeration and safety
Jev-Moderation-Bot
Chat moderation with editable rules.
Moderation and safetyClassification and extraction
citation-verifier
Does the cited paper support the sentence citing it? Claude finds the quote, Jev scores it, a human decides.
Output verificationBenchmarks and evals
human-compiler
Paste text, get diagnostics, like a compiler for prose.
Playgrounds and demosModeration and safety
snifftest
Prose linter for AI writing tells: countable rules plus one judgment model.
Output verification
riff
Ruff-style rule codes for writing.
jev-secret-detection
Measures how well Jev spots real credentials in file snippets, with the hard config-shaped cases scored separately.
Benchmarks and evalsOutput verification
jev-audio-beeper
Low-latency audio censorship proof of concept: Jev typed decisions drive ffmpeg.
Playgrounds and demosModeration and safety
is-malicious
Scans a codebase for hidden or data-stealing behavior before you run it; a clean report is not proof, and it says so.
Command line toolingCode review
tripwire
AI SDK middleware and proxy that runs seven Jev checks on every LLM response before the user sees it; no accuracy numbers yet, and it says so.
Output verificationModeration and safety
unclutter
Browser extension that removes page clutter with reusable template rules.
Playgrounds and demos
typesafe-adblock
Chrome extension that asks "is this element an ad?" per DOM node; a toy, and it says so.
Playgrounds and demos
xtags
Labels every post in your X timeline with what it wants you to do.
Playgrounds and demosClassification and extraction
jevibe-check
Live tone labels for Bluesky posts and drafts.
Playgrounds and demosModeration and safety
jevmeter
Puts a live meter on any video: every sentence scored on five questions, rendered as a 16:9 edit, a whole debate for about two cents.
Playgrounds and demos
slidepilot
Voice-driven auto-advance for Slidev on Cloudflare Agents.
Voice and realtimePlaygrounds and demos
should-ai-kill-us-all
Asks Jev the question every ten minutes, using the actual headlines.
Playgrounds and demos
Privacy Facts
Turns privacy policies into nutrition-style labels with plain-language answers, Jev confidence scores, and suggested source clauses.
Playgrounds and demosClassification and extraction
jev-voice-control
Menu-bar Swift app turning spoken commands into Jev typed decisions and macOS actions.
Browser and computer usePlaygrounds and demos
jev-got
Game of Thrones roleplay where a story model writes each scene and Jev answers five typed questions that drive the header, soundtrack, art, and next prompt.
Playgrounds and demosOutput verification
typesafe-jev
Jev experiments starting with a local CV-screening workbench, each with its own measured results.
Playgrounds and demosOutput verification
super-jev
Small harness connecting evidence, Jev judgments, permitted actions, and verified outcomes.
Playgrounds and demosOutput verification
safer-with-jev
Neon Function proxy for the Neon AI Gateway with Jev routing in front.
Moderation and safetyOutput verification
Sponsor Skip
Chrome extension that finds sponsor reads from the transcript or live audio and jumps past them; code owns every timestamp, under a cent an hour in transcript mode.
Playgrounds and demosVoice and realtime
jev-seo
Rust CLI and MCP server for SEO and GEO checks over DuckDuckGo results, scored by Jev.
Command line toolingMCP and agent integration
jev.nvim
Neovim plugin: ask the buffer a plain-language question, Treesitter splits it into functions, Jev scores each one, and the answers land in quickfix ranked by probability.
Playgrounds and demosCode review
jev-skip
Browser extension that reads the caption track and paints a per-segment sponsor probability on the seek bar before the intro ends, no crowd database; reports 77 percent of SponsorBlock's sponsor seconds caught over 23 videos at $0.0008 a video.
openpoke-meets-jev
OpenPoke fork that moves email screening, a tool-call guardrail, and search reranking onto Jev, with an A/B against the Sonnet call it replaced and an adversarial run on the injection gate.
Tool gating and guardrailsSearch reranking
typesafe-mario
Plays Super Mario Bros. from structured emulator state; Jev picks the NES controller input directly.
Playgrounds and demosBenchmarks and evals
jev-drone
Camera-only drone in MuJoCo with Jev in the loop at 2.5 Hz.
Games and simulationPlaygrounds and demos
tsai-sc
Plays the original StarCraft shareware through keyboard and mouse, action probabilities recorded.
Benchmarks and evalsOutput verification
tsai-civ2
Civilization II in a browser, full-game harness, live action probabilities.
Playgrounds and demosBenchmarks and evals
heist-one
Stealth game where Jev makes the guards' judgments and deterministic code owns the world.
Playgrounds and demosLearning resources
typesafe-snake
One Choice per tick; legal moves and facts generated in code.
Playgrounds and demosBenchmarks and evals
jev-doom-agent
Browser-native Doom agent with structured spatial state and live decision telemetry.
Benchmarks and evalsPlaygrounds and demos
JevPlaysPokemon
Generation 3 Pokémon through Showdown and a real FireRed ROM.
Playgrounds and demosBenchmarks and evals
jev-askable-arm
Zero-shot English goals on a simulated Franka arm; Jev chains hardcoded primitives.
Playgrounds and demosGames and simulation
quackd
Command line for LLM-piloted robots across seven bodies, with an optional Jev stepper that picks among calls without ever writing a joint angle.
Tool gating and guardrailsPlaygrounds and demos
JevPilot
Three.js driving simulator where Jev picks steering and speed from sampled paths up to four times a second; [drive it](https://jevpilot.standardagents.ai).
Playgrounds and demosGames and simulation
live-jev
Top-down car in the browser sending four typed questions every 200 ms, with confidence-gated overrides in code.
Playgrounds and demosGames and simulation
jev-plays-pokemon-red
Pokemon Red on PyBoy: code owns the route and the arithmetic, Jev picks only at branches, and every battle turn logs a faint prediction scored by Brier against what the RAM says.
Playgrounds and demosOutput verification
jev-trader
One trade decision every Monad block, on Kuru MON-USDC, about 300 ms each.
Playgrounds and demosFinance and trading
trade-jev
Backtests Jev as a buy, sell, or hold trader on NQ order-book data.
Benchmarks and evalsOutput verification
jev-benchmarks
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, reproducible.
Benchmarks and evalsOutput verification
jevcal
Stop guessing thresholds: calibrate, threshold, and drift-check against an LLM teacher.
Benchmarks and evalsOutput verification
jev-harness
Confidence gates, shadow mode, recipes, and evals; reports Claude CLI at 48.9 s against Jev at 1.3 s on the same row-filter job.
Output verificationBenchmarks and evals
jev-rerank-bench
Jev against Cohere Rerank, ZeroEntropy, and a chat baseline on 14 datasets, raw responses included.
Benchmarks and evalsOutput verification
jev-search-rerank-eval
Does a Jev rerank beat embedding search? 9,831 graded pairs, with the judge-circularity bias measured.
Benchmarks and evalsSearch reranking
jev-sec-bench
Blind benchmarks for prompt injection and vulnerable-code detection.
Benchmarks and evalsOutput verification
jev-phishing-bench
Jev against Claude Haiku on 2,000 phishing emails: accuracy, calibration, latency, cost.
Benchmarks and evalsOutput verification
jev-spam-eval
Zero-shot spam filtering with Noul questions against TF-IDF baselines.
Benchmarks and evalsPlaygrounds and demos
jev-agent-failure-benchmark
Jev against a strong LLM on the Who and When agent-failure-attribution benchmark.
Benchmarks and evalsOutput verification
jev-korean-benchmark
Korean understanding and medical text, with runtime and cost evidence.
Benchmarks and evalsOutput verification
jev-behavior-study
Controlled prompt experiments on jev-1.13.0, raw results and offline verification.
Playgrounds and demosBenchmarks and evals
jev-report
Independent Chinese research report: 52 pages, 50 reproducible tests, 143 traceable data rows.
Benchmarks and evalsOutput verification
jev-benchmark
Two benchmarks, chess and predator identification, one inside Jev's lane and one outside, both with results.
Benchmarks and evalsPlaygrounds and demos
jev-dspy-lab
Reproducible calibration and selective-risk benchmarks for Jev decisions in DSPy.
Benchmarks and evalsOutput verification
jev-eval-agent
Personal-assistant agent with 100 mocked tools, measuring how many steps a Jev-gated agent needs.
Benchmarks and evalsTool gating and guardrails
jev-synergy-screening
Choice and Noul questions scored against ASReview SYNERGY gold labels for abstract screening.
Benchmarks and evalsOutput verification
jev-orderby-bench
Measures whether ORDER BY over a Jev probability is defensible: pairwise inversion, Score ordinality against a human grade, calibration, and wording invariants under a pre-registered gate; passes on 20 Newsgroups topics, fails four of six conditions on Amazon ESCI product relevance, and shows that a 40-row batched state through a DuckDB extension fails the ranking gate one row per request passes.
Benchmarks and evalsOutput verification
cultivar
Pinecone's skill-testing CLI, with a Jev grading backend it reports at about 30 times cheaper than the LLM grader.
Benchmarks and evalsOutput verification
jev-eval by 4esv
Jev against GPT-5.6 Terra on three labeled tasks: equal on the easy ones, 6.7 points lower on 77-way routing, 5 times faster, 41 to 50 times cheaper.
Benchmarks and evalsOutput verification
jev-benchmark by themsquared
Tool-call risk classification with the run-to-run variance reported; every wrong answer came with hedged confidence.
Benchmarks and evalsOutput verification
jev-research-eval
Reproducible harness over a pinned jev-ultrafast commit, with baseline and stress suites.
Benchmarks and evalsOutput verification
jev-playground by hegargarcia
Jev against other models in games with explicit states, legal actions, and a measurable outcome.
Benchmarks and evalsOutput verification
typesafe-playground by TypeSafeAI
110 use cases, games, and model challenges with editable prompts and A/B comparisons; a community org, not the vendor, formerly under BunsDev.
Playgrounds and demosClassification and extraction
typesafe-playground by kavehmz
From support routing to a 3D driving simulation with visible sensor inputs.
Playgrounds and demosOutput verification
jev-experiments
Nader Dabit's grab bag of small Jev experiments.
Playgrounds and demosLearning resources
TypeSafe Typewriter
Sixteen typed judgments update as you type, on Val Town.
Yes / No
Ask a question, get yes, no, or maybe, with web search when needed; no signup.
Voice and realtime
Jev Tetris
Rotation and column chosen from holes, stack height, and bumpiness.
Games and simulationBenchmarks and evals
Crowdcheck
Test a post against 10,000 synthetic personas before you publish it.
Output verificationModeration and safety
Magic-8-Jev
Ask a question, one choice over twenty answers picks the reply and shows the click-to-answer latency; [live demo](https://willprout.github.io/magic-8-ball/).
Playgrounds and demos
typesafe-ai-playground by markjaquith
Rust CLI playground for experiments around Jev.
Playgrounds and demosClassification and extraction
jev-playground by wustep
Can a System One model steer a music composition through typed classify, score, and pick decisions alone.
Playgrounds and demosBenchmarks and evals
typesafe-jev-workflow
LangGraph demo that sends a mocked email to Jev and routes on the typed Choice it returns.
Playgrounds and demosOutput verification
Jev Classifier
Hosted demo filing posts by type, quality, sentiment, and tone.
Playgrounds and demosClassification and extraction
Companion
Hosted robot interface answering nine typed questions per turn to decide act, ask, or shrug, no generated text.
Playgrounds and demosGames and simulation
Jev System One
Terminal interface where OpenAI answers and Jev separately scores relevance, reliability, and quality.
Output verificationPlaygrounds and demos
jev-web-analyzer
Turns a SaaS landing page into Markdown and asks Jev ten bounded Choice questions about what a first-time visitor understands, shown as a founder teardown.
Playgrounds and demos
jev-axi
Shell verbs for agents and humans: pick, rate, check, rank, triage, guard.
Tool gating and guardrailsOutput verification
semdecide
Typed semantic decisions for Unix pipelines and CI.
Classification and extractionCommand line tooling
every
Ask a yes/no question of every function in a codebase; grep whose pattern is a question.
Playgrounds and demosCode review
typesafe-cli
Noul, choice, and score answers as numbers from the shell.
Benchmarks and evalsPlaygrounds and demos
jgrep
Prints the lines that fit a plain-English description, streaming from `tail -f` under a spend cap, and reports F1 0.91 on SMS spam against 0.72 for a keyword grep.
Playgrounds and demosModeration and safety
jev-cli by jtsang4
Typed questions in, structured JSON answers out.
Output verificationBenchmarks and evals
jev-cli by tumf
Dependency-free Python CLI wrapping Choice, Score, and Noul.
MCP and agent integrationCommand line tooling
jevctl
npm CLI with the key in the OS keychain; typed judgments from the shell.
Output verificationPlaygrounds and demos
jev-go
Go client that returns typed judgments and probabilities.
SDK or client libraryPlaygrounds and demos
typesafe-ai
Rust client with async and blocking backends and observable retries.
SDK or client libraryClassification and extraction
jev
Elixir client built for OTP: reply to Jev from a GenServer and pattern match on the answer.
SDK or client libraryPlaygrounds and demos
ruby_llm-typesafe
TypeSafe as a structured-output provider for RubyLLM 2.
SDK or client libraryOutput verification
laravel-typesafe-jev
Laravel integration with typed responses, async requests, and testing fakes.
SDK or client libraryBenchmarks and evals
jev-dsl
Haskell DSL with typed packets and inferred answer types.
Output verificationBenchmarks and evals
advocaat
Small TypeScript client for asking questions about your own data.
SDK or client libraryClassification and extraction
jod
Zod-style schemas over Jev: validate the state locally, then project typed answers.
SDK or client libraryClassification and extraction
n8n-nodes-typesafe-ai
n8n community node for yes/no, choice, and score questions.
Tool gating and guardrailsPlaygrounds and demos
jevclient
Async Python client, probabilities and choices out, no prose to parse.
SDK or client libraryPlaygrounds and demos
s1-rs
Turns Rust enums and structs into Choice, Score, and Noul questions with compile-time-checked, confidence-gated answers.
Output verificationTool gating and guardrails
typesafe-ai-rails
Rails integration built on the community Ruby gem.
Output verificationClassification and extraction
typesafe_sdk by nshkrdotcom
Elixir port of the TypeScript AI SDK with a TypeSafe provider.
Classification and extractionSDK or client library
ruby_decision_model
Ruby client for decision models with OpenRouter and TypeSafe providers behind one interface, stdlib only.
SDK or client libraryPlaygrounds and demos
zod-jev
Zod 4 schemas with semantic rules: shape checks stay in Zod, meaning checks go to Jev in one request and come back as Zod issues.
Moderation and safetySDK or client library
typesafeai-dotnet-sdk
Community .NET SDK with typed Noul, Choice, and Score questions.
Classification and extractionSDK or client library
swift-typesafe
Swift 6.4 SDK following the Python SDK's API, on Apple platforms and Linux.
SDK or client libraryClassification and extraction
typesafe-sdk-php
PHP client with sync calls, Guzzle promises, and PSR-3 logging.
Classification and extractionSDK or client library