Jev routes easy judgment calls away from Claude Opus and escalates only uncertain ones, cutting LLM-judge costs over 4x with almost no accuracy loss.
Vamsi Tallapudi
Manager, Architect Technology at Cognizant
Jev is TypeSafe AI's "System One" decision model, and the pattern everyone is suddenly copying is simple: let Jev handle every judgment call by default, and only pay for Claude Opus when Jev isn't sure. Hightouch ran this on an identity-resolution task and got 98.8% accuracy at $0.88 per 1,000 decisions, versus Opus 5.5 alone at 99.0% accuracy for $3.86 per 1,000. That's a 4.4x cost cut for a 0.2-point accuracy hit. This is how to actually build that, and where it falls apart.
Jev isn't a chatbot and it doesn't write text. TypeSafe AI launched it on September 15, 2026, built by Diogo Almeida, one of the researchers behind the instruction-following work that led to ChatGPT, with $40 million in funding behind it. You send Jev a blob of state (a trace, a JSON object, a conversation) plus a typed question, and it returns a typed answer with a calibrated probability attached. No prose, no explanation, just a value and a confidence score.
That constraint is the whole point. Because it isn't generating tokens one at a time, Jev answers in roughly 70-500 milliseconds, and TypeSafe prices it at $0.042 per million input tokens with output free (there's barely any output to pay for). On OpenRouter, the current version, typesafe/jev-1.13, ships a 262,144-token context window and went live there on September 18, 2026.
Compare that to Claude Opus, which is still the thing you reach for when a decision actually requires reasoning: multi-step judgment, nuance, an explanation a human needs to read. Opus is slow and expensive by comparison. Jev is fast and cheap but, on its own, measurably less accurate on hard cases. The trick is not picking one. It's routing between them.
Run every case through Jev first. If Jev's confidence lands in a comfortable zone, trust it and move on. If Jev is uncertain, forward that one case to Opus and pay for the real judgment. You're not replacing Opus, you're filtering out the 70-90% of cases that didn't need it in the first place.
Here's what that looked like across three independent benchmarks:
| Setup | Accuracy | Cost per 1,000 |
|---|---|---|
| Claude Opus 5.5 alone (identity resolution) | 99.0% | $3.86 |
| Jev alone | 95.7% | $0.05 |
| Hybrid: Jev routes uncertain (30-90% confidence) cases to Opus | 98.8% | $0.88 |
| Claude Opus 5 alone (hallucination detection, Arize) | 83% | $14.30 |
| Jev alone, default 0.5 threshold | 76% | $0.05 |
| Jev alone, tuned to 0.80 threshold | 87% (beats Opus) | $0.05 |
| Claude Opus 5 alone (classification, OpenRouter's own test) | 84.4% | $2.42 |
| Hybrid: route everything under 0.9 confidence to Opus | 84.0% | $0.69 |
That middle Arize row is the one that should make you pause. Arize's benchmark found that at the default 0.5 confidence threshold, Jev looked clearly worse than Opus, 76% versus 83%. Nobody would ship that. But the "mistake" wasn't Jev, it was the threshold. Pushed to 0.80, Jev matched Opus exactly, at roughly 1/286th the price and over 20x the speed. Escalating uncertain cases to Opus after that barely moved the number, because tuned Jev had basically already caught up.
The identity-resolution numbers at the top, from Hightouch's writeup, are the cleanest real-world case of the "4x" framing. They also tested a harder dataset where the gap narrowed: hybrid Jev hit 95.3% at $2.94 per 1,000 against Opus alone's higher cost of $5.39, still cheaper, but only by about 1.8x, not 4x. The savings shrink as the task gets genuinely harder, because more cases legitimately need Opus.
If you want this pattern on your own coding agent instead of a data pipeline, there's already tooling for it. A community proxy called jev-router sits between Claude Code and Anthropic's API on a local port, intercepts each new user message, and asks Jev three things in parallel: how complex is this task, does it touch anything risky (production, credentials, permissions), and is the request trying to manipulate its own routing.
npm install -g jev-router
export JEV_API_KEY=your_typesafe_key
jev-router claude
It maps confidence to four tiers, and it only moves up during a session, never back down, so you don't lose prompt-cache hits by yo-yoing between models:
Each routing check costs something like $0.00003 and adds under half a second. If Jev's API has a bad moment, the router is built to fail open and just forward the request, so a routing hiccup doesn't block your session. This is basically the same idea as the Hightouch and Arize benchmarks, just applied to "which model should write this diff" instead of "is this answer hallucinated."
I'd use this for anything high-volume and low-stakes per decision: content moderation, lead scoring, "does this agent trace look broken," picking a model tier for a coding task. I would not use the default threshold anywhere, ever. The Arize numbers above make that obvious: 0.5 made Jev look worse than it is, 0.80 made it match a frontier model on the same task. You have to tune this on your own labeled data before you trust it in production, and the whole pattern lives or dies on that one step.
The bigger worry is confidence calibration itself. A critical look at Jev versus Claude as judges found almost no correlation, 0.06 to 0.15, between either model's stated confidence and whether humans actually disagreed on the case. In plain terms: the thing you're using to decide "is this case hard enough to escalate" doesn't reliably know when a case is hard. It knows when it's easy, which is enough to save money on the bulk of traffic, but it's not the safety net people assume it is for the genuinely ambiguous stuff.
A September 2026 paper by Delip Rao and Chris Callison-Burch backs this up from a different angle. Comparing decision models like Jev against LLM judges across nine benchmark panels, they found decision models run 16 to 357 times cheaper and 5 to 350 times faster, underperforming LLMs in at most 6 of 27 comparisons. But over 85% of the errors decision models make are the same errors the LLMs make. Cascading the two together only recovered about 2.7 points at best. If a cheap model and an expensive model are wrong about the same cases, routing between them doesn't fix those cases, it just saves you money on the ones that were never wrong.
So the honest framing is: this pattern cuts cost on volume, not on your hardest 5%. Anyone selling it as "Opus-quality everywhere for a quarter of the price" is skipping that part.
I like this a lot more than the "replace the expensive model entirely" pitches that came out when Jev launched. TypeSafe's own numbers (100x faster, 100x cheaper, matches intelligence) sound like marketing because they are, but the routing version of the claim actually survived three separate benchmarks from Arize, Hightouch, and OpenRouter, run by people with no reason to flatter TypeSafe. A 4x cost cut for a fraction of a point of accuracy is real and worth having, especially on anything you run at scale, like agent evals or Claude Code routing. Just don't skip the threshold-tuning step, and don't pretend the escalation path catches your hardest cases, because the research says it mostly doesn't.
If you're already running Claude Opus 5 for everything and haven't looked at your cost breakdown by task type, this is probably the single cheapest change you can make this quarter. If you're running Haiku 4.5 for cost reasons already, Jev is a cheap way to catch the cases Haiku is quietly getting wrong before a user does.
New AI tools, automation workflows, and course drops — straight to your inbox. Join 2,400+ builders.
Gemini Omni 1.2 Flash cut per-second pricing 30% to $0.07/s and stretched clips to 15 seconds, but a full-length clip now costs about the same as the old one did.
Thinking Machines' Inkling 2 Small: 594B params, 17B active, $0.30/$1 per 1M tokens on Tinker, and Apache 2.0 weights still pending safety review.
Go 1.27's encoding/json/v2 changes 4 defaults that can break your API silently. Here's the migration path, benchmark reality, and when to actually switch.
Comments