vLLM Semantic Router team releases Decision 3.0, open multimodal decision models from 0.6B to 27B parameters
Introducing Decision 3.0: towards open multimodal foundation decision models ⚡ Open and state-of-the-art from 0.6B to 27B: #1 on both Jev Decision Index boards in our evaluation, on a new Pareto frontier. HF collection 🤗: t.co/I7RfrzJqRc #OpenSource #Jev #LLM
Context
Small, fast models that answer routing and gating questions with probabilities could make AI gateways cheaper, and this family is openly licensed.
vLLM Semantic Router is an open source project that picks or combines models for each request, and Xunzhuo Liu is its most active contributor on GitHub. The team released Decision 1.0 on September 22 and Decision 2.0 in early October. Decision models answer a question about an input with a probability for each option instead of generating free text.
Deep dive
On October 11, Xunzhuo Liu introduced Decision 3.0, describing it as open and state of the art from 0.6B to 27B, and number one on both Jev Decision Index boards in our evaluation, on a new Pareto frontier.
According to AICoder's summary of the model card, the family has six models, d3, d3 flash, d3 mini, d3 nano, d3 lite and d3 edge, released on Hugging Face under the Apache 2.0 license and fine tuned from Qwen3.5 and Qwen3.8 27B. They take text or JSON plus images and video and return probabilities for choice, yes or no, and score questions, several per call, without generating text.
The team reports that the 27B d3 scores 64.7 on Jev Decision Index 0.3.1, ahead of Perplexity Decider v1.1 at 62.8 and Decision 2.0 at 55.9, with a median text latency of 55 milliseconds on one AMD MI325X. AICoder said the smallest model answers text in 6.7 milliseconds but scores much lower, and that the small sizes suit gateway routing and tool call screening.
The rankings are the team's own evaluation, and AICoder noted no independent replication yet.
What to expect next
Watch for independent benchmark results on the Jev Decision Index and other routing tests, and for adoption of Decision 3.0 inside vLLM Semantic Router deployments in production.
Also watch whether larger providers such as Perplexity respond with new decider models, and whether the team keeps its rapid release pace after shipping three Decision generations in about three weeks, which leaves little time for outside testing.