Decision-2.0-Lux-9B
The vLLM Semantic Router team's Decision family, now at 2.0. Lux-9B is Qwen3.5-9B with a shared candidate head: it answers choice, yes/no and score questions about one input in a single pass, with a probability for every option and no generated text, over 16,384 tokens.
Lux 2.0 fully fine-tunes Decision 1.0 Lux, averages three seeds and interpolates back toward 1.0. The 2.0 releases ship no calibration file (temperature 1), so probabilities are not calibrated; 1.0 shipped fitted temperatures. Choice takes up to 255 options. On the card, Lux 2.0 scores 68.1 on JevArena (an arena the card does not attribute) and a median macro-F1 of 56.2 over 15 human-labelled transfer tasks; the team's own run of the third-party Decision Index 0.2.1 suite with the official kit gives 46.3 (1.0 Lux: 43.5). Siblings, all Apache-2.0: Vega-27B (a rank-512 LoRA and head on Qwen3.8-27B, which downloads at load time; Index run 56.5), Nox-4B, Sol-2B and Eos-0.8B on Qwen3.5, and Kai-0.6B, now on Qwen3-0.6B-Base. Decision-1.0-Route-0.6B is Kai 1.0 tuned for the router's own request signals and keeps the Gemma tokenizer terms. Loads in Transformers 5.17+ with trust_remote_code; serving runs through vLLM Semantic Router's Decision runtime, which speaks /v1/systemone. Version 2026.09 on this page is Decision-1.0-Lux-9B (77.40% on the team's 54-task benchmark, against 81.05% for Jev). The Hugging Face org was renamed from llm-semantic-router to vllm-sr; old URLs redirect.
What it decides
- choice — picks one option from a set
- score — places the input on an ordered scale
- noul — answers a yes/no question with one probability
- classify — assigns a category from a fixed taxonomy
- route — sends the input to one of several destinations
At a glance
| Parameters | 7.94B |
| Base model | qwen/qwen3.5-9b |
| Maker | vLLM Semantic Router |
| Released | 2026-09-29 |
| License | apache-2.0 |
| Reported latency | 18.4 ms median per single-question request on a single GPU |
Get the weights
pip install systemonemodels
systemone pull vllm-semantic-router/decision
The files are served from the maker's Hugging Face repository, vllm-sr/Decision-2.0-Lux-9B, and verified against the checksums recorded here.
Read more
- Announcement
- Runtime
- Weights on Hugging Face
- Decision 2.0 collection
- Decision-2.0-Vega-27B
- Decision-2.0-Nox-4B
- Decision-2.0-Sol-2B
- Decision-2.0-Eos-0.8B
- Decision-2.0-Kai-0.6B
- Decision-1.0-Route-0.6B
- Decision-1.0-Lux-9B
This page was opened by System One for vLLM Semantic Router, who can claim the organisation and take it over at any time.