The flagship of the vLLM Semantic Router team's Decision 1.0 family. Qwen3.5-9B with a shared candidate head returns a probability for every supplied answer to choice, yes/no and score questions, over a 16,384-token input.
Unofficial NoulXP package of Convai Innovations' Laya typed-decisions (Apache-2.0), fp32-o23: checked against the model's own answers, none changed. Not made by Convai Innovations.
Decides
choice, score, noul, classify, route
choice, score, noul, classify, route
Architecture
decision
laya
Fine-tuned from
qwen/qwen3.5-9b
convai-innovations/laya
License
apache-2.0
apache-2.0
Availability
Open weights
Open weights
Hosted by
—
—
Input price
—
—
Decision accuracy
77.4%
—
Calibration error
—
—
Valid action rate
—
—
Median latency
—
126 ms
p95 latency
—
2185 ms
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between decision and laya-typed-decisions-noulxp?
decision is from vLLM Semantic Router and laya-typed-decisions-noulxp from Convai Innovations. Both have open weights you can download and run. Both answer choice, score, noul, classify and route questions. decision reads up to 16K tokens of state, against 1K tokens for laya-typed-decisions-noulxp. laya-typed-decisions-noulxp is the smaller model, at 421M parameters to 9.0B.
Which is more accurate, decision or laya-typed-decisions-noulxp?
Only decision publishes an accuracy figure (77.4% on vLLM-SR decision benchmark (54 tasks, 3,766 decisions, weighted)); laya-typed-decisions-noulxp does not, so there is no comparison to make without your own test.
Which is cheaper, decision or laya-typed-decisions-noulxp?
decision: Free (open weights). laya-typed-decisions-noulxp: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Can I run decision or laya-typed-decisions-noulxp locally?
Yes, both: systemone pull vllm-semantic-router/decision and systemone pull convai-innovations/laya-typed-decisions-noulxp download the weights.
