An open Jev-style LoRA on Qwen3.5-9B from Bespoke Labs, trained on 2,676 contrastively curated examples to score the allowed answer tokens directly for enums, booleans and rubric levels. Recipe, data and a public benchmark suite are released with it.
Upstage's structured decision model, a System One endpoint on Solar Mini 4. Returns a choice, a score or a yes/no answer with a probability read from the model, in one forward pass, on the same /v1/systemone schema as Jev.
Decides
choice, noul, score, classify, route
choice, score, noul, classify, route
Architecture
nimble
solar
Fine-tuned from
qwen/qwen3.5-9b
—
License
apache-2.0
proprietary
Availability
Open weights + hosted API
Hosted API
Hosted by
Bespoke Labs
Upstage
Input price
—
$0.10/MTok
Decision accuracy
90.1%
—
Calibration error
0.054
—
Valid action rate
—
—
Median latency
106 ms
—
p95 latency
—
—
Evaluation suite
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between bespoke-nimble-9b and solar-decide?
bespoke-nimble-9b is from Bespoke Labs and solar-decide from Upstage. bespoke-nimble-9b has open weights and a hosted API; solar-decide is only available as a hosted API. Both answer choice, noul, score, classify and route questions. solar-decide reads up to 512K tokens of state, against 8K tokens for bespoke-nimble-9b. bespoke-nimble-9b is licensed apache-2.0; solar-decide, proprietary.
Which is more accurate, bespoke-nimble-9b or solar-decide?
Only bespoke-nimble-9b publishes an accuracy figure (90.1% on Bespoke held-out set (324 examples)); solar-decide does not, so there is no comparison to make without your own test.
Which is cheaper, bespoke-nimble-9b or solar-decide?
bespoke-nimble-9b: Hosted, price not published, or free to self-host. solar-decide: $0.1 / $0 per 1M. Open weights cost nothing per call beyond your own hardware.
Can I run bespoke-nimble-9b or solar-decide locally?
bespoke-nimble-9b yes — systemone pull bespoke-labs/bespoke-nimble-9b downloads its weights. The other is only served as a hosted API.
