Loading comparison…
HEAD TO HEAD
Avishek Biswas: bev-decider and Nandakishor M: vega, compared on what they decide, where they run, what they cost and what their publishers report.
| Property | avishek-biswas/bev-decider | nandakishorm/vega |
|---|---|---|
| Summary | A 0.4B decision model made from the first 20 layers of Qwen3-0.6B plus a small attention head that compares options. It answers choice, noul and score questions in one pass, and choice order cannot change its answer by construction. Non-commercial licence. | Nandakishor M's typed-decision model. A frozen Qwen3.5 backbone is read, never trained, and cut off mid-stack; a small trained physics engine settles each choice, score or yes/no question into calibrated probabilities, a conformal set and an abstain flag. 0.8B and 4B. |
| Decides | choice, score, noul | choice, score, noul, classify, route |
| Architecture | bev-decider | vega |
| Fine-tuned from | qwen/qwen3-0.6b | qwen/qwen3.5-0.8b |
| License | cc-by-nc-4.0 | apache-2.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | 74.7% | 55.6% |
| Calibration error | — | 0.151 |
| Valid action rate | — | — |
| Median latency | — | — |
| p95 latency | — | — |
| Evaluation suite | avbiswas/bev-decision test split (5,000 held-out questions over 2,617 states), the maker's own | His 11 October 2026 benchmark, published with its results and its harness (a notebook in vegaml): macro accuracy over 43 public tasks for the 0.8B, 0.717 for the 4B; with JevBench (231 items) and DecisionBench (1,075 rows), 3,841 decisions in all, seed 20261011. On his own set of 2,050 choice decisions over six intent workflows (esci, clinc150, appliances, banking77, when2call, apibank), one choice question each, which he has not published with its question wording, he reports 0.763 (calibration error 0.026) for the 0.8B with its public_intents adapter, 0.389 without the adapter and 0.803 for the 4B with it. He publishes no accuracy for the typed_decisions adapters |
| Latest version | 2026.09 | 2026.10.12 |
| Variants | LICENSE-Qwen | adapters, backbone, 4b |
| Size of latest version | 940.1 MB | 10.5 GB |
| Files | 8 | 31 |
| Downloads | 0 | 108 |
| Stars | 0 | 0 |
| Tags | system-one, qwen, non-commercial, 478m | system-one, qwen, frozen-backbone, calibrated, conformal, abstention, adapters, multimodal, long-context, 0.8b |
| Updated | Oct 7, 2026 | Oct 29, 2026 |
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
bev-decider is from Avishek Biswas and vega from Nandakishor M. Both have open weights you can download and run. Both answer choice, score and noul questions. Only vega answers classify and route. vega reads up to 72K tokens of state, against 2K tokens for bev-decider. bev-decider is the smaller model, at 478M parameters to 800M. bev-decider is licensed cc-by-nc-4.0; vega, apache-2.0.
They report on different suites — bev-decider 74.7% on avbiswas/bev-decision test split (5,000 held-out questions over 2,617 states), the maker's own, vega 55.6% on His 11 October 2026 benchmark, published with its results and its harness (a notebook in vegaml): macro accuracy over 43 public tasks for the 0.8B, 0.717 for the 4B; with JevBench (231 items) and DecisionBench (1,075 rows), 3,841 decisions in all, seed 20261011. On his own set of 2,050 choice decisions over six intent workflows (esci, clinc150, appliances, banking77, when2call, apibank), one choice question each, which he has not published with its question wording, he reports 0.763 (calibration error 0.026) for the 0.8B with its public_intents adapter, 0.389 without the adapter and 0.803 for the 4B with it. He publishes no accuracy for the typed_decisions adapters — so the numbers do not rank them. Test both on your own labelled examples.
bev-decider: Free (open weights). vega: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Yes, both: systemone pull avishek-biswas/bev-decider and systemone pull nandakishorm/vega download the weights.