Loading comparison…
HEAD TO HEAD
Yuichi Tateno (hotchpotch): bekko-system-one and onepass: caliber-flex-1b, compared on what they decide, where they run, what they cost and what their publishers report.
| Property | hotchpotch/bekko-system-one | onepass/caliber-flex-1b |
|---|---|---|
| Summary | Ultra-small English encoders (17M, 68M and 395M) fine-tuned from Ettin rerankers. Each answers choice, noul and score questions with a probability per candidate and no generated text. Experimental v0 by one developer; the weights have no licence assigned yet. | Caliber Flex 1B by OnePass. Decision-only model, exactly 1,000,000,000 parameters. |
| Decides | choice, noul, score | choice, noul, score |
| Architecture | bekko | llm |
| Fine-tuned from | cross-encoder/ettin-reranker-400m-v1 | qwen/qwen3.5-0.8b-base |
| License | Unassigned: the weights licence is not finalised (treated as non-commercial); training code MIT | caliber-flex-non-commercial-1.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | — | — |
| Calibration error | — | — |
| Valid action rate | — | — |
| Median latency | 5 ms | — |
| p95 latency | 5.4 ms | — |
| Evaluation suite | The maker's short-input speed probe (4-option Choice, RTX 5090, 1 Oct 2026) | — |
| Latest version | 2026.09 | 0.3.0 |
| Variants | 0_BekkoInference | LICENSE, Modelfile, merged |
| Size of latest version | 1.5 GB | 2.6 GB |
| Files | 9 | 12 |
| Downloads | 0 | 68 |
| Stars | 0 | 0 |
| Tags | system-one, encoder, ettin, onnx, browser, small, 395m | decision-model, calibrated, qwen3_5, timesfm-distilled, onepass, gguf |
| Updated | Oct 7, 2026 | Oct 29, 2026 |
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
bekko-system-one is from Yuichi Tateno (hotchpotch) and caliber-flex-1b from onepass. Both have open weights you can download and run. Both answer choice, noul and score questions.
Neither publishes an accuracy figure. Test both on your own labelled examples.
bekko-system-one: Free (open weights). caliber-flex-1b: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Yes, both: systemone pull hotchpotch/bekko-system-one and systemone pull onepass/caliber-flex-1b download the weights.