Loading comparison…
HEAD TO HEAD
onepass: caliber-flex-5b and Superagent: security-one, compared on what they decide, where they run, what they cost and what their publishers report.
| Property | onepass/caliber-flex-5b | superagent/security-one |
|---|---|---|
| Summary | Caliber Flex 5B by OnePass. Decision-only model, exactly 5,000,000,000 parameters. | Superagent's 27B security decision model. It scores 2 to 16 supplied options in one forward pass and returns a probability for each, for triaging prompt injection, agent tool calls, code changes, logs and alerts. Apache-2.0 weights (gated, auto-approved) plus a hosted API. |
| Decides | choice, noul, score | choice, score, noul, classify, route |
| Architecture | llm | security-one |
| Fine-tuned from | qwen/qwen3.5-4b-base | denis-pplx/autojev-27b |
| License | caliber-flex-non-commercial-1.0 | apache-2.0 |
| Availability | Open weights | Open weights + hosted API |
| Hosted by | — | Superagent |
| Input price | — | — |
| Decision accuracy | — | 99.8% |
| Calibration error | — | — |
| Valid action rate | — | — |
| Median latency | — | — |
| p95 latency | — | — |
| Evaluation suite | — | BIPIA binary prompt-injection detector adaptation (800 rows; Superagent's frozen evaluation, unsafe if P(unsafe) >= 0.70) |
| Latest version | 0.2.0 | 2026.09 |
| Variants | Modelfile, merged, LICENSE | — |
| Size of latest version | 13.3 GB | — |
| Files | 17 | 0 |
| Downloads | 69 | 0 |
| Stars | 1 | 0 |
| Tags | decision-model, calibrated, qwen3_5, timesfm-distilled, onepass, gguf | system-one, security, prompt-injection, qwen, sglang, hosted, gated, 27b |
| Updated | Oct 29, 2026 | Oct 7, 2026 |
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
caliber-flex-5b is from onepass and security-one from Superagent. caliber-flex-5b has open weights you can download and run; security-one has open weights and a hosted API. Both answer choice, noul and score questions. Only security-one answers classify and route. caliber-flex-5b is licensed other; security-one, apache-2.0.
Only security-one publishes an accuracy figure (99.8% on BIPIA binary prompt-injection detector adaptation (800 rows; Superagent's frozen evaluation, unsafe if P(unsafe) >= 0.70)); caliber-flex-5b does not, so there is no comparison to make without your own test.
caliber-flex-5b: Free (open weights). security-one: Hosted, price not published, or free to self-host. Open weights cost nothing per call beyond your own hardware.
Yes, both: systemone pull onepass/caliber-flex-5b and systemone pull superagent/security-one download the weights.