A 0.4B decision model made from the first 20 layers of Qwen3-0.6B plus a small attention head that compares options. It answers choice, noul and score questions in one pass, and choice order cannot change its answer by construction. Non-commercial licence.
Superagent's 27B security decision model. It scores 2 to 16 supplied options in one forward pass and returns a probability for each, for triaging prompt injection, agent tool calls, code changes, logs and alerts. Apache-2.0 weights (gated, auto-approved) plus a hosted API.
Decides
choice, score, noul
choice, score, noul, classify, route
Architecture
bev-decider
security-one
Fine-tuned from
qwen/qwen3-0.6b
denis-pplx/autojev-27b
License
cc-by-nc-4.0
apache-2.0
Availability
Open weights
Open weights + hosted API
Hosted by
—
Superagent
Input price
—
—
Decision accuracy
74.7%
99.8%
Calibration error
—
—
Valid action rate
—
—
Median latency
—
—
p95 latency
—
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between bev-decider and security-one?
bev-decider is from Avishek Biswas and security-one from Superagent. bev-decider has open weights you can download and run; security-one has open weights and a hosted API. Both answer choice, score and noul questions. Only security-one answers classify and route. security-one reads up to 256K tokens of state, against 2K tokens for bev-decider. bev-decider is the smaller model, at 478M parameters to 27B. bev-decider is licensed cc-by-nc-4.0; security-one, apache-2.0.
Which is more accurate, bev-decider or security-one?
They report on different suites — bev-decider 74.7% on avbiswas/bev-decision test split (5,000 held-out questions over 2,617 states), the maker's own, security-one 99.8% on BIPIA binary prompt-injection detector adaptation (800 rows; Superagent's frozen evaluation, unsafe if P(unsafe) >= 0.70) — so the numbers do not rank them. Test both on your own labelled examples.
Which is cheaper, bev-decider or security-one?
bev-decider: Free (open weights). security-one: Hosted, price not published, or free to self-host. Open weights cost nothing per call beyond your own hardware.
Can I run bev-decider or security-one locally?
Yes, both: systemone pull avishek-biswas/bev-decider and systemone pull superagent/security-one download the weights.
—
Evaluation suite
avbiswas/bev-decision test split (5,000 held-out questions over 2,617 states), the maker's own
