Ultra-small English encoders (17M, 68M and 395M) fine-tuned from Ettin rerankers. Each answers choice, noul and score questions with a probability per candidate and no generated text. Experimental v0 by one developer; the weights have no licence assigned yet.
A 149.6M ModernBERT-base cross-encoder with a scalar head that picks an agent's next action or tool from labels and descriptions you supply. Each option is scored against the state and a softmax ranks the set; no text is generated. Experimental preview, not calibrated.
Decides
choice, noul, score
choice, rank, route
Architecture
bekko
modernjev
Fine-tuned from
cross-encoder/ettin-reranker-400m-v1
answerdotai/modernbert-base
License
Unassigned: the weights licence is not finalised (treated as non-commercial); training code MIT
apache-2.0
Availability
Open weights
Open weights
Hosted by
—
—
Input price
—
—
Decision accuracy
—
73.4%
Calibration error
—
—
Valid action rate
—
—
Median latency
5 ms
—
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between bekko-system-one and modernjev-decide?
bekko-system-one is from Yuichi Tateno (hotchpotch) and modernjev-decide from Maziyar Panahi. Both have open weights you can download and run. Both answer choice questions. Only bekko-system-one answers noul and score. Only modernjev-decide answers rank and route. modernjev-decide is the smaller model, at 150M parameters to 395M. bekko-system-one is licensed other; modernjev-decide, apache-2.0.
Which is more accurate, bekko-system-one or modernjev-decide?
Only modernjev-decide publishes an accuracy figure (73.4% on AgentToolDecisions-180K held-out test, next action type (1,158 decisions, 3 choices; the maker's split)); bekko-system-one does not, so there is no comparison to make without your own test.
Which is cheaper, bekko-system-one or modernjev-decide?
bekko-system-one: Free (open weights). modernjev-decide: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Can I run bekko-system-one or modernjev-decide locally?
Yes, both: systemone pull hotchpotch/bekko-system-one and systemone pull maziyar-panahi/modernjev-decide download the weights.
p95 latency
5.4 ms
—
Evaluation suite
The maker's short-input speed probe (4-option Choice, RTX 5090, 1 Oct 2026)
AgentToolDecisions-180K held-out test, next action type (1,158 decisions, 3 choices; the maker's split)
