Small open typed-decision model with calibrated probabilities, first-class Nepali coverage.
An independent Jev-shaped reproduction on DeBERTa-v3-large. One state and any number of choice, score and yes/no questions go in, and a calibrated distribution per question comes out of one forward pass. Public gold labels only.
Decides
choice, score, noul, classify, route
choice, score, noul, classify
Architecture
mira
open-jev
Fine-tuned from
jhu-clsp/mmbert-small
microsoft/deberta-v3-large
License
apache-2.0
apache-2.0
Availability
Open weights
Open weights
Hosted by
—
—
Input price
—
—
Decision accuracy
61.3%
85.4%
Calibration error
0.083
0.022
Valid action rate
100.0%
—
Median latency
30 ms
28 ms
p95 latency
43 ms
—
Evaluation suite
s1-decision-bench
Kotoba held-out test, seen question types (banking77, SST-5, BoolQ)
Latest version
0.1.5
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between mira and open-jev-deberta-v3-large?
mira is from SAGEA and open-jev-deberta-v3-large from Kotoba Labs. Both have open weights you can download and run. Both answer choice, score, noul and classify questions. Only mira answers route.
Which is more accurate, mira or open-jev-deberta-v3-large?
They report on different suites — mira 61.3% on s1-decision-bench, open-jev-deberta-v3-large 85.4% on Kotoba held-out test, seen question types (banking77, SST-5, BoolQ) — so the numbers do not rank them. Test both on your own labelled examples.
Which is cheaper, mira or open-jev-deberta-v3-large?
mira: Free (open weights). open-jev-deberta-v3-large: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Which is faster, mira or open-jev-deberta-v3-large?
By their publishers’ figures, open-jev-deberta-v3-large answers in about 28 ms at the median and mira in about 30 ms — measured on different hardware, so treat it as a rough guide.
Can I run mira or open-jev-deberta-v3-large locally?
Yes, both: systemone pull sagea/mira and systemone pull kotoba-labs/open-jev-deberta-v3-large download the weights.