Skip to content
decisionbench
OverallSudokuTriageRobustness

Independent benchmark. Not affiliated with or endorsed by OpenRouter or any model provider. Company and model names are trademarks of their respective owners.

How ranking worksPrivacyTermsContact

© 2026 editid0

← Overall ranking

Solar Decide Flash

Upstage · upstage/solar-decide-flash · added 20 Oct 2026

Solar Decide Flash by Upstage ranks #12 of 12 AI decision models overall on DecisionBench: #10 of 12 on Sudoku, #12 of 12 on Triage, #12 of 12 on Robustness. View on OpenRouter.

Overall
#12 of 12
Average rank
11.3
Sudoku
#10 of 12
Triage
#12 of 12
Robustness
#12 of 12

Sudoku Logical reasoning

Leaderboard →
Rank
#10 of 12
Accuracy
74.1%
Solved
20/20
Mistakes / puzzle
17.6
Solve time / puzzle
51s
Cost / puzzle
$0.0433

By difficulty

DifficultyRankAccuracySolvedMistakesSolve timeCost
Easy#1284.0%5/57.829s$0.0218
Medium#1176.1%5/515.444s$0.0381
Hard#972.8%5/520.255s$0.0497
Expert#1067.9%5/527.076s$0.0637
Every race (20)
PuzzleMistakesCallsSolve timeCostStatus
easy-0171829s$0.0193Solved
easy-0251724s$0.0174Solved
easy-03122334s$0.0263Solved
easy-04102232s$0.0272Solved
easy-0551824s$0.0187Solved
medium-01162744s$0.0374Solved
medium-02163149s$0.0405Solved
medium-03132639s$0.0334Solved
medium-04163046s$0.0410Solved
medium-05163043s$0.0381Solved
hard-01233759s$0.0555Solved
hard-02253964s$0.0583Solved
hard-03132842s$0.0374Solved
hard-04233557s$0.0522Solved
hard-05173254s$0.0451Solved
expert-01294377s$0.0674Solved
expert-02253766s$0.0563Solved
expert-03153049s$0.0407Solved
expert-04344897s$0.0794Solved
expert-05324691s$0.0745Solved

Triage Following written rules

Leaderboard →
Rank
#12 of 12
Accuracy
70.0%
Team
100.0%
Refund
85.0%
Urgency
25.0%
Confidence gap
0.086

60 tickets · 0.0% of mistakes made while at least 90% sure · $0.1220 per 1,000 tickets

Robustness Consistency under pressure

Leaderboard →
Rank
#12 of 12
Score
89.4%
Same if re-asked
96.7%
Changed by reorder
0.0%
In a list of 40
52% / 70%
Obeyed planted text
23.3%

20 tickets × 6 checks · changed by rename 0.0% · accuracy with planted text 46.7%