Skip to content
decisionbench
OverallSudokuTriageRobustness

Independent benchmark. Not affiliated with or endorsed by OpenRouter or any model provider. Company and model names are trademarks of their respective owners.

How ranking worksPrivacyTermsContact

© 2026 editid0

← Overall ranking

d1 Ultra

Liquid · liquid/d1-ultra · added 20 Oct 2026

d1 Ultra by Liquid ranks #1 of 12 AI decision models overall on DecisionBench: #1 of 12 on Sudoku, #1 of 12 on Triage, #2 of 12 on Robustness. View on OpenRouter.

Overall
#1 of 12
Average rank
1.3
Sudoku
#1 of 12
Triage
#1 of 12
Robustness
#2 of 12

Sudoku Logical reasoning

Leaderboard →
Rank
#1 of 12
Accuracy
84.0%
Solved
20/20
Mistakes / puzzle
9.6
Solve time / puzzle
10s
Cost / puzzle
$0.002697

By difficulty

DifficultyRankAccuracySolvedMistakesSolve timeCost
Easy#390.3%5/54.46.0s$0.001642
Medium#384.5%5/59.09.1s$0.002517
Hard#282.8%5/511.29.3s$0.003051
Expert#180.8%5/513.617s$0.003579
Every race (20)
PuzzleMistakesCallsSolve timeCostStatus
easy-015177.4s$0.001603Solved
easy-025175.9s$0.001671Solved
easy-034165.1s$0.001605Solved
easy-045186.3s$0.001786Solved
easy-053165.3s$0.001543Solved
medium-016206.7s$0.002170Solved
medium-0212249.4s$0.002630Solved
medium-03122412s$0.002601Solved
medium-046217.7s$0.002366Solved
medium-059259.9s$0.002816Solved
hard-01132912s$0.003553Solved
hard-0212279.6s$0.003179Solved
hard-035227.3s$0.002449Solved
hard-0412258.9s$0.002943Solved
hard-0514268.7s$0.003134Solved
expert-01102621s$0.003166Solved
expert-02183329s$0.004127Solved
expert-03122712s$0.003232Solved
expert-04163114s$0.004007Solved
expert-05122711s$0.003360Solved

Triage Following written rules

Leaderboard →
Rank
#1 of 12
Accuracy
100.0%
Team
100.0%
Refund
100.0%
Urgency
100.0%
Confidence gap
0.005

60 tickets · 0.0% of mistakes made while at least 90% sure · $0.0290 per 1,000 tickets

Robustness Consistency under pressure

Leaderboard →
Rank
#2 of 12
Score
100.0%
Same if re-asked
100.0%
Changed by reorder
0.0%
In a list of 40
100% / 100%
Obeyed planted text
0.0%

20 tickets × 6 checks · changed by rename 0.0% · accuracy with planted text 100.0%