Skip to content
decisionbench
OverallSudokuTriageRobustness

Independent benchmark. Not affiliated with or endorsed by OpenRouter or any model provider. Company and model names are trademarks of their respective owners.

How ranking worksPrivacyTermsContact

© 2026 editid0

← Overall ranking

d1

Liquid · liquid/d1 · added 20 Oct 2026

d1 by Liquid ranks #7 of 12 AI decision models overall on DecisionBench: #4 of 12 on Sudoku, #7 of 12 on Triage, #8 of 12 on Robustness. View on OpenRouter.

Overall
#7 of 12
Average rank
6.3
Sudoku
#4 of 12
Triage
#7 of 12
Robustness
#8 of 12

Sudoku Logical reasoning

Leaderboard →
Rank
#4 of 12
Accuracy
81.5%
Solved
20/20
Mistakes / puzzle
11.4
Solve time / puzzle
9.5s
Cost / puzzle
$0.001373

By difficulty

DifficultyRankAccuracySolvedMistakesSolve timeCost
Easy#291.1%5/54.07.3s$0.000750
Medium#185.1%5/58.69.4s$0.001211
Hard#578.0%5/515.210s$0.001680
Expert#376.3%5/517.811s$0.001852
Every race (20)
PuzzleMistakesCallsSolve timeCostStatus
easy-013157.5s$0.000671Solved
easy-022165.9s$0.000685Solved
easy-035176.9s$0.000815Solved
easy-0471810s$0.000881Solved
easy-053156.1s$0.000698Solved
medium-017229.1s$0.001147Solved
medium-028239.6s$0.001235Solved
medium-039239.7s$0.001279Solved
medium-0472210s$0.001197Solved
medium-0512238.0s$0.001201Solved
hard-01173015s$0.001774Solved
hard-0213279.1s$0.001507Solved
hard-0310267.3s$0.001350Solved
hard-0415299.5s$0.001705Solved
hard-05213310s$0.002065Solved
expert-01213411s$0.001963Solved
expert-0212279.8s$0.001566Solved
expert-03213412s$0.001919Solved
expert-04153111s$0.001879Solved
expert-05203211s$0.001933Solved

Triage Following written rules

Leaderboard →
Rank
#7 of 12
Accuracy
93.9%
Team
100.0%
Refund
100.0%
Urgency
81.7%
Confidence gap
0.038

60 tickets · 0.0% of mistakes made while at least 90% sure · $0.0138 per 1,000 tickets

Robustness Consistency under pressure

Leaderboard →
Rank
#8 of 12
Score
97.8%
Same if re-asked
94.2%
Changed by reorder
0.0%
In a list of 40
92% / 95%
Obeyed planted text
1.7%

20 tickets × 6 checks · changed by rename 0.0% · accuracy with planted text 90.0%