Skip to content
decisionbench
OverallSudokuRulebookConsistencyOddsFairness

Independent benchmark. Not affiliated with or endorsed by OpenRouter or any model provider. Company and model names are trademarks of their respective owners.

How ranking worksPrivacyTermsContact

© 2026 editid0 · Results licensed under CC BY 4.0

← Rulebook leaderboard

Drex Max

Nace.AI · nace-ai/drex-max · added 22 Oct 2026

Drex Max by Nace.AI ranks #1 of 18 AI decision models on the DecisionBench Rulebook benchmark (following written rules), with accuracy 99.4%. View on OpenRouter.

Overall#2Sudoku#11Rulebook#1Consistency#3Odds#2Fairness#1
Rulebook rank
#1 of 18
Accuracy
99.4%
Team
98.3%
Refund
100.0%
Urgency
100.0%
Confidence gap
0.005

120 tickets · 0.0% of mistakes made while at least 90% sure · $0.0643 per 1,000 tickets · 399 ms per ticket

Every ticket

The model's three decisions on each ticket, with its confidence. Wrong answers show the right one. 2 of 120 tickets had at least one mistake.

TicketCustomer wroteTeamRefundUrgency
T-1000I was charged twice for order #680007. Please fix the duplicate charge.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1001I cancelled my plan on the 20th and was still charged this month. I want that money back.✓correct billing 100%✓correct approve 100%✓correct 1 100%
T-1002My invoice says $142 but checkout showed $122. Why was I charged more?✓correct billing 100%✓correct approve 100%✓correct 1 100%
T-1003There's an order #537756 on my account that I did not place. Also, a second problem: Sync stops halfway through and shows error E-673.✓correct fraud 100%✓correct deny 100%✓correct 3 100%
T-1004There's an order #250882 on my account I didn't recognise at first, but it turns out my partner placed it. It's now 10 days late.✓correct shipping 100%✓correct approve 100%✓correct 2 100%
T-1005The payment for #611274 shows on my bank statement but your site still says unpaid.✓correct billing 100%✓correct approve 100%✓correct 4 100%
T-1006I was charged twice for order #638446. Please fix the duplicate charge. And separately: Tracking says delivered but there is nothing at my door or with my neighbours.✓correct billing 100%✓correct deny 100%✓correct 3 100%
T-1007My package for order #780678 hasn't arrived and tracking hasn't moved in 4 days.✓correct shipping 100%✓correct approve 100%✓correct 1 100%
T-1008Please refund me. The jacket arrived on time but it doesn't fit.✓correct returns 100%✓correct approve 100%✓correct 3 100%
T-1009I got a login alert from a country I've never been to. Also, a second problem: You sent me the wrong colour. How do I return it?✓correct fraud 100%✓correct deny 100%✓correct 2 100%
T-1010Tracking says delivered but there is nothing at my door or with my neighbours.✓correct shipping 100%✓correct approve 100%✓correct 0 100%
T-1011The package came quickly, but it's the wrong item entirely. I want to send it back.✓correct returns 100%✓correct deny 100%✓correct 4 100%
T-1012The courier sent order #885341 to my old address instead of the one I entered.✓correct shipping 100%✓correct approve 100%✓correct 3 100%
T-1013My invoice says $410 but checkout showed $390. Why was I charged more? And separately: The app crashes every time I open the settings page.✓correct billing 100%✓correct approve 100%✓correct 1 100%
T-1014I asked for a password reset an hour ago, but the link in the email says it has expired.✓correct technical 100%✓correct deny 100%✓correct 3 100%
T-1015The item I ordered is the wrong size. I'd like to send it back.✓correct returns 100%✓correct approve 100%✓correct 3 100%
T-1016Tracking says delivered but there is nothing at my door or with my neighbours. One more thing: I got a login alert from a country I've never been to.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1017I changed my mind about order #213061 and want to return it.✓correct returns 100%✓correct approve 100%✓correct 0 100%
T-1018The tracking page shows a blank screen every time I open it. The package itself arrived fine.✓correct technical 100%✓correct deny 100%✓correct 3 100%
T-1019Sync stops halfway through and shows error E-219. One more thing: The payment for #546481 shows on my bank statement but your site still says unpaid.✓correct billing 100%✓correct deny 100%✓correct 1 100%
T-1020You sent me the wrong colour. How do I return it?✓correct returns 100%✓correct approve 100%✓correct 1 100%
T-1021The invoice page won't load, it just spins. The charge itself is correct.✕wrong billing → technical 68%✓correct deny 100%✓correct 3 100%
T-1022I bought the wrong plan by mistake and want to undo the purchase.✓correct returns 100%✓correct deny 100%✓correct 4 100%
T-1023There's an order #678886 on my account that I did not place. Also, a second problem: The payment for #699070 shows on my bank statement but your site still says unpaid.✓correct fraud 100%✓correct deny 100%✓correct 3 100%
T-1024I changed my account email myself yesterday, and now the app won't accept the new one when I log in.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1025The app crashes every time I open the settings page.✓correct technical 100%✓correct deny 100%✓correct 4 100%
T-1026Export to PDF has been broken since the last update. And separately: My invoice says $586 but checkout showed $566. Why was I charged more?✓correct billing 100%✓correct deny 100%✓correct 4 100%
T-1027I can't log in. It keeps saying "session expired" even after resetting my password.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1028I can't log in because my password was changed, and I never asked for that.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1029I was charged twice for order #477211. Please fix the duplicate charge. One more thing: You sent me the wrong colour. How do I return it?✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1030Export to PDF has been broken since the last update.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1031I bought this ebook by mistake, I meant to get the audiobook. Can I get my money back?✓correct returns 100%✓correct approve 100%✓correct 4 100%
T-1032Sync stops halfway through and shows error E-628.✓correct technical 100%✓correct deny 100%✓correct 2 100%
T-1033The payment for #466055 shows on my bank statement but your site still says unpaid. One more thing: My package for order #930701 hasn't arrived and tracking hasn't moved in 4 days.✓correct billing 100%✓correct deny 100%✓correct 2 100%
T-1034I cancelled my plan on the 1st and was still charged this month. I want that money back.✓correct billing 100%✓correct approve 100%✓correct 3 100%
T-1035I got a login alert from a country I've never been to.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1036I can't log in. It keeps saying "session expired" even after resetting my password. One more thing: I was charged twice for order #924019. Please fix the duplicate charge.✓correct billing 100%✓correct approve 100%✓correct 3 100%
T-1037Someone changed the email on my account without my permission.✓correct fraud 100%✓correct deny 100%✓correct 2 100%
T-1038There's an order #346522 on my account I didn't recognise at first, but it turns out my partner placed it. It's now 5 days late.✓correct shipping 100%✓correct approve 100%✓correct 3 100%
T-1039The courier sent order #823637 to my old address instead of the one I entered. Also, a second problem: Sync stops halfway through and shows error E-239.✓correct shipping 100%✓correct approve 100%✓correct 4 100%
T-1040There's an order #832730 on my account that I did not place.✓correct fraud 100%✓correct deny 100%✓correct 3 100%
T-1041Please refund me. The jacket arrived on time but it doesn't fit.✓correct returns 100%✓correct deny 100%✓correct 1 100%
T-1042I was charged twice for order #996453. Please fix the duplicate charge.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1043Tracking says delivered but there is nothing at my door or with my neighbours. And separately: Someone changed the email on my account without my permission.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1044The package came quickly, but it's the wrong item entirely. I want to send it back.✓correct returns 100%✓correct approve 100%✓correct 4 100%
T-1045My invoice says $135 but checkout showed $115. Why was I charged more?✓correct billing 100%✓correct approve 100%✓correct 1 100%
T-1046The app crashes every time I open the settings page. And separately: The payment for #668003 shows on my bank statement but your site still says unpaid.✓correct billing 100%✓correct approve 100%✓correct 0 100%
T-1047The payment for #251974 shows on my bank statement but your site still says unpaid.✓correct billing 100%✓correct approve 100%✓correct 0 100%
T-1048I asked for a password reset an hour ago, but the link in the email says it has expired.✓correct technical 100%✓correct deny 100%✓correct 2 100%
T-1049I changed my mind about order #436330 and want to return it. Also, a second problem: There's an order #734491 on my account that I did not place.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1050My package for order #594998 hasn't arrived and tracking hasn't moved in 6 days.✓correct shipping 100%✓correct approve 100%✓correct 3 100%
T-1051The tracking page shows a blank screen every time I open it. The package itself arrived fine.✓correct technical 100%✓correct deny 100%✓correct 3 100%
T-1052Tracking says delivered but there is nothing at my door or with my neighbours.✓correct shipping 100%✓correct deny 100%✓correct 2 100%
T-1053The item I ordered is the wrong size. I'd like to send it back. And separately: The app crashes every time I open the settings page.✓correct returns 100%✓correct deny 100%✓correct 2 100%
T-1054The invoice page won't load, it just spins. The charge itself is correct.✕wrong billing → technical 61%✓correct deny 100%✓correct 0 100%
T-1055The courier sent order #975175 to my old address instead of the one I entered.✓correct shipping 100%✓correct approve 100%✓correct 1 100%
T-1056The item I ordered is the wrong size. I'd like to send it back. Also, a second problem: My invoice says $578 but checkout showed $558. Why was I charged more?✓correct billing 100%✓correct approve 100%✓correct 4 100%
T-1057The item I ordered is the wrong size. I'd like to send it back.✓correct returns 100%✓correct approve 100%✓correct 2 100%
T-1058I changed my account email myself yesterday, and now the app won't accept the new one when I log in.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1059You sent me the wrong colour. How do I return it? One more thing: There's an order #489343 on my account that I did not place.✓correct fraud 100%✓correct deny 100%✓correct 2 100%
T-1060I changed my mind about order #385879 and want to return it.✓correct returns 100%✓correct deny 100%✓correct 2 100%
T-1061I can't log in because my password was changed, and I never asked for that.✓correct fraud 100%✓correct deny 100%✓correct 2 100%
T-1062You sent me the wrong colour. How do I return it?✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1063I got a login alert from a country I've never been to. And separately: I can't log in. It keeps saying "session expired" even after resetting my password.✓correct fraud 100%✓correct deny 100%✓correct 4 99%
T-1064I bought this ebook by mistake, I meant to get the audiobook. Can I get my money back?✓correct returns 100%✓correct deny 100%✓correct 3 100%
T-1065I bought the wrong plan by mistake and want to undo the purchase.✓correct returns 100%✓correct approve 100%✓correct 2 100%
T-1066The payment for #781224 shows on my bank statement but your site still says unpaid. And separately: Tracking says delivered but there is nothing at my door or with my neighbours.✓correct billing 100%✓correct approve 100%✓correct 3 100%
T-1067The app crashes every time I open the settings page.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1068I cancelled my plan on the 12th and was still charged this month. I want that money back.✓correct billing 100%✓correct deny 100%✓correct 3 100%
T-1069I was charged twice for order #773212. Please fix the duplicate charge. One more thing: Export to PDF has been broken since the last update.✓correct billing 100%✓correct deny 100%✓correct 3 100%
T-1070I can't log in. It keeps saying "session expired" even after resetting my password.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1071There's an order #193724 on my account I didn't recognise at first, but it turns out my partner placed it. It's now 6 days late.✓correct shipping 100%✓correct approve 100%✓correct 3 100%
T-1072Export to PDF has been broken since the last update.✓correct technical 100%✓correct deny 100%✓correct 2 100%
T-1073The courier sent order #360706 to my old address instead of the one I entered. One more thing: I changed my mind about order #611142 and want to return it.✓correct shipping 100%✓correct deny 100%✓correct 4 100%
T-1074Please refund me. The jacket arrived on time but it doesn't fit.✓correct fraud 100%✓correct deny 100%✓correct 1 100%
T-1075Sync stops halfway through and shows error E-482.✓correct fraud 100%✓correct deny 100%✓correct 3 100%
T-1076Sync stops halfway through and shows error E-623. Also, a second problem: My invoice says $633 but checkout showed $613. Why was I charged more?✓correct billing 100%✓correct approve 100%✓correct 2 100%
T-1077I got a login alert from a country I've never been to.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1078The package came quickly, but it's the wrong item entirely. I want to send it back.✓correct returns 100%✓correct deny 100%✓correct 3 100%
T-1079I changed my mind about order #971088 and want to return it. And separately: Export to PDF has been broken since the last update.✓correct returns 100%✓correct deny 100%✓correct 3 100%
T-1080Someone changed the email on my account without my permission.✓correct fraud 100%✓correct deny 100%✓correct 3 100%
T-1081I asked for a password reset an hour ago, but the link in the email says it has expired.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1082There's an order #419807 on my account that I did not place.✓correct fraud 100%✓correct deny 100%✓correct 3 100%
T-1083The payment for #230504 shows on my bank statement but your site still says unpaid. Also, a second problem: I can't log in. It keeps saying "session expired" even after resetting my password.✓correct billing 100%✓correct approve 100%✓correct 2 100%
T-1084The tracking page shows a blank screen every time I open it. The package itself arrived fine.✓correct fraud 100%✓correct deny 100%✓correct 2 100%
T-1085I was charged twice for order #335464. Please fix the duplicate charge.✓correct billing 100%✓correct deny 100%✓correct 1 100%
T-1086The courier sent order #455835 to my old address instead of the one I entered. Also, a second problem: The app crashes every time I open the settings page.✓correct fraud 100%✓correct deny 100%✓correct 2 100%
T-1087My invoice says $156 but checkout showed $136. Why was I charged more?✓correct billing 100%✓correct approve 100%✓correct 4 100%
T-1088The invoice page won't load, it just spins. The charge itself is correct.✓correct technical 74%✓correct deny 91%✓correct 3 100%
T-1089The courier sent order #805614 to my old address instead of the one I entered. One more thing: I got a login alert from a country I've never been to.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1090The payment for #617914 shows on my bank statement but your site still says unpaid.✓correct billing 100%✓correct deny 100%✓correct 3 100%
T-1091I changed my account email myself yesterday, and now the app won't accept the new one when I log in.✓correct fraud 100%✓correct deny 100%✓correct 4 99%
T-1092My package for order #866428 hasn't arrived and tracking hasn't moved in 8 days.✓correct shipping 100%✓correct approve 100%✓correct 2 100%
T-1093I can't log in. It keeps saying "session expired" even after resetting my password. And separately: The payment for #860116 shows on my bank statement but your site still says unpaid.✓correct billing 100%✓correct deny 100%✓correct 2 100%
T-1094I can't log in because my password was changed, and I never asked for that.✓correct fraud 100%✓correct deny 100%✓correct 3 100%
T-1095Tracking says delivered but there is nothing at my door or with my neighbours.✓correct shipping 100%✓correct approve 100%✓correct 2 100%
T-1096I bought the wrong plan by mistake and want to undo the purchase. And separately: Someone changed the email on my account without my permission.✓correct fraud 100%✓correct deny 100%✓correct 3 100%
T-1097The courier sent order #939646 to my old address instead of the one I entered.✓correct shipping 100%✓correct deny 100%✓correct 1 100%
T-1098I bought this ebook by mistake, I meant to get the audiobook. Can I get my money back?✓correct returns 100%✓correct approve 100%✓correct 1 100%
T-1099My package for order #247674 hasn't arrived and tracking hasn't moved in 3 days. One more thing: I changed my mind about order #232773 and want to return it.✓correct shipping 100%✓correct approve 100%✓correct 4 100%
T-1100The item I ordered is the wrong size. I'd like to send it back.✓correct returns 100%✓correct approve 100%✓correct 2 100%
T-1101I cancelled my plan on the 1st and was still charged this month. I want that money back.✓correct billing 100%✓correct approve 100%✓correct 4 98%
T-1102I changed my mind about order #385270 and want to return it.✓correct returns 100%✓correct approve 100%✓correct 4 100%
T-1103My invoice says $241 but checkout showed $221. Why was I charged more? And separately: You sent me the wrong colour. How do I return it?✓correct billing 100%✓correct approve 100%✓correct 2 100%
T-1104There's an order #761633 on my account I didn't recognise at first, but it turns out my partner placed it. It's now 9 days late.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1105You sent me the wrong colour. How do I return it?✓correct returns 100%✓correct approve 100%✓correct 2 100%
T-1106Tracking says delivered but there is nothing at my door or with my neighbours. One more thing: Someone changed the email on my account without my permission.✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1107I bought the wrong plan by mistake and want to undo the purchase.✓correct returns 100%✓correct deny 100%✓correct 3 100%
T-1108Please refund me. The jacket arrived on time but it doesn't fit.✓correct returns 100%✓correct approve 100%✓correct 1 100%
T-1109You sent me the wrong colour. How do I return it? One more thing: The payment for #469814 shows on my bank statement but your site still says unpaid.✓correct billing 100%✓correct approve 100%✓correct 2 100%
T-1110The app crashes every time I open the settings page.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1111The package came quickly, but it's the wrong item entirely. I want to send it back.✓correct returns 100%✓correct approve 100%✓correct 2 100%
T-1112I can't log in. It keeps saying "session expired" even after resetting my password.✓correct technical 100%✓correct deny 100%✓correct 2 100%
T-1113The app crashes every time I open the settings page. One more thing: My invoice says $158 but checkout showed $138. Why was I charged more?✓correct billing 100%✓correct approve 100%✓correct 3 100%
T-1114I asked for a password reset an hour ago, but the link in the email says it has expired.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1115Export to PDF has been broken since the last update.✓correct technical 100%✓correct deny 100%✓correct 1 100%
T-1116Someone changed the email on my account without my permission. Also, a second problem: My invoice says $546 but checkout showed $526. Why was I charged more?✓correct fraud 100%✓correct deny 100%✓correct 4 100%
T-1117Sync stops halfway through and shows error E-711.✓correct technical 100%✓correct deny 100%✓correct 2 100%
T-1118The tracking page shows a blank screen every time I open it. The package itself arrived fine.✓correct technical 100%✓correct deny 100%✓correct 2 100%
T-1119Tracking says delivered but there is nothing at my door or with my neighbours. And separately: My invoice says $261 but checkout showed $241. Why was I charged more?✓correct billing 100%✓correct approve 100%✓correct 4 100%

Percentages are the model's own confidence. Every rule is on the Rulebook page.

Drex Max across all benchmarks · How Rulebook works