d1
Liquid · liquid/d1 · added 20 Oct 2026
d1 by Liquid ranks #7 of 12 AI decision models on the DecisionBench Rulebook benchmark (following written rules), with accuracy 93.9%. View on OpenRouter.
- Rulebook rank
- #7 of 12
- Accuracy
- 93.9%
- Team
- 100.0%
- Refund
- 100.0%
- Urgency
- 81.7%
- Confidence gap
- 0.038
60 tickets · 0.0% of mistakes made while at least 90% sure · $0.0138 per 1,000 tickets · 406 ms per ticket
Every ticket
The model's three decisions on each ticket, with its confidence. Wrong answers show the right one. 11 of 60 tickets had at least one mistake.
| Ticket | Customer wrote | Team | Refund | Urgency |
|---|---|---|---|---|
| T-1000 | My invoice says $425 but checkout showed $405. Why was I charged more? | ✓ billing100% | ✓ approve99% | ✓ 1100% |
| T-1001 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping100% | ✓ deny100% | ✓ 1100% |
| T-1002 | I changed my mind about order #468974 and want to return it. | ✓ returns100% | ✓ deny100% | ✓ 296% |
| T-1003 | Sync stops halfway through and shows error E-883. | ✓ technical100% | ✓ deny99% | ✓ 198% |
| T-1004 | Someone changed the email on my account without my permission. | ✓ fraud100% | ✓ deny99% | ✓ 0100% |
| T-1005 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing100% | ✓ deny90% | ✓ 198% |
| T-1006 | My package for order #822804 hasn't arrived and tracking hasn't moved in 7 days. | ✓ shipping100% | ✓ approve100% | ✓ 283% |
| T-1007 | I changed my mind about order #797563 and want to return it. | ✓ returns100% | ✓ approve99% | ✓ 188% |
| T-1008 | The app crashes every time I open the settings page. | ✓ technical100% | ✓ deny100% | ✓ 197% |
| T-1009 | Someone changed the email on my account without my permission. | ✓ fraud100% | ✓ deny100% | ✓ 378% |
| T-1010 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing100% | ✓ approve99% | ✓ 199% |
| T-1011 | The courier sent order #441011 to my old address instead of the one I entered. | ✓ shipping100% | ✓ approve100% | ✕ 3 → 268% |
| T-1012 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns96% | ✓ approve89% | ✕ 3 → 272% |
| T-1013 | Export to PDF has been broken since the last update. | ✓ fraud100% | ✓ deny100% | ✓ 178% |
| T-1014 | Someone changed the email on my account without my permission. | ✓ fraud100% | ✓ deny99% | ✓ 199% |
| T-1015 | My invoice says $62 but checkout showed $42. Why was I charged more? | ✓ billing100% | ✓ deny100% | ✓ 296% |
| T-1016 | My package for order #455490 hasn't arrived and tracking hasn't moved in 4 days. | ✓ fraud100% | ✓ deny100% | ✕ 2 → 180% |
| T-1017 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns98% | ✓ approve95% | ✓ 196% |
| T-1018 | Export to PDF has been broken since the last update. | ✓ fraud100% | ✓ deny100% | ✓ 199% |
| T-1019 | Someone changed the email on my account without my permission. | ✓ fraud100% | ✓ deny100% | ✓ 198% |
| T-1020 | I was charged twice for order #227551. Please fix the duplicate charge. | ✓ fraud100% | ✓ deny100% | ✕ 3 → 273% |
| T-1021 | My package for order #718743 hasn't arrived and tracking hasn't moved in 8 days. | ✓ shipping100% | ✓ approve100% | ✕ 4 → 385% |
| T-1022 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns89% | ✓ deny96% | ✓ 484% |
| T-1023 | Export to PDF has been broken since the last update. | ✓ technical100% | ✓ deny100% | ✓ 298% |
| T-1024 | I got a login alert from a country I've never been to. | ✓ fraud100% | ✓ deny96% | ✓ 298% |
| T-1025 | My invoice says $261 but checkout showed $241. Why was I charged more? | ✓ billing100% | ✓ approve100% | ✓ 1100% |
| T-1026 | My package for order #821430 hasn't arrived and tracking hasn't moved in 10 days. | ✓ shipping100% | ✓ approve100% | ✓ 0100% |
| T-1027 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns98% | ✓ approve95% | ✓ 0100% |
| T-1028 | The app crashes every time I open the settings page. | ✓ technical100% | ✓ deny100% | ✕ 4 → 364% |
| T-1029 | Someone changed the email on my account without my permission. | ✓ fraud100% | ✓ deny100% | ✕ 3 → 254% |
| T-1030 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing100% | ✓ approve99% | ✓ 194% |
| T-1031 | The courier sent order #259717 to my old address instead of the one I entered. | ✓ shipping100% | ✓ approve100% | ✓ 186% |
| T-1032 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns99% | ✓ approve98% | ✕ 3 → 264% |
| T-1033 | Export to PDF has been broken since the last update. | ✓ technical100% | ✓ deny100% | ✓ 381% |
| T-1034 | There's an order #135622 on my account that I did not place. | ✓ fraud100% | ✓ deny100% | ✓ 490% |
| T-1035 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing100% | ✓ approve98% | ✓ 199% |
| T-1036 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping100% | ✓ approve100% | ✓ 099% |
| T-1037 | You sent me the wrong colour. How do I return it? | ✓ returns100% | ✓ deny98% | ✓ 297% |
| T-1038 | I can't log in. It keeps saying "session expired" even after resetting my password. | ✓ technical100% | ✓ deny100% | ✓ 193% |
| T-1039 | There's an order #919845 on my account that I did not place. | ✓ fraud100% | ✓ deny93% | ✓ 0100% |
| T-1040 | My invoice says $72 but checkout showed $52. Why was I charged more? | ✓ billing100% | ✓ deny100% | ✓ 296% |
| T-1041 | My package for order #643805 hasn't arrived and tracking hasn't moved in 9 days. | ✓ shipping100% | ✓ deny100% | ✓ 0100% |
| T-1042 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns83% | ✓ deny100% | ✓ 199% |
| T-1043 | Sync stops halfway through and shows error E-132. | ✓ technical100% | ✓ deny100% | ✓ 0100% |
| T-1044 | I got a login alert from a country I've never been to. | ✓ fraud100% | ✓ deny99% | ✓ 199% |
| T-1045 | My invoice says $377 but checkout showed $357. Why was I charged more? | ✓ billing100% | ✓ approve99% | ✕ 3 → 266% |
| T-1046 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ fraud100% | ✓ deny100% | ✓ 389% |
| T-1047 | You sent me the wrong colour. How do I return it? | ✓ returns100% | ✓ deny100% | ✓ 1100% |
| T-1048 | Export to PDF has been broken since the last update. | ✓ fraud100% | ✓ deny100% | ✓ 197% |
| T-1049 | There's an order #917499 on my account that I did not place. | ✓ fraud100% | ✓ deny88% | ✓ 199% |
| T-1050 | I was charged twice for order #334980. Please fix the duplicate charge. | ✓ billing100% | ✓ approve98% | ✓ 493% |
| T-1051 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping100% | ✓ approve100% | ✕ 4 → 384% |
| T-1052 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns94% | ✓ deny100% | ✓ 286% |
| T-1053 | Sync stops halfway through and shows error E-508. | ✓ technical100% | ✓ deny100% | ✓ 0100% |
| T-1054 | Someone changed the email on my account without my permission. | ✓ fraud100% | ✓ deny99% | ✓ 0100% |
| T-1055 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing100% | ✓ approve100% | ✕ 4 → 365% |
| T-1056 | The courier sent order #983082 to my old address instead of the one I entered. | ✓ shipping100% | ✓ approve100% | ✓ 193% |
| T-1057 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns98% | ✓ approve91% | ✓ 279% |
| T-1058 | The app crashes every time I open the settings page. | ✓ technical100% | ✓ deny100% | ✓ 099% |
| T-1059 | There's an order #230179 on my account that I did not place. | ✓ fraud100% | ✓ deny80% | ✓ 294% |
Percentages are the model's own confidence. Every rule is on the Rulebook page.