Drex v1.5
olderNace.AI · nace-ai/drex-v1.5 · added 20 Oct 2026
Newest version: Drex v2.0. Ranks on this page count every version, older ones included.
Drex v1.5 by Nace.AI, an older version of Drex v2.0, ranks #13 of 19 AI decision models on the DecisionBench Rulebook benchmark (following written rules), with accuracy 85.0%. View on OpenRouter.
- Rulebook rank
- #13 of 19
- Accuracy
- 85.0%
- Team
- 100.0%
- Refund
- 96.7%
- Urgency
- 58.3%
- Confidence gap
- 0.097
60 tickets · 59.3% of mistakes made while at least 90% sure · $0.0243 per 1,000 tickets · 1170 ms per ticket
Every ticket
The model's three decisions on each ticket, with its confidence. Wrong answers show the right one. 26 of 60 tickets had at least one mistake.
| Ticket | Customer wrote | Team | Refund | Urgency |
|---|---|---|---|---|
| T-1000 | My invoice says $425 but checkout showed $405. Why was I charged more? | ✓ billing 100% | ✓ approve 100% | ✓ 1 83% |
| T-1001 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping 100% | ✓ deny 100% | ✓ 1 96% |
| T-1002 | I changed my mind about order #468974 and want to return it. | ✓ returns 100% | ✓ deny 100% | ✓ 2 97% |
| T-1003 | Sync stops halfway through and shows error E-883. | ✓ technical 100% | ✓ deny 100% | ✕ 2 → 1 99% |
| T-1004 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 0 92% |
| T-1005 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 99% | ✓ deny 64% | ✓ 1 66% |
| T-1006 | My package for order #822804 hasn't arrived and tracking hasn't moved in 7 days. | ✓ shipping 100% | ✓ approve 100% | ✕ 3 → 2 97% |
| T-1007 | I changed my mind about order #797563 and want to return it. | ✓ returns 100% | ✓ approve 100% | ✕ 3 → 1 91% |
| T-1008 | The app crashes every time I open the settings page. | ✓ technical 100% | ✓ deny 100% | ✓ 1 74% |
| T-1009 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 3 89% |
| T-1010 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 99% | ✓ approve 99% | ✕ 2 → 1 99% |
| T-1011 | The courier sent order #441011 to my old address instead of the one I entered. | ✓ shipping 100% | ✓ approve 100% | ✕ 3 → 2 99% |
| T-1012 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 100% | ✓ approve 94% | ✕ 3 → 2 99% |
| T-1013 | Export to PDF has been broken since the last update. | ✓ fraud 100% | ✓ deny 99% | ✕ 2 → 1 80% |
| T-1014 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 70% |
| T-1015 | My invoice says $62 but checkout showed $42. Why was I charged more? | ✓ billing 100% | ✓ deny 100% | ✓ 2 99% |
| T-1016 | My package for order #455490 hasn't arrived and tracking hasn't moved in 4 days. | ✓ fraud 100% | ✓ deny 100% | ✕ 3 → 1 82% |
| T-1017 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 100% | ✕ deny → approve 61% | ✕ 2 → 1 96% |
| T-1018 | Export to PDF has been broken since the last update. | ✓ fraud 100% | ✓ deny 99% | ✕ 2 → 1 65% |
| T-1019 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 97% | ✕ 2 → 1 64% |
| T-1020 | I was charged twice for order #227551. Please fix the duplicate charge. | ✓ fraud 100% | ✓ deny 100% | ✕ 3 → 2 85% |
| T-1021 | My package for order #718743 hasn't arrived and tracking hasn't moved in 8 days. | ✓ shipping 100% | ✓ approve 100% | ✓ 3 89% |
| T-1022 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 100% | ✓ deny 100% | ✓ 4 75% |
| T-1023 | Export to PDF has been broken since the last update. | ✓ technical 100% | ✓ deny 100% | ✓ 2 97% |
| T-1024 | I got a login alert from a country I've never been to. | ✓ fraud 99% | ✓ deny 100% | ✓ 2 53% |
| T-1025 | My invoice says $261 but checkout showed $241. Why was I charged more? | ✓ billing 100% | ✓ approve 100% | ✓ 1 76% |
| T-1026 | My package for order #821430 hasn't arrived and tracking hasn't moved in 10 days. | ✓ shipping 100% | ✓ approve 59% | ✓ 0 95% |
| T-1027 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 100% | ✕ deny → approve 92% | ✓ 0 95% |
| T-1028 | The app crashes every time I open the settings page. | ✓ technical 100% | ✓ deny 100% | ✓ 3 89% |
| T-1029 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✕ 3 → 2 96% |
| T-1030 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 99% | ✓ approve 99% | ✕ 2 → 1 93% |
| T-1031 | The courier sent order #259717 to my old address instead of the one I entered. | ✓ shipping 99% | ✓ approve 100% | ✕ 2 → 1 94% |
| T-1032 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 100% | ✓ approve 85% | ✕ 3 → 2 98% |
| T-1033 | Export to PDF has been broken since the last update. | ✓ technical 100% | ✓ deny 100% | ✓ 3 82% |
| T-1034 | There's an order #135622 on my account that I did not place. | ✓ fraud 100% | ✓ deny 100% | ✓ 4 67% |
| T-1035 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 99% | ✓ approve 100% | ✕ 2 → 1 63% |
| T-1036 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping 99% | ✓ approve 100% | ✕ 1 → 0 59% |
| T-1037 | You sent me the wrong colour. How do I return it? | ✓ returns 100% | ✓ deny 100% | ✓ 2 99% |
| T-1038 | I can't log in. It keeps saying "session expired" even after resetting my password. | ✓ technical 100% | ✓ deny 100% | ✕ 2 → 1 98% |
| T-1039 | There's an order #919845 on my account that I did not place. | ✓ fraud 100% | ✓ deny 100% | ✓ 0 90% |
| T-1040 | My invoice says $72 but checkout showed $52. Why was I charged more? | ✓ billing 100% | ✓ deny 100% | ✓ 2 98% |
| T-1041 | My package for order #643805 hasn't arrived and tracking hasn't moved in 9 days. | ✓ shipping 100% | ✓ deny 100% | ✓ 0 92% |
| T-1042 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 100% | ✓ deny 100% | ✓ 1 95% |
| T-1043 | Sync stops halfway through and shows error E-132. | ✓ technical 100% | ✓ deny 100% | ✓ 0 93% |
| T-1044 | I got a login alert from a country I've never been to. | ✓ fraud 99% | ✓ deny 100% | ✓ 1 92% |
| T-1045 | My invoice says $377 but checkout showed $357. Why was I charged more? | ✓ billing 100% | ✓ approve 100% | ✕ 3 → 2 99% |
| T-1046 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ fraud 100% | ✓ deny 100% | ✓ 3 58% |
| T-1047 | You sent me the wrong colour. How do I return it? | ✓ returns 100% | ✓ deny 100% | ✓ 1 99% |
| T-1048 | Export to PDF has been broken since the last update. | ✓ fraud 100% | ✓ deny 100% | ✕ 2 → 1 73% |
| T-1049 | There's an order #917499 on my account that I did not place. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 94% |
| T-1050 | I was charged twice for order #334980. Please fix the duplicate charge. | ✓ billing 100% | ✓ approve 100% | ✕ 3 → 4 73% |
| T-1051 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping 100% | ✓ approve 99% | ✓ 3 73% |
| T-1052 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 100% | ✓ deny 100% | ✓ 2 86% |
| T-1053 | Sync stops halfway through and shows error E-508. | ✓ technical 100% | ✓ deny 100% | ✓ 0 83% |
| T-1054 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 0 87% |
| T-1055 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 100% | ✓ approve 99% | ✓ 3 60% |
| T-1056 | The courier sent order #983082 to my old address instead of the one I entered. | ✓ shipping 100% | ✓ approve 94% | ✕ 2 → 1 99% |
| T-1057 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 100% | ✓ approve 69% | ✕ 3 → 2 95% |
| T-1058 | The app crashes every time I open the settings page. | ✓ technical 100% | ✓ deny 100% | ✕ 1 → 0 65% |
| T-1059 | There's an order #230179 on my account that I did not place. | ✓ fraud 100% | ✓ deny 100% | ✓ 2 75% |
Percentages are the model's own confidence. Every rule is on the Rulebook page.