Span-02
Respan · respan/span-02 · added 20 Oct 2026
Span-02 by Respan ranks #8 of 17 AI decision models on the DecisionBench Rulebook benchmark (following written rules), with accuracy 95.0%. View on OpenRouter.
- Rulebook rank
- #8 of 17
- Accuracy
- 95.0%
- Team
- 100.0%
- Refund
- 100.0%
- Urgency
- 85.0%
- Confidence gap
- 0.029
60 tickets · 66.7% of mistakes made while at least 90% sure · $0.0177 per 1,000 tickets · 619 ms per ticket
Every ticket
The model's three decisions on each ticket, with its confidence. Wrong answers show the right one. 9 of 60 tickets had at least one mistake.
| Ticket | Customer wrote | Team | Refund | Urgency |
|---|---|---|---|---|
| T-1000 | My invoice says $425 but checkout showed $405. Why was I charged more? | ✓ billing 100% | ✓ approve 95% | ✓ 1 99% |
| T-1001 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping 100% | ✓ deny 100% | ✓ 1 99% |
| T-1002 | I changed my mind about order #468974 and want to return it. | ✓ returns 100% | ✓ deny 100% | ✓ 2 99% |
| T-1003 | Sync stops halfway through and shows error E-883. | ✓ technical 100% | ✓ deny 100% | ✕ 2 → 1 85% |
| T-1004 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 0 99% |
| T-1005 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 100% | ✓ deny 100% | ✓ 1 86% |
| T-1006 | My package for order #822804 hasn't arrived and tracking hasn't moved in 7 days. | ✓ shipping 100% | ✓ approve 92% | ✓ 2 99% |
| T-1007 | I changed my mind about order #797563 and want to return it. | ✓ returns 100% | ✓ approve 98% | ✕ 2 → 1 60% |
| T-1008 | The app crashes every time I open the settings page. | ✓ technical 100% | ✓ deny 100% | ✕ 2 → 1 68% |
| T-1009 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 3 99% |
| T-1010 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 100% | ✓ approve 96% | ✓ 1 98% |
| T-1011 | The courier sent order #441011 to my old address instead of the one I entered. | ✓ shipping 100% | ✓ approve 95% | ✓ 2 100% |
| T-1012 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 93% | ✓ approve 89% | ✓ 2 98% |
| T-1013 | Export to PDF has been broken since the last update. | ✓ fraud 100% | ✓ deny 100% | ✕ 2 → 1 97% |
| T-1014 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 99% |
| T-1015 | My invoice says $62 but checkout showed $42. Why was I charged more? | ✓ billing 100% | ✓ deny 100% | ✓ 2 99% |
| T-1016 | My package for order #455490 hasn't arrived and tracking hasn't moved in 4 days. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 65% |
| T-1017 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 98% | ✓ approve 95% | ✕ 2 → 1 97% |
| T-1018 | Export to PDF has been broken since the last update. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 98% |
| T-1019 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 94% |
| T-1020 | I was charged twice for order #227551. Please fix the duplicate charge. | ✓ fraud 100% | ✓ deny 100% | ✓ 2 98% |
| T-1021 | My package for order #718743 hasn't arrived and tracking hasn't moved in 8 days. | ✓ shipping 100% | ✓ approve 94% | ✓ 3 93% |
| T-1022 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 97% | ✓ deny 99% | ✓ 4 89% |
| T-1023 | Export to PDF has been broken since the last update. | ✓ technical 100% | ✓ deny 100% | ✓ 2 99% |
| T-1024 | I got a login alert from a country I've never been to. | ✓ fraud 100% | ✓ deny 100% | ✓ 2 99% |
| T-1025 | My invoice says $261 but checkout showed $241. Why was I charged more? | ✓ billing 100% | ✓ approve 92% | ✓ 1 96% |
| T-1026 | My package for order #821430 hasn't arrived and tracking hasn't moved in 10 days. | ✓ shipping 100% | ✓ approve 97% | ✓ 0 98% |
| T-1027 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 95% | ✓ approve 92% | ✓ 0 95% |
| T-1028 | The app crashes every time I open the settings page. | ✓ technical 100% | ✓ deny 100% | ✓ 3 96% |
| T-1029 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 2 97% |
| T-1030 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 100% | ✓ approve 93% | ✓ 1 83% |
| T-1031 | The courier sent order #259717 to my old address instead of the one I entered. | ✓ shipping 100% | ✓ approve 96% | ✕ 2 → 1 97% |
| T-1032 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 97% | ✓ approve 93% | ✓ 2 95% |
| T-1033 | Export to PDF has been broken since the last update. | ✓ technical 100% | ✓ deny 100% | ✓ 3 99% |
| T-1034 | There's an order #135622 on my account that I did not place. | ✓ fraud 100% | ✓ deny 100% | ✓ 4 87% |
| T-1035 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 100% | ✓ approve 94% | ✓ 1 98% |
| T-1036 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping 100% | ✓ approve 97% | ✓ 0 98% |
| T-1037 | You sent me the wrong colour. How do I return it? | ✓ returns 99% | ✓ deny 99% | ✓ 2 99% |
| T-1038 | I can't log in. It keeps saying "session expired" even after resetting my password. | ✓ technical 100% | ✓ deny 100% | ✕ 2 → 1 98% |
| T-1039 | There's an order #919845 on my account that I did not place. | ✓ fraud 100% | ✓ deny 100% | ✓ 0 94% |
| T-1040 | My invoice says $72 but checkout showed $52. Why was I charged more? | ✓ billing 100% | ✓ deny 100% | ✓ 2 99% |
| T-1041 | My package for order #643805 hasn't arrived and tracking hasn't moved in 9 days. | ✓ shipping 100% | ✓ deny 100% | ✓ 0 93% |
| T-1042 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 94% | ✓ deny 100% | ✓ 1 98% |
| T-1043 | Sync stops halfway through and shows error E-132. | ✓ technical 100% | ✓ deny 100% | ✓ 0 99% |
| T-1044 | I got a login alert from a country I've never been to. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 97% |
| T-1045 | My invoice says $377 but checkout showed $357. Why was I charged more? | ✓ billing 100% | ✓ approve 93% | ✓ 2 99% |
| T-1046 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ fraud 100% | ✓ deny 100% | ✓ 3 98% |
| T-1047 | You sent me the wrong colour. How do I return it? | ✓ returns 100% | ✓ deny 100% | ✓ 1 100% |
| T-1048 | Export to PDF has been broken since the last update. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 97% |
| T-1049 | There's an order #917499 on my account that I did not place. | ✓ fraud 100% | ✓ deny 100% | ✓ 1 98% |
| T-1050 | I was charged twice for order #334980. Please fix the duplicate charge. | ✓ billing 100% | ✓ approve 81% | ✓ 4 83% |
| T-1051 | Tracking says delivered but there is nothing at my door or with my neighbours. | ✓ shipping 100% | ✓ approve 94% | ✓ 3 98% |
| T-1052 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 97% | ✓ deny 100% | ✓ 2 98% |
| T-1053 | Sync stops halfway through and shows error E-508. | ✓ technical 100% | ✓ deny 100% | ✕ 1 → 0 92% |
| T-1054 | Someone changed the email on my account without my permission. | ✓ fraud 100% | ✓ deny 100% | ✓ 0 70% |
| T-1055 | My card was billed again after I cancelled. Can you look into this charge? | ✓ billing 100% | ✓ approve 92% | ✓ 3 88% |
| T-1056 | The courier sent order #983082 to my old address instead of the one I entered. | ✓ shipping 100% | ✓ approve 90% | ✓ 1 80% |
| T-1057 | I bought the wrong plan by mistake and want to undo the purchase. | ✓ returns 95% | ✓ approve 77% | ✓ 2 99% |
| T-1058 | The app crashes every time I open the settings page. | ✓ technical 100% | ✓ deny 100% | ✕ 1 → 0 97% |
| T-1059 | There's an order #230179 on my account that I did not place. | ✓ fraud 100% | ✓ deny 100% | ✓ 2 99% |
Percentages are the model's own confidence. Every rule is on the Rulebook page.