Clef

Cloudflare · cloudflare/clef · added 20 Oct 2026

Clef by Cloudflare ranks #7 of 17 AI decision models on the DecisionBench Odds benchmark (weighing risk), with score 42.2%. View on OpenRouter.

Odds rank: #7 of 17
Score: 42.2%
Value captured: 64.3%
Odds within 2×: 20.0%
Odds off by: ×10.3
Leans: over ×9.9

60 cases · best action 30% of the time · acts on its own odds 63% of the time · $0.0362 per 1,000 cases · 306 ms per case

Every case

The probability the model gave and the right one (✓ when its odds are within 2×), the action it picked, and how much of the available expected payoff that action earns.

Case	Situation	Probability	Action	Value
O-1000 · Easy	Online order #512643: $120 basket	✕ 32% / 2%	✕ cancel the order → ship the order	23%
O-1001 · Rare outcome	Small-business loan application: $10,000 over 3 years	✕ 93% / 9%	✕ decline the loan → approve the loan	0%
O-1002 · Adds up	Boiler feed pump on line 7, 6 years in service	✓ 80% / 81%	✓ replace the part now	100%
O-1003 · Missing clue	Inbound demo request, $9,850 first-year deal	✕ 80% / 9%	✕ assign a sales rep → drop the lead	0%
O-1004 · Red herring	Online order #428497: $170 basket	✓ 17% / 11%	✓ ship the order	100%
O-1005 · High stakes	Small-business loan application: $5,000 over 5 years	✓ 13% / 8%	✕ approve the loan → decline the loan	53%
O-1006 · Easy	Inbound demo request, $8,450 first-year deal	✕ 3% / 1%	✓ drop the lead	100%
O-1007 · Rare outcome	Online order #527243: $100 basket	✕ 88% / 25%	✓ hold for manual review	100%
O-1008 · Adds up	Small-business loan application: $128,000 over 2 years	✕ 95% / 44%	✓ approve only against collateral	100%
O-1009 · Missing clue	Conveyor gearbox on line 7, 4 years in service	✕ 86% / 43%	✕ replace the part now → stop it for an inspection	95%
O-1010 · Red herring	Inbound demo request, $5,500 first-year deal	✕ 91% / 34%	✕ assign a sales rep → send the automated email sequence	56%
O-1011 · High stakes	Online order #736444: $190 basket	✓ 5% / 6%	✕ ship the order → hold for manual review	85%
O-1012 · Easy	Press motor on line 9, 12 years in service	✕ 87% / 30%	✕ replace the part now → stop it for an inspection	46%
O-1013 · Rare outcome	Inbound demo request, $2,200 first-year deal	✕ 93% / 5%	✕ assign a sales rep → drop the lead	71%
O-1014 · Adds up	Online order #735461: $310 basket	✕ 98% / 68%	✓ cancel the order	100%
O-1015 · Missing clue	Small-business loan application: $22,000 over 3 years	✕ 93% / 6%	✕ decline the loan → approve the loan	0%
O-1016 · Red herring	Conveyor gearbox on line 2, 10 years in service	✓ 15% / 10%	✕ replace the part now → keep it running	0%
O-1017 · High stakes	Inbound demo request, $3,450 first-year deal	✓ 3% / 4%	✕ send the automated email sequence → assign a sales rep	29%
O-1018 · Easy	Small-business loan application: $6,000 over 5 years	✕ 50% / 4%	✕ approve only against collateral → approve the loan	70%
O-1019 · Rare outcome	Coolant pump on line 4, 10 years in service	✕ 32% / 8%	✕ replace the part now → stop it for an inspection	64%
O-1020 · Adds up	Inbound demo request, $5,800 first-year deal	✕ 89% / 46%	✕ assign a sales rep → send the automated email sequence	64%
O-1021 · Missing clue	Online order #590697: $95 basket	✕ 86% / 24%	✕ cancel the order → hold for manual review	12%
O-1022 · Red herring	Small-business loan application: $21,000 over 3 years	✕ 90% / 37%	✓ approve only against collateral	100%
O-1023 · High stakes	Coolant pump on line 2, 15 years in service	✕ 4% / 2%	✕ replace the part now → stop it for an inspection	0%
O-1024 · Easy	Online order #426231: $175 basket	✕ 91% / 52%	✓ cancel the order	100%
O-1025 · Rare outcome	Small-business loan application: $77,000 over 2 years	✕ 95% / 6%	✕ approve only against collateral → approve the loan	94%
O-1026 · Adds up	Conveyor gearbox on line 9, 14 years in service	✕ 95% / 80%	✓ replace the part now	100%
O-1027 · Missing clue	Inbound demo request, $3,200 first-year deal	✕ 74% / 22%	✕ assign a sales rep → drop the lead	0%
O-1028 · Red herring	Online order #599758: $73 basket	✕ 33% / 16%	✕ cancel the order → ship the order	89%
O-1029 · High stakes	Small-business loan application: $112,000 over 3 years	✕ 47% / 10%	✕ approve only against collateral → decline the loan	93%
O-1030 · Easy	Inbound demo request, $31,000 first-year deal	✓ 5% / 5%	✕ drop the lead → send the automated email sequence	73%
O-1031 · Rare outcome	Online order #973229: $545 basket	✕ 98% / 23%	✕ cancel the order → hold for manual review	84%
O-1032 · Adds up	Small-business loan application: $21,000 over 2 years	✕ 94% / 52%	✕ decline the loan → approve only against collateral	81%
O-1033 · Missing clue	Boiler feed pump on line 2, 4 years in service	✕ 66% / 31%	✕ replace the part now → stop it for an inspection	90%
O-1034 · Red herring	Inbound demo request, $2,400 first-year deal	✓ 9% / 12%	✓ send the automated email sequence	100%
O-1035 · High stakes	Online order #380045: $700 basket	✕ 23% / 8%	✓ hold for manual review	100%
O-1036 · Easy	Press motor on line 2, 10 years in service	✕ 14% / 1%	✕ replace the part now → keep it running	0%
O-1037 · Rare outcome	Inbound demo request, $3,250 first-year deal	✕ 47% / 9%	✕ assign a sales rep → drop the lead	0%
O-1038 · Adds up	Online order #820072: $71 basket	✕ 98% / 87%	✓ cancel the order	100%
O-1039 · Missing clue	Small-business loan application: $52,000 over 5 years	✕ 89% / 6%	✕ approve only against collateral → approve the loan	65%
O-1040 · Red herring	Coolant pump on line 1, 14 years in service	✕ 65% / 20%	✕ replace the part now → keep it running	0%
O-1041 · High stakes	Inbound demo request, $2,700 first-year deal	✓ 5% / 4%	✕ drop the lead → assign a sales rep	97%
O-1042 · Easy	Small-business loan application: $17,000 over 5 years	✕ 82% / 43%	✕ approve only against collateral → decline the loan	66%
O-1043 · Rare outcome	Boiler feed pump on line 7, 14 years in service	✕ 84% / 21%	✓ stop it for an inspection	100%
O-1044 · Adds up	Inbound demo request, $2,650 first-year deal	✕ 88% / 50%	✕ assign a sales rep → send the automated email sequence	70%
O-1045 · Missing clue	Online order #739291: $185 basket	✕ 97% / 57%	✕ cancel the order → hold for manual review	82%
O-1046 · Red herring	Small-business loan application: $15,000 over 3 years	✕ 34% / 12%	✕ decline the loan → approve only against collateral	0%
O-1047 · High stakes	Air compressor on line 8, 14 years in service	✓ 6% / 6%	✕ keep it running → stop it for an inspection	96%
O-1048 · Easy	Online order #728467: $440 basket	✕ 96% / 53%	✕ cancel the order → hold for manual review	75%
O-1049 · Rare outcome	Small-business loan application: $11,000 over 2 years	✕ 96% / 6%	✕ approve only against collateral → approve the loan	93%
O-1050 · Adds up	Air compressor on line 7, 7 years in service	✓ 88% / 84%	✓ replace the part now	100%
O-1051 · Missing clue	Inbound demo request, $3,250 first-year deal	✕ 43% / 11%	✕ assign a sales rep → drop the lead	0%
O-1052 · Red herring	Online order #552300: $43 basket	✕ 70% / 22%	✕ cancel the order → ship the order	53%
O-1053 · High stakes	Small-business loan application: $13,000 over 5 years	✕ 67% / 6%	✕ approve only against collateral → decline the loan	0%
O-1054 · Easy	Inbound demo request, $84,500 first-year deal	✕ 72% / 39%	✓ assign a sales rep	100%
O-1055 · Rare outcome	Online order #914426: $705 basket	✕ 97% / 20%	✕ cancel the order → hold for manual review	0%
O-1056 · Adds up	Small-business loan application: $114,000 over 2 years	✕ 93% / 44%	✕ decline the loan → approve only against collateral	91%
O-1057 · Missing clue	Boiler feed pump on line 7, 14 years in service	✕ 60% / 8%	✓ stop it for an inspection	100%
O-1058 · Red herring	Inbound demo request, $3,750 first-year deal	✓ 19% / 19%	✓ send the automated email sequence	100%
O-1059 · High stakes	Online order #381274: $720 basket	✕ 32% / 7%	✓ hold for manual review	100%

Probability: the model's answer / the right one. Value: 100% for the best action, 0% for the worst. A case is worked through on the Odds page.

Clef across all benchmarks · How Odds works

Every case

The probability the model gave and the right one (✓ when its odds are within 2×), the action it picked, and how much of the available expected payoff that action earns.

Case	Situation	Probability	Action	Value
O-1000 · Easy	Online order #512643: $120 basket	✕ 32% / 2%	✕ cancel the order → ship the order	23%
O-1001 · Rare outcome	Small-business loan application: $10,000 over 3 years	✕ 93% / 9%	✕ decline the loan → approve the loan	0%
O-1002 · Adds up	Boiler feed pump on line 7, 6 years in service	✓ 80% / 81%	✓ replace the part now	100%
O-1003 · Missing clue	Inbound demo request, $9,850 first-year deal	✕ 80% / 9%	✕ assign a sales rep → drop the lead	0%
O-1004 · Red herring	Online order #428497: $170 basket	✓ 17% / 11%	✓ ship the order	100%
O-1005 · High stakes	Small-business loan application: $5,000 over 5 years	✓ 13% / 8%	✕ approve the loan → decline the loan	53%
O-1006 · Easy	Inbound demo request, $8,450 first-year deal	✕ 3% / 1%	✓ drop the lead	100%
O-1007 · Rare outcome	Online order #527243: $100 basket	✕ 88% / 25%	✓ hold for manual review	100%
O-1008 · Adds up	Small-business loan application: $128,000 over 2 years	✕ 95% / 44%	✓ approve only against collateral	100%
O-1009 · Missing clue	Conveyor gearbox on line 7, 4 years in service	✕ 86% / 43%	✕ replace the part now → stop it for an inspection	95%
O-1010 · Red herring	Inbound demo request, $5,500 first-year deal	✕ 91% / 34%	✕ assign a sales rep → send the automated email sequence	56%
O-1011 · High stakes	Online order #736444: $190 basket	✓ 5% / 6%	✕ ship the order → hold for manual review	85%
O-1012 · Easy	Press motor on line 9, 12 years in service	✕ 87% / 30%	✕ replace the part now → stop it for an inspection	46%
O-1013 · Rare outcome	Inbound demo request, $2,200 first-year deal	✕ 93% / 5%	✕ assign a sales rep → drop the lead	71%
O-1014 · Adds up	Online order #735461: $310 basket	✕ 98% / 68%	✓ cancel the order	100%
O-1015 · Missing clue	Small-business loan application: $22,000 over 3 years	✕ 93% / 6%	✕ decline the loan → approve the loan	0%
O-1016 · Red herring	Conveyor gearbox on line 2, 10 years in service	✓ 15% / 10%	✕ replace the part now → keep it running	0%
O-1017 · High stakes	Inbound demo request, $3,450 first-year deal	✓ 3% / 4%	✕ send the automated email sequence → assign a sales rep	29%
O-1018 · Easy	Small-business loan application: $6,000 over 5 years	✕ 50% / 4%	✕ approve only against collateral → approve the loan	70%
O-1019 · Rare outcome	Coolant pump on line 4, 10 years in service	✕ 32% / 8%	✕ replace the part now → stop it for an inspection	64%
O-1020 · Adds up	Inbound demo request, $5,800 first-year deal	✕ 89% / 46%	✕ assign a sales rep → send the automated email sequence	64%
O-1021 · Missing clue	Online order #590697: $95 basket	✕ 86% / 24%	✕ cancel the order → hold for manual review	12%
O-1022 · Red herring	Small-business loan application: $21,000 over 3 years	✕ 90% / 37%	✓ approve only against collateral	100%
O-1023 · High stakes	Coolant pump on line 2, 15 years in service	✕ 4% / 2%	✕ replace the part now → stop it for an inspection	0%
O-1024 · Easy	Online order #426231: $175 basket	✕ 91% / 52%	✓ cancel the order	100%
O-1025 · Rare outcome	Small-business loan application: $77,000 over 2 years	✕ 95% / 6%	✕ approve only against collateral → approve the loan	94%
O-1026 · Adds up	Conveyor gearbox on line 9, 14 years in service	✕ 95% / 80%	✓ replace the part now	100%
O-1027 · Missing clue	Inbound demo request, $3,200 first-year deal	✕ 74% / 22%	✕ assign a sales rep → drop the lead	0%
O-1028 · Red herring	Online order #599758: $73 basket	✕ 33% / 16%	✕ cancel the order → ship the order	89%
O-1029 · High stakes	Small-business loan application: $112,000 over 3 years	✕ 47% / 10%	✕ approve only against collateral → decline the loan	93%
O-1030 · Easy	Inbound demo request, $31,000 first-year deal	✓ 5% / 5%	✕ drop the lead → send the automated email sequence	73%
O-1031 · Rare outcome	Online order #973229: $545 basket	✕ 98% / 23%	✕ cancel the order → hold for manual review	84%
O-1032 · Adds up	Small-business loan application: $21,000 over 2 years	✕ 94% / 52%	✕ decline the loan → approve only against collateral	81%
O-1033 · Missing clue	Boiler feed pump on line 2, 4 years in service	✕ 66% / 31%	✕ replace the part now → stop it for an inspection	90%
O-1034 · Red herring	Inbound demo request, $2,400 first-year deal	✓ 9% / 12%	✓ send the automated email sequence	100%
O-1035 · High stakes	Online order #380045: $700 basket	✕ 23% / 8%	✓ hold for manual review	100%
O-1036 · Easy	Press motor on line 2, 10 years in service	✕ 14% / 1%	✕ replace the part now → keep it running	0%
O-1037 · Rare outcome	Inbound demo request, $3,250 first-year deal	✕ 47% / 9%	✕ assign a sales rep → drop the lead	0%
O-1038 · Adds up	Online order #820072: $71 basket	✕ 98% / 87%	✓ cancel the order	100%
O-1039 · Missing clue	Small-business loan application: $52,000 over 5 years	✕ 89% / 6%	✕ approve only against collateral → approve the loan	65%
O-1040 · Red herring	Coolant pump on line 1, 14 years in service	✕ 65% / 20%	✕ replace the part now → keep it running	0%
O-1041 · High stakes	Inbound demo request, $2,700 first-year deal	✓ 5% / 4%	✕ drop the lead → assign a sales rep	97%
O-1042 · Easy	Small-business loan application: $17,000 over 5 years	✕ 82% / 43%	✕ approve only against collateral → decline the loan	66%
O-1043 · Rare outcome	Boiler feed pump on line 7, 14 years in service	✕ 84% / 21%	✓ stop it for an inspection	100%
O-1044 · Adds up	Inbound demo request, $2,650 first-year deal	✕ 88% / 50%	✕ assign a sales rep → send the automated email sequence	70%
O-1045 · Missing clue	Online order #739291: $185 basket	✕ 97% / 57%	✕ cancel the order → hold for manual review	82%
O-1046 · Red herring	Small-business loan application: $15,000 over 3 years	✕ 34% / 12%	✕ decline the loan → approve only against collateral	0%
O-1047 · High stakes	Air compressor on line 8, 14 years in service	✓ 6% / 6%	✕ keep it running → stop it for an inspection	96%
O-1048 · Easy	Online order #728467: $440 basket	✕ 96% / 53%	✕ cancel the order → hold for manual review	75%
O-1049 · Rare outcome	Small-business loan application: $11,000 over 2 years	✕ 96% / 6%	✕ approve only against collateral → approve the loan	93%
O-1050 · Adds up	Air compressor on line 7, 7 years in service	✓ 88% / 84%	✓ replace the part now	100%
O-1051 · Missing clue	Inbound demo request, $3,250 first-year deal	✕ 43% / 11%	✕ assign a sales rep → drop the lead	0%
O-1052 · Red herring	Online order #552300: $43 basket	✕ 70% / 22%	✕ cancel the order → ship the order	53%
O-1053 · High stakes	Small-business loan application: $13,000 over 5 years	✕ 67% / 6%	✕ approve only against collateral → decline the loan	0%
O-1054 · Easy	Inbound demo request, $84,500 first-year deal	✕ 72% / 39%	✓ assign a sales rep	100%
O-1055 · Rare outcome	Online order #914426: $705 basket	✕ 97% / 20%	✕ cancel the order → hold for manual review	0%
O-1056 · Adds up	Small-business loan application: $114,000 over 2 years	✕ 93% / 44%	✕ decline the loan → approve only against collateral	91%
O-1057 · Missing clue	Boiler feed pump on line 7, 14 years in service	✕ 60% / 8%	✓ stop it for an inspection	100%
O-1058 · Red herring	Inbound demo request, $3,750 first-year deal	✓ 19% / 19%	✓ send the automated email sequence	100%
O-1059 · High stakes	Online order #381274: $720 basket	✕ 32% / 7%	✓ hold for manual review	100%

Probability: the model's answer / the right one. Value: 100% for the best action, 0% for the worst. A case is worked through on the Odds page.