◎
CRPS: Beyond Win/Loss
Continuous Ranked Probability Score measures how close probability estimates are to the outcome — not only whether the side was right.
Track Record separates cautious forecasts from higher-variance research. Accuracy appears after recorded markets resolve.
A cautious view that favors stronger evidence and smaller, more defensible probability gaps.
Each point shows published observed accuracy for a probability bucket. Hover or focus on a point to inspect its values.
| Category | Resolved | Accuracy | Avg Edge vs Market |
|---|---|---|---|
| Crypto | 48 | 71.2% | +9.4% |
| Weather | 22 | 81.8% | +6.1% |
| Sports | 61 | 68.9% | +8.7% |
| Esports | 19 | 73.7% | +10.2% |
| Geopolitics | 27 | 66.7% | +11.5% |
| Politics | 34 | 70.6% | +7.9% |
| Finance | 41 | 75.6% | +8.3% |
| General | 15 | 73.3% | +5.8% |
| Date | Market | Category | AI Pred | Mkt Price | Edge % | Side | Outcome |
|---|---|---|---|---|---|---|---|
| Oct 24, 2026 | Will ETH close above $4,000 this week? | Crypto | 62% | 54% | +8.0% | YES | correct |
| Oct 23, 2026 | NYC measurable rain before Oct 25? | Weather | 28% | 41% | +13.0% | NO | correct |
| Oct 22, 2026 | Fed holds rates at next decision? | Finance | 71% | 66% | +5.0% | YES | correct |
| Oct 21, 2026 | LCK team wins Worlds group stage Bo1? | Esports | 44% | 52% | +8.0% | NO | incorrect |
| Oct 20, 2026 | US House passes spending package this month? | Politics | 39% | 47% | +8.0% | NO | correct |
| Oct 19, 2026 | NBA opener: home team covers? | Sports | 57% | 51% | +6.0% | YES | correct |
Continuous Ranked Probability Score measures how close probability estimates are to the outcome — not only whether the side was right.
Resolved forecasts feed per-category calibration multipliers so systematic over/under-confidence is corrected over time.
When models disagree, confidence is lowered. Agreement across the ensemble raises weight on the published probability.