Model Performance
Transparent accuracy tracking. Every prediction is measured, every miss is counted.
How to read this page
A forecast here is one decision — one match, one race, one stage, one title — not one line of probability. A WRC Stage Winner forecast means scoring around 10 candidates, most of them easy calls; counting each line as a forecast would let a single race outweigh dozens of matches.
Raw Brier scores cannot be compared across markets, because some questions are harder than others. The skill score removes that: it measures how much better the model does than knowing only how often this kind of call comes in. Zero means it adds nothing, one is perfect, and a negative number means it is worse than guessing. 4 forecasts sit in segments too small to set a reliable baseline, so they show a raw score only.
Calibration
When the model says 70%, does it happen 70% of the time? The closer to the diagonal, the better calibrated.
Skill over time
Monthly skill score by sport. Higher is better. Months with fewer than 5 scored forecasts are excluded.
By market
Raw Brier sits next to the baseline it is measured against; compare Brier only within a row, and skill across rows. The highlighted row is where the model adds the most over guessing.
| Sport | Market | Field | Forecasts | Brier | Baseline | Skill |
|---|---|---|---|---|---|---|
| WRC | Drivers Championship | 8 | 1 | 0.1031 | 0.7656 | — |
| WRC | Rally Podium | 11 | 4 | 0.1989 | — | — |
| WRC | Rally Winner | 10 | 4 | 0.0862 | 0.0880 | — |
| WRC | Stage Winner best | 10 | 37 | 0.0861 | 0.0881 | 0.022 |