Model Performance

Transparent accuracy tracking. Every prediction is measured, every miss is counted.

Forecasts scored
55
of 55 · 1,185 underlying lines
Skill score
0.307
over 51 forecasts · 0 = no better than the base rate
Log loss
0.2465
penalises confident mistakes

How to read this page

A forecast here is one decision — one match, one race, one stage, one title — not one line of probability. A Formula 1 Podium forecast means scoring around 22 candidates, most of them easy calls; counting each line as a forecast would let a single race outweigh dozens of matches.

Raw Brier scores cannot be compared across markets, because some questions are harder than others. A forecaster with no knowledge at all scores about 0.200 on Formula 1 Top 6 and about 0.044 on Formula 1 Race Winner — a lower Brier on the second says nothing about the model being better. The skill score removes that: it measures how much better the model does than knowing only how often this kind of call comes in. Zero means it adds nothing, one is perfect, and a negative number means it is worse than guessing.

Some markets are worked out from the same forecast as others. In football, double chance, draw no bet, other goal lines, team goals and correct score come from the same scoreline forecast as the match result and over/under 2.5. In Formula 1, the top 10 and the team-mate battles come from the same simulated races as the winner, podium and top 6. They are scored and listed below, but left out of the overall figures, the sport summary, the monthly trend and the model version comparison: counting several restatements of one forecast per event would let them drown out the forecasts that carry the information. A draw no bet forecast is not scored when the match is drawn.

Calibration

When the model says 70%, does it happen 70% of the time? The closer to the diagonal, the better calibrated.

By market

Raw Brier sits next to the baseline it is measured against; compare Brier only within a row, and skill across rows. The highlighted row is where the model adds the most over guessing.

Sport Market Field Forecasts Brier Baseline Skill
Formula 1 Fastest Lap 22 7 0.0496 0.0442 —
Formula 1 Podium 22 14 0.0901 0.1194 0.245
Formula 1 Qualifying Winner 22 2 0.0404 0.0443 —
Formula 1 Race Winner 22 14 0.0416 0.0441 0.056
Formula 1 Team-mate Head-to-Head 20 2 0.1924 — —
Formula 1 Top 10 21 2 0.0916 — —
Formula 1 Top 6 best 22 14 0.1097 0.2004 0.453

Model versions

Each model change is tracked separately so improvements can be verified.

Version Sport Forecasts Brier Skill Log loss Status
f1-pl-v2 Formula 1 8 0.0524 — 0.1752 active
f1-plackett-luce-v1 Formula 1 46 0.0766 0.300 0.2537 retired
Note: This is statistical information for educational and entertainment purposes. It does not constitute betting advice. Past model accuracy does not guarantee future performance. Proknoz has no affiliation with any betting operator.