OpenLifts

Accuracy

Forecasts served on the site

The models behind the lift and piste ranges on the site now, from the current forecast publication, and how often each model's range held when it was back-tested. Aggregate figures over all resorts: no per-resort or per-season figures.

Forecasts served on the siteYes

Publication 1203 · as of 24 October 2026

Lifts open, per week

Model
—
ValidatedNo
How often the forecast range held
Overall110,143 of 124,761
back-tested forecasts · 88%

Each range is the central 80% of the modelled distribution.

Model
—
ValidatedNo
How often the forecast range held
Overall72,994 of 85,596
back-tested forecasts · 85%

Each range is the central 80% of the modelled distribution.

By month
MonthRange held
November4,948 of 5,701 · 87%
December25,132 of 30,324 · 83%
January39,649 of 46,689 · 85%
February33,633 of 39,809 · 84%
March28,530 of 33,055 · 86%
April7,227 of 8,547 · 85%
Range hit rate on held-out resorts and a held-out season
Overall15,733 of 16,205
published ranges that contained the actual count · 97% · target: at least 75%

Same week last year, as a range of the same width: 15,420 of 16,128 · 96%

Target met: at least 75%, and more often than the same week last year.

A range spans 42% of the total on average. A wider range holds more often, so this does not make the forecast validated.

Held-out: 92 resorts never used to build or tune the model, scored on the 2025/26 season it had not seen.

Historical baseline
baseline-hist-elev-region-wkm1-v1
ValidatedNo
How often the forecast range held
Overall148 of 213
back-tested forecasts · 69%

Each range is the central 80% of the modelled distribution.

Historical baseline
baseline-hist-elev-region-v1
ValidatedNo
How often the forecast range held
Overall32,650 of 37,792
back-tested forecasts · 86%

Each range is the central 80% of the modelled distribution.

Range hit rate on held-out resorts and a held-out season
Overall14,145 of 14,796
published ranges that contained the actual count · 96% · target: at least 75%

Same week last year, as a range of the same width: 13,588 of 14,132 · 96%

Target not met.

A range spans 56% of the total on average. A wider range holds more often, so this does not make the forecast validated.

Held-out: each resort scored without its own history, on the 2025/26 season.

Pistes open, per week

Model
—
ValidatedNo
How often the forecast range held
Overall74,431 of 85,596
back-tested forecasts · 87%

Each range is the central 80% of the modelled distribution.

By month
MonthRange held
November5,044 of 5,701 · 88%
December25,333 of 30,324 · 84%
January39,477 of 46,689 · 85%
February33,914 of 39,809 · 85%
March28,762 of 33,055 · 87%
April7,392 of 8,547 · 86%
Range hit rate on held-out resorts and a held-out season
Overall14,473 of 15,715
published ranges that contained the actual count · 92% · target: at least 75%

Same week last year, as a range of the same width: 14,155 of 15,645 · 90%

Target met: at least 75%, and more often than the same week last year.

A range spans 46% of the total on average. A wider range holds more often, so this does not make the forecast validated.

Held-out: 89 resorts never used to build or tune the model, scored on the 2025/26 season it had not seen.

Historical baseline
baseline-hist-elev-region-piste-wkm1-v1
ValidatedNo
How often the forecast range held
Overall156 of 213
back-tested forecasts · 73%

Each range is the central 80% of the modelled distribution.

Historical baseline
baseline-hist-elev-region-piste-v1
ValidatedNo
How often the forecast range held
Overall30,793 of 37,792
back-tested forecasts · 81%

Each range is the central 80% of the modelled distribution.

Range hit rate on held-out resorts and a held-out season
Overall12,394 of 13,946
published ranges that contained the actual count · 89% · target: at least 75%

Same week last year, as a range of the same width: 12,130 of 13,446 · 90%

Target not met.

A range spans 58% of the total on average. A wider range holds more often, so this does not make the forecast validated.

Held-out: each resort scored without its own history, on the 2025/26 season.

Forecasts are estimates, not guarantees — on the day, always check the resort’s own board before you ski.

Current models

Every forecast model in the Open Lifts model registry and whether any forecast is being served on the site. Taken from the registry and the live serving state, not written by hand.

Lifts open, daily (reconstruction)
EXPERIMENTAL, not served1 registered: 0 validated, 1 experimental
Latest gate result (PRD-2.9.1)Overall: FAIL
Registered18 September 2026
Lifts open, per week
EXPERIMENTAL, served11 registered: 0 validated, 11 experimental
Gate v3 verdictOverall: FAIL
Servable bucketsnone
Registered15 October 2026

Per evaluation cell: rolling2024_seen/near FAIL · rolling2024_seen/long FAIL · rolling2024_fresh_resorts/near FAIL · rolling2024_fresh_resorts/long FAIL · fresh_resorts_2025/near PASS · fresh_resorts_2025/long FAIL · viewed2025_seen/near PASS

Pistes open, per week
EXPERIMENTAL, served8 registered: 0 validated, 8 experimental
Gate v3 verdictOverall: FAIL
Servable bucketsnone
Registered15 October 2026

Per evaluation cell: rolling2024_seen/near FAIL · rolling2024_seen/long FAIL · rolling2024_fresh_resorts/near FAIL · rolling2024_fresh_resorts/long FAIL · fresh_resorts_2025/near PASS · fresh_resorts_2025/long FAIL · viewed2025_seen/near PASS

Snow depth, per week
EXPERIMENTAL, not served4 registered: 0 validated, 4 experimental
Latest gate result (snow-gate-v1)Overall: FAIL
Registered14 October 2026

Lifts open, daily (reconstruction)

The real, current evaluation of the Open Lifts open-lift-count model — every split, the baseline it's measured against, and exactly how much evidence it's based on. This page is generated directly from the same evaluation artifacts the model itself was registered with — nothing here is written by hand.

Current status
PRD validation gate: NOT PASSED

Model reconstruction-hgb-v1-20260918 is currently labelled EXPERIMENTAL. The PRD requires ≥75% range hit rate, beating a plain baseline, on every held-out split below before a model may be called validated. This one has not cleared that bar yet — every prediction it produces is experimental, not a booking-grade promise.

model held-out-date coverage 0.743 does not beat the resort-historical-mean baseline's 0.788 — PRD §2.9.1 requires both; held-out-date coverage 0.7428571428571429 < 0.75; held-out-resort evidence insufficient: only 3 eligible resorts (need >=10 per Phase 3E Sec 14's own criterion for a trustworthy estimate); held-out-season evidence insufficient: only 79 training rows (Phase 3E Sec 14 flags 300+ as the scale needed to trust this split); held-out-season coverage 0.5263157894736842 < 0.75

The three required splits

A range "hit" means the actual observed open-lift count fell inside the predicted range. Each split answers a different question about whether the model actually generalises, not just whether it fits data it has already seen.

Held-out date74%A date the model never trained on, same resorts. Below target (target ≥75%) · n = 35 test days.
Held-out resort48%A resort the model never trained on at all. Below target (target ≥75%) · n = 3 resorts evaluated.
Held-out season53%A season the model never trained on at all. Below target (target ≥75%) · n = 38 test days.

The baseline comparison

A baseline is the simplest reasonable guess with no model at all — here, a resort's own historical average for that time of year. A real model has to beat it, not just clear 75%, or it isn't adding anything.

Resort historical-average baseline79%Evaluated on 33 of 35 held-out test days.
This model, same held-out-date split74%

This model currently does not beat the baseline on this split — the honest reading is that a simple historical average is at least as good a guess right now.

Why the gate isn't just a percentage

A coverage number on too little evidence isn't trustworthy on its own. Here's exactly how much real evidence this evaluation is based on:

Usable resort-days175
Distinct resorts68
Held-out-resort sample3 resort(s)needs ≥10 to trust · insufficient evidence
Held-out-season training rows79insufficient evidence

Live forecast verification

Separately from the training-time backtest above, every real forecast this model makes is checked against what actually happened once the date passes — the ongoing, real accuracy record.

No live forecast-verification records yet. No forecast from this model has resolved against real observed data yet.

Model reconstruction-hgb-v1-20260918, trained on data up to 16 June 2026, evaluated 18 September 2026. See how it works for what observed/reconstructed/forecast mean, or /data for source attribution.