How accurate is our crowd calendar?

Every crowd forecast we publish is written down before the day arrives, then marked against what actually happened. This page is that scorecard, misses included. We have not found anyone else in Walt Disney World planning who publishes theirs.

81%
of 401 marked days landed within one crowd level of what we predicted. Usually right, worth a sanity check on big decisions.

Accuracy by how far ahead we called it

A forecast made three days out should beat one made three months out. If it does not, the model is not really using recent signal, which is the most useful thing this table can tell us.

CalledDays markedExactly rightWithin one levelAverage miss
60 days ahead2631%81%9.5 pts
30 days ahead5629%82%12.6 pts
14 days ahead7233%81%11.9 pts
7 days ahead7930%80%12.9 pts
3 days ahead8331%81%12.7 pts
1 days ahead8531%81%12.5 pts

The five we got most wrong

Publishing these is the point. A scorecard that only showed the wins would not be a scorecard.

DateCalledWe saidIt wasOut by
14 Oct 20261 days aheadBusier than typicalMuch busier54.5 pts
14 Oct 20263 days aheadBusier than typicalMuch busier54.5 pts
14 Oct 20267 days aheadBusier than typicalMuch busier54.5 pts
14 Oct 202614 days aheadBusier than typicalMuch busier54.5 pts
14 Oct 202630 days aheadBusier than typicalMuch busier54.5 pts

How the marking works

  • The call is stored before the day. At 90, 60, 30, 14, 7, 3 and 1 days out we write down what the calendar was showing. Those rows are never edited afterwards, so a later re-run cannot improve our own marks.
  • Both sides are the same measure. We compare the predicted deviation from a typical day against the measured one, so there is no conversion and no second model to disagree with.
  • A day we never measured is skipped, not scored. A missing reading is our failure to observe. Counting it as a miss would be as dishonest as counting it as a hit.
  • "Within one level" means one step on the five-point scale from quieter than typical through to much busier.

The forecasts come from our own log of park wait times, described on the crowd calendar.

Related guides

More guides