Beyond the clouds

Why the Weather App Is Always Confidently Wrong

The weather app never says "we have no idea." It says 30% chance of rain with a little sun icon and a temperature that turns out to be completely fictional. A serious investigation into the confidence problem

Why the Weather App Is Always Confidently Wrong

This image was created with the assistance of DALL·E

The App Has Never Once Said "We Don't Know"

Open any weather app right now. Look at it. It will tell you the temperature to the degree. It will tell you the precipitation probability to the percentage point. It will tell you the UV index, the wind speed, the humidity, the feels-like temperature, the sunrise time, the sunset time, and in some apps, the air quality index broken down by specific pollutant. It will tell you all of this for today, tomorrow, and the next ten days, with the same calm, authoritative confidence across all of them.

It will not, under any circumstances, tell you that it is not entirely sure.

This is the central problem with weather apps, and it is not a data problem or a technology problem. It is a communication problem. The app knows, somewhere in the mathematics behind its interface, that forecasting becomes significantly less reliable after about three days and genuinely speculative after five. It knows that a 40% chance of rain means that 40% of the modelled scenarios produced rain, which is a very different thing from "it will probably rain." It knows all of this. It has simply decided not to share it, because an app that communicated its own uncertainty would feel unreliable, and an app that feels unreliable gets deleted.

So instead it gives you a sun with a little cloud behind it and the number 22, stated with the confidence of someone who was actually there and checked.

What a Percentage Actually Means and Why It Doesn't Mean What You Think

The percentage chance of rain on a weather app is one of the most widely misunderstood numbers in everyday life, and this is not the fault of the people misunderstanding it. It is the fault of the number being presented without any of the context that would make it interpretable.

When an app says 30% chance of rain, most people hear: probably won't rain, light chance, leave the umbrella at home. What it actually means is that in 30% of the forecast models run with current atmospheric data, precipitation occurred. This tells you something about probability but nothing about intensity, duration, location within the forecast area, or whether the rain will last four minutes or four hours.

A 30% chance of rain that produces a twenty-minute downpour at 2pm is meteorologically identical to a 30% chance of rain that produces nothing. Both are correct forecasts. The rain either happened in your specific location or it didn't, and the percentage was never promising you either outcome. It was describing a distribution of possibilities across a model, which you were then free to interpret however you liked, and you interpreted it as "probably fine."

The app is not wrong about the percentage. The app is wrong about whether the percentage is useful information, and it has decided, commercially, that showing you the percentage is better than showing you nothing, even if the percentage produces false confidence in both directions.

The Ten Day Forecast, Which Is a Work of Fiction

Atmospheric forecasting is genuinely impressive science. The models that underpin weather prediction use satellite data, ground stations, ocean buoys, weather balloons, and supercomputers running millions of calculations to produce forecasts that are, for the first two days, remarkably accurate. A 24-hour forecast from a good meteorological service is correct in its broad outlines the overwhelming majority of the time. A 48-hour forecast is still pretty good. A 72-hour forecast is useful with caveats.

After that, the mathematics of atmospheric chaos begin to compound. Small errors in initial conditions, which are always present because measuring the entire atmosphere perfectly is not possible, multiply over time. By day five, the forecast is a reasonable guess. By day seven, it is a gesture in the direction of a guess. By day ten, it is essentially the average weather for that time of year dressed up in specific numbers.

The app shows you all ten days with the same typeface, the same icon size, the same confident temperature. Tuesday next week: 18 degrees, partly cloudy. This is stated with exactly the same visual authority as tomorrow, which the app has a genuine basis for knowing. There is no asterisk. There is no fading gradient that gets increasingly transparent to indicate decreasing confidence. There is just ten days laid out like a done deal, and you make plans accordingly, and then Wednesday arrives with sideways rain and a temperature twelve degrees lower than advertised.

The ten day forecast is not a forecast. It is a mood board for a week that hasn't happened yet and probably won't look like that.

Why It Gets the Feels-Like Temperature Wrong in the Most Personal Way

The feels-like temperature is the app's most ambitious feature and its most consistent failure. It takes the actual temperature and adjusts it for wind chill or humidity to produce a number representing what the temperature will feel like to a human body. It is, in theory, more useful than the raw temperature. In practice it is more wrong in a more confusing way.

Feels-like is calculated using a standardised human body, which walks at a standard speed in standard clothing with standard wind exposure. You are not a standardised human body. You are a specific person, wearing what you decided to wear this morning, walking the route you walk, standing at your bus stop which has its own particular wind situation, with your own specific relationship to cold that is different from everyone else's and from whatever the meteorologists used when they built the model.

The app says feels like 14. You step outside and it feels like 8. You are not wrong. The app is not technically wrong either. You are both describing a real temperature experienced by different entities, one of which is a mathematical abstraction and one of which is you, annoyed, underdressed, walking faster than the model assumed.

The Update Problem, Which Makes Everything Worse

Weather apps update their forecasts constantly, sometimes every hour, as new data comes in and the models are rerun. This is good practice from a meteorological standpoint. It is a psychological disaster from a user standpoint.

You check the app at 7am. It says dry all day, high of 20. You plan accordingly. Light jacket. No umbrella. Outdoor lunch seems reasonable. You check again at 10am because something feels off about the sky. It now says 60% chance of rain from 1pm, high of 16. You check at 12pm. It says rain from 2pm. You go out for lunch. It rains at 1pm.

The app was updating toward the truth the whole time, getting more accurate as the event got closer, doing exactly what it was supposed to do. But you made your decision at 7am, when the forecast was at its least accurate, because that is when you needed to decide what to wear. The app's accuracy peaks at exactly the moment it is too late to change your plans, and it is at its least accurate at exactly the moment you need it most.

This is not the app's fault. It is a fundamental feature of how forecasting works. The app could communicate this. It chooses not to, because "check back closer to the time" is not a satisfying answer at 7am when you are trying to decide about the jacket.

What the App Is Actually Good At

It is good at telling you it is currently raining, which you can also verify by looking out the window. It is good at the next six hours, which it handles with reasonable reliability most of the time. It is good at telling you sunrise and sunset, which are not forecasts at all but astronomical calculations and are always correct. It is good at giving you something to look at when you are anxious about an outdoor event and need to feel like you are doing something about it, even if what you are doing is refreshing a screen and rearranging your uncertainty into smaller, more specific uncertainties.

It is not good at the rest of it, or rather it is good at the rest of it in ways that its presentation does not reflect. The forecasting science is real and improving. The confidence of the interface outruns the confidence of the science, and has done since the first app put a cartoon sun on a screen and said: tomorrow, definitely this.

What Would Actually Help

A weather app that showed its uncertainty would look different from what we have now. Temperatures given as ranges rather than single numbers. Icons that varied in size or opacity to indicate forecast confidence. A ten day view that became visibly less defined toward the end, blurring into something honest about what can and cannot be known a week in advance. Precipitation percentages accompanied by a plain language explanation of what that percentage actually describes.

Nobody has built this app, or if they have, nobody has downloaded it, because an app that tells you it isn't sure feels worse than an app that tells you 22 degrees and a little cloud, even if the uncertain one is telling you something true and the confident one is telling you something it cannot possibly know.

We want the certainty. We want the little sun. We want the number, specific and clean and stated without hesitation.

The atmosphere does not care what we want, and it has been proving this, reliably and without apology, every single day.

Beyond the clouds
How to Have a Better Social Life Than a Raindrop in a Thundercloud
How to Have a Better Social Life Than a Raindrop in a Thundercloud
How to Recognize When You're Being the Emotional Fog
How to Recognize When You're Being the Emotional Fog
How Air Masses Control Weather Patterns
How Air Masses Control Weather Patterns
Everyone Has a Friend Who’s Basically Seasonal Cloud Cover
Everyone Has a Friend Who’s Basically Seasonal Cloud Cover
How Cold Air Travels Through Jeans Like a Betrayal
How Cold Air Travels Through Jeans Like a Betrayal
What Happens When the Forecast Says Rain but It Stays Dry All Day
What Happens When the Forecast Says Rain but It Stays Dry All Day
Why Lightning Waits for Deep Thoughts and Wi-Fi Drops
Why Lightning Waits for Deep Thoughts and Wi-Fi Drops
How Humidity Knows Exactly When You Did Your Hair
How Humidity Knows Exactly When You Did Your Hair
How to Predict a Storm by Watching Animals
How to Predict a Storm by Watching Animals
Why Goodbyes Hit Harder When the Wind Picks Up
Why Goodbyes Hit Harder When the Wind Picks Up
Why Africa Has Both Blazing Hot Deserts and Snowy Mountains
Why Africa Has Both Blazing Hot Deserts and Snowy Mountains
Why It’s Impossible to Predict How Much Water You’ll Need While Sightseeing
Why It’s Impossible to Predict How Much Water You’ll Need While Sightseeing
See all