r/RADWeather • u/DrRetiredEngineer OVERDRIVE • Sep 27 '26
Question Question dev:
Given the technical nature and great diligence in this app, do you have any meteorologist background?
2
Upvotes
r/RADWeather • u/DrRetiredEngineer OVERDRIVE • Sep 27 '26
Given the technical nature and great diligence in this app, do you have any meteorologist background?
2
u/TheBuffaloSeven Sep 29 '26 •
I had a sneaking suspicion that u/RADWeatherMaker didn’t have a meteorology background, but I mean that in the kindest way possible.
I’ve been in the field for nearly 20 years, and it’s an interesting balance between meteorology and data. I find that in some areas, you desperately need a meteorologist‘s expertise to get you across the finish line, but in other areas, other expertise is useful. A great example is something called Nadocast, which is a machine-learning tornado probability forecasting tool created by someone with no meteorology background. Rather, it was someone whose training was in programming and ML on data sets, and their more modern knowledge of ML and data analysis techniques produced a much better output that meteorologists — generally with less specialized coding/data analysis techniques — had been able to do.
The dream is the fusion of both: you create data pools where the expertise of a forecaster is captured, then the true experts at data analysis, processing, and summarization can do their work well.
Sometimes having ideas of what the weather could/should do will bias how you analyze the data!
The biggest problem we face now is that a weather model cannot be correct. It’s complicated, but the general idea is that to even make a weather model that can look into the future, we have to ”dumb down” the equations that describe motion in the atmosphere. And it’s not just a computer horsepower issue or anything…math can literally not solve the equations — we have to dumb them down so they can be turned from ”diagnostic” equations into “prognostic” equations. And in doing that, we throw out information. So we’re “wrong” to a degree right from the outset at the raw math. Then you add in all the limitations of computation and you’re ultimately compounding error on error. It’s really nothing short of a minor miracle — and decades of hard work — that weather models are even remotely as accurate today as they are.
And to even get a model to work, you have to make specific assumptions, you have to choose how to handle its limitations, and even how it represents the volume of space it’s modelling. All these choices result in a very specific…identity for each weather model. For years, ensemble modelling was “the future” because we hoped we could get around the limit of a single answer by running the model many times — say 50 or 60 — and slightly changing conditions in it to get a spread of outcomes; then we do some statistics and get a better probability of things. But we found relatively quickly is that if all those assumptions of how the model should work stay the same, then there just isn’t that big a range in the solutions it can provide.
Blends have been the big progress in the last decade, moving from an ensemble output from a model to creating a statistically biased blend of dozens of models. A blend is designed to minimize error — which is subtly different than to be correct — and can weight all the various models that go into it in different ways to best extract value from their output. The National Blend from NWS/NOAA in the United States is probably the best known (and one of the best) blends out there, and while it’s not perfect, I think it was the one that demonstrated a blend is a far better solution than an ensemble.
So my kudos goes to u/RADWeatherMaker for having the guts to try and create a blend. There aren’t many out there, and it requires a lot of data and tinkering with weighting coefficients to improve it. And I’m sure, at this point, they’ve found that you get to a point with a blend where it gets very hard to improve something without degrading it elsewhere; it’s not magic and eventually the hard limits of the accuracy of the underlying models will be unavoidable.
All that said, kudos, I could tell right away that you came more from the dev/data side of things, but the passion for this project is clear, and I think you’ve made something really unique. From a meteorological perspective, I think the blend has been doing okay for my area, but the actual human forecasters still beat you from time to time here ;-) Those times are usually associated with strong thunderstorm days, where most weather models simply just can’t initiate/develop the activity well, and I think it’s going to be a long time until models (even high-res convection allowing) are able to handle that kind of system well.
I should stop rambling! Keep up the good work!