Showing posts with label weather predictions. Show all posts
Showing posts with label weather predictions. Show all posts

Thursday

Improving hurricane intensity predictions

A bit of hurricane folklore has it that hurricanes have a dry side and a wet side - that is, whether you'll get more wind than rain when a hurricane passes through depends on which side of the center you're on. A new report from the NASA Jet Propulsion Lab points out that not only is this folklore true, it may to improve the ability to predict the intensity of hurricanes.
The researchers found the hurricanes that rapidly intensified tended to exist within a moister large-scale environment than weaker storms. The rapidly intensifying hurricanes had statistically significant higher relative-humidity levels in their environments than storms whose intensity was weakening or unchanged.
 . . .
The team found substantial differences in relative-humidity levels between storm quadrants. One factor may be the shape of the Atlantic basin. Hurricanes in the Atlantic usually travel to the west or northwest -- regions that are drier, climatologically-speaking, than from where the storms originated. This causes the front two quadrants of Atlantic hurricanes to be drier than their rear two quadrants.

A unique result the team found is that in their front-right quadrants, rapidly intensifying hurricanes tended to have sharply higher amounts of upper tropospheric moisture near their centers than they did farther from their centers. 

A previous post linking to some good explanations of why predicting hurricane intensity is so complex is here. NASA is "exploring collaborations" that will allow forecasters to incorporate relative humidity data into hurricane prediction system, so we may be able to see test data in the next few years.

Tuesday

The Signal and the Noise, by Nate Silver

I've been a fan of Nate Silver's work since the 2008 election when I, like perhaps many of you, obsessively checked his blog. I've always thought that his writing is clear and that he is transparent - to a point - about his methodology. So I was eager to read his very interesting book, "The Signal and the Noise."

What Silver sets out to do in this book is explore our ability to make predictions based on big data. Silver's main thesis is that we should be using Bayesian statistics to make and judge our predictions about the world. As Silver puts it,
The argument mad by Bayes and Price is not that the world is intrinsically probabilistic or uncertain . . . It is, rather, a statement . . . about how we learn about the universe: that we learn about it through approximation, getting closer and closer to the truth as we gather more evidence. [Italics in original.]
As Silver acknowledges, this approach is not the one we are taught in school (or in classes in the history and philosophy of science. For a review of that approach, read the first third or so of Jim Manzi's book "Uncontrolled." My review of "Uncontrolled" is here.) Instead, Silver argues, we use statistics that focus on our ability to measure events. We ask, given cause X, how likely is effect Y to occur? This approach raises lots of issues, such as separating cause from effect - we get mixed up a lot about the difference between correlation and causality. We mistake the approximation for reality. We forget we have prior beliefs, so allow our conclusions to be biased.

In contrast, Silver explains, the Bayesian approach is to regard events in a probabilistic way. We are limited in our ability to measure the universe, and Pierre-Simon Laplace, the mathematician who developed Bayes' theorem into a mathematical expression, found an equation to express this uncertainty. We state what we know, then make a prediction based on it. After we collect information about whether or not our prediction is correct, we revise the hypothesis. Probability, prediction,  scientific progress - Silver describes them as intimately connected. And then he makes a broader claim:
Science may have stumbled later when a different statistical paradigm, which de-emphasized the role of prediction and tried to recast uncertainty as resulting from the errors of our measurements rather than the imperfections in our judgments, came to dominate in the twentieth century.
Silver describes the use of Bayesian statistics (to greater or lesser rigor) in many contexts, including sports betting, politics, the stock market, earthquakes, the weather, chess, and terrorism. We are better at predictions in some of these contexts than we are in others, and he uses the chapters to illustrate various corollaries to his main theme. In his first chapter, on the 2008 financial meltdown, he identifies characteristics of failed predictions: the predictor focused on stories that describe the world we want, we ignore risks that are hard to measure, and our estimates are often cruder than we think they are. On the other hand, in a chapter about sports data, he makes a compelling case for the premise that a competent forecaster gets better with more information. Throughout, he urges us to remember that data are not abstractions but need to be understood in context.

This is not a how-to book, and it certainly left me with many questions. How do you test social programs using Bayesian analysis? But it is a very good starting point.

Image via amazon.com

Friday

Tracking Sandy


If you're interested, that's a screen shot of the predicted path as of this morning of Hurricane Sandy. For various reasons meteorologists are getting better and better at predicting the paths of storms, though not the intensity at any one time. The possibility that Sandy may come into contact with a more typical North American weather system means that a big hybrid system may develop.
And, as Adam Sobel explains on Climate Central, that would result in an unpredictable storm.
As Sandy moves northward, it will move over cooler water. If this were all that were happening, Sandy would weaken, as tropical cyclones moving toward a pole typically do. At the same time, though, Sandy will come close enough to the upper trough now over the U.S. to interact with that trough in something like the way that an extratropical surface low normally would  . . .
When this happens, they will form a hybrid storm system with some tropical and some extratropical properties. Some energy will still come from the ocean surface, but some will now come from the pole-to-equator temperature contrast. This new energy source will enable Sandy to maintain its intensity, or maybe even increase it.
This process is called “extratropical transition.” It poses a lot of problems for forecasters. In the first place, the computer models aren’t that great at predicting exactly when it will happen. 
So keep an eye on the storm. You can do it easily through ESRI's social storm tracker:

Monday

I'm coming late to this, I realize, but if you haven't already read it, take a look at Nate Silver's article about weather prediction in the NY Times Magazine of September 9. It's a good explanation of the uncertainty that goes into making predictions based on statistical models, and the assumptions and corrections that are required.

Silver demonstrates how dramatically weather predictions have improved over the last few decades. For an example, you can see my post from last year about the predicted path of Hurricane Irene here, and a follow up post here.

The article is an excerpt from Silver's forthcoming book "The Signal and the Noise: Why So Many Predictions Fail - but Some Don't."


Popular Posts