Ken Ring can’t predict the weather

By David Winter 19/11/2010

It’s that time of year for academics in New Zealand. As soon as undergrad teaching finishes every department, organisation and society on campus decides to schedule some sort of meeting,conference or symposium – since everyone will have so much spare time. Between the three talks I’m going to end up giving this month, and the tonne of work I have to get done between them, I don’t have much time to write here. So, partly inspired by people talking abut their months-old posts in Grant’s piece on the length of time it can take to put a blog post together, I’ve decided to dive in The Atavism’s “draft” folder and resurrect a few half-written posts. This one took about two months to write, and though I never quite got the copy right I do rather like the graph.

Ken Ring was on National Radio a couple of months ago, blathering on about his method of weather prediction. Ring thinks he can provide a forecast for any future date by looking at weather map that’s about 18 years out of date That’s how long it takes for the earth, the moon and the sun to cycle into the same relative positions in their orbits, and Ring thinks it’s the moon that drives weather down here on earth. The 18 year old weather map will tell him what the atmosphere was doing last time everything lined up this way, and that will be enough to predict the next event. You probably agree that Ring’s methods sound like lunacy, but Ring continually claimed in his time on air that his method had an 85 % accuracy rate. Reading Ring’s website, you can see he is pretty generous when he estimates his own accuracy, like the Texas sharpshooter who shoots the side of a barn then paints a target around the bullet hole to show his prowess with a shooting iron, Ring uses any vaguely similar weather event to prop up the accuracy of his predictions. My particular favourite from that page is his prediction for 100 mm or rain in New South Wales, which was accurate, it’s just that it arrived further West, two days later and was a only 20mm.

So, we shouldn’t take Ring’s self confidence too seriously and his method, which involves tricky maths and obscure terminology, is a prefect example of cargo cult science. But we don’t have to stop there, Ring makes specific predictions that we can test. Just as the worst thing you can say about homeopathy is not that it’s impossible for those dilutions to effect the human body, but that homeopathy has been shown to do nothing; the worst thing you could say about Ring’s weather forecasting methods is that they don’t work. I went digging for some of Ring’s old claims and was thrilled to see that my Sciblogs stablemate Gareth Renowden has already done all the hard work for me! Apparently Gareth was been dealing with crazy people and weather even before he launched Hot Topic, and back in 2006 he got his hands on on Ring’s predictions for rainfall and sunshine hours in each of the major centres. Gareth compared those predictions to the actual values and to the long term average kept by NIWA.

There’s a bunch of stuff that can be done with that data (which Gareth kindly made available for anyone to download), but the most important thing (and this holds for almost any statistical analysis) is to take a look at it. Here’s what I came up with for the rainfall data using the rather wonderful ggplot2 and inkscape :

You can click on the graphic above to get a bigger version. In these graphs the long term average for each observation is the black line, Ring’s predictions if the blue circle and the actual rainfall for that month in that city is the green circle.

Now, let’s test the accuracy of Ring’s predictions, but against what? Statistical tests often compare a set of results to what you might expect to get “by chance” but that’s not very helpful in this case. For one, it’s not clear what the range of possible values should be, and second, comparing the forecasts to numbers picked at random ignores the seasonal effects everyone knows contribute to weather. You don’t have to know the position of the moon 18 years ago to know that Auckland is more rainy in July than January. Instead, let’s compare Ring’s forecasts to the easiest forecast you could ever make – just saying rainfall for a given region in a given month would match the long-term average. If there was anything to Ring’s methods he should be able to do better than that. He didn’t, on average Ring’s prediction was 52.5 mm out from the actual rainfall where as “predicting” the average would have been 37.25 mm out.The long-term average was a better predictor, averaging 15.15 mm closer to the actual rainfall with a confidence interval spanning from -0.4 and 31 mm. We can’t (quite) say from that data that Ring’s forecasts have less predictive power than the long term average, but there is absolutely no evidence they’re any better.

Let’s lower the bar a little and forget about how close to the true value Ring’s predictions came. Was he at least able to get on the right side of the average? If he predicted a drier August than average was the real value likely to indeed be direr? In this case, if you just tossed a coin 48 times, calling heads drier and tails wetter, you’d expect to be right about half the time. And would have done better than Ring. His prediction was only on the right side of the average 17 times in 48 attempts, about 35% accuracy and significantly worse that you would expect to get from tossing a coin (if you’re one of those p-value fetishists p, in this case, is equal to about 0.03) .

So Ken Ring can’t predict the weather. That probably doesn’t surprise anyone reading my blog or at sciblogs.I wish it surprised me that the uselessness of Ring’s forecasts is no barrier to him being taken seriously, selling books and appearing on radio and in newspapers. The host of the show that started by little investigation evidently took some flack for having Ring on (it was a National Radio after all) and his defense amounted to “well, we just let these people talk and you can decide what you think about it”. That seems impossibly weak to me, surely the least we should do is ask people who make outrageous claims to show what evidence they have to support those claims. I’m pretty satisfied there is nothing in astrological weather forecasting, but if advocates of the method really want to put it to the test it would be easy. Get someone to provide a year’s worth of old weather maps but let only half of them be of the right vintage for their method (about 18 years in Ring’s case) and see if the forecasts from the supposedly predictive weather maps are better than the ones from weather maps chosen at random. How likely do you think it is that test will be run?

0 Responses to “Ken Ring can’t predict the weather”

  • Thanks for writing this up. I love your charts. Nice work!

    I have wanted to compare Ken Ring data to actual readings for a while but I didn’t want to collate it myself. A big thank you is due to Gareth for putting this data resource together.

  • Hadley Wickham is a legend. Those R libraries are the bee’s knees.

  • They don’t pull any punches, do they?

    Hey, are you going to be at the First-Year Biology Educators’ Colloquium that Phil Bishop’s organised? It’d be great to catch up with you, if you are 🙂

  • Hi Alison,

    That’s one meeting I won’t be going to, but I’ll be in town if you have some spare time and you want to catch up

  • I think Erick Brenstrum at Metservice did a comparison using one year of weather maps. Was generous about what qualified as “correct” by giving Ring a day either side of an event, and I think the outcome was still about 30% success. He also identified the minimum accuracy to be considered to be a useful forecast tool, and Rings results were well short. All this from memory, so may need researching to confirm numbers.

  • thankyou! I saw Ken at TEDxAuckland, I have not heard of the man before, I wasn’t sure to laugh or cry at his talk/performance, he was more of an entertainer than anyone serious, except he seemed to wants to be taken seriously of his weather predication… very odd.

  • Thanks Jofe and Lillian,

    It’s no to see other people have but Ken Ring to the test, though I guess the sad conclusion to draw is that being proved wrong hasn’t been a big barrier to sales.

    Lillian, you should really be thanking Gareth who did all the hard work!

    I had heard that Ring was at the local TED, which is just horrifying. The tagline of the original meeting is “Ideas worth spreading” which hardly fits with his nonsense. (I think they had faith healers last year, so the whole thing seems a little off)

  • Good grief! Who on earth decided who the speakers are at these things?

  • Actually, to be fair about TEDx they didn’t quite have faith healers last year, it was Robin Kelly who appears to be one of those guys who did something like this

    1. Eastern philosophy is weird
    2. Quantum mechanics is weird
    3. Quantuam mechnics explains Eastern philosophy!

  • I know of a very experienced observer who rated Ring’s accuracy for some regions to be as low as 25%. A couple of years ago Ring challenged a NIWA statement about the Waikato drought – that Hamilton (Ruakura) had had its lowest January rainfall for 100 years. When I cross-examined him on the point, he asserted that it couldn’t be true because some of the intervening years were followed by wetter ones! He kept digging in resposne to my further questions, effectively asserting that there had to be a monotonically decreasing sequence of January rainfalls for the claim to be right! That someone can talk such utter nonsense and yet claim to be able to say anything credible on weather, mathematics or science in general is amazing – and yet there is a coterie of followers, including plenty of farmers as I understand things.

    I haven’t found Ring’s forecast for NZ conditions in November and for the summer, but they should be looking pretty sick already. I monitored February-April and September’s versions, and they were of course miles off the mark.

  • Ken Ring has predicted That North Canterbury, Christchurch New Zealand will be hit again by an earthquake due to the pull of the Moom, which apparently will be at its lowest this month? Around 20th of march – is something bad going to happen to us? I live in Christchurch and would like to know can these things be really predictec??

  • Sue,

    According to most geologists the moon can have a very small influence on earthquakes, but the major cause of earthquakes is the pressures occurring under the earth and the pressure arising between tectonic plates.
    The is a good article here
    Also if you look closely at Ken Rings predictions they are so vague he is typically “predicting” that there will be some “ground movement” in Christchurch which as you will know is currently occurring every few hours in Christchurch.
    I wouldn’t be too worried about any specific prediction for Christchurch. The best any of us can do is be prepared with water, food and other essentials if we are unlucky enough to experience another significant quake.
    Also if Ken Ring can predict earthquakes where was his specific warning to Christchurch BEFORE the Feb 22 quake, and where is his prediction of the Japan quake?