Why Astrology Fails Controlled Prediction Tests

Pune, two thousand and eight. Two hundred birth charts on a table. Half belong to gifted schoolchildren. Half belong to children with severe intellectual disability. Fifty-one astrologers have been invited to tell them apart.

Date, time, place. That's all they get?

That's all they need, by their own claim. Vedic astrology says the sky at the moment of your birth encodes your intellect, your temperament, your fate. So the astrophysicist Jayant Narlikar and his colleagues said... fine. Show us.

And this is where you tell me they nailed it and my whole worldview collapses.

Hold that thought, I'm coming back to Pune. First I want to do to you what astrology does to all of us. Ready? You have a great deal of unused capacity you haven't turned to your advantage. You can be outgoing and sociable... but at times you're guarded and reserved.

...Okay, that's uncomfortably accurate.

It's accurate for almost everyone. That's the trick. The real question isn't whether a reading FEELS true. It's whether an astrologer, handed a chart and nothing else, can pick the right person out of a lineup.

Has anyone actually run that?

A twenty-six-year-old physicist at Berkeley. Shawn Carlson. His paper landed in Nature, fifth of December, nineteen eighty-five. And the crucial thing is, he didn't ambush anybody. He built the test WITH astrologers, including members of the National Council for Geocosmic Research, so they'd agree in advance the design was fair.

So nobody could cry foul afterwards.

That was the idea. Twenty-eight astrologers. A hundred and sixteen natal charts. For each chart, three personality profiles from the California Psychological Inventory. One was the real person. Two were strangers. Pick a first choice and a second.

One in three by luck. What did they get?

Chance. And Carlson's verdict was blunt. He wrote that we are now in a position to argue a surprisingly strong case against natal astrology as practised by reputable astrologers.

In Nature. That's a public execution.

And it became THE citation. For twenty-four years. Until a psychology professor at Göttingen went back into the numbers.

Oh no. This is where it gets complicated, isn't it.

Suitbert Ertel, Journal of Scientific Exploration, two thousand and nine. His argument: Carlson set the bar for astrology to win at two point five standard deviations above chance. The normal social science threshold is one point six four. And he sliced the data into subsamples instead of testing the totals.

So the goalposts moved. Accidentally or otherwise.

Ertel reanalysed it, and found the astrologers matched profiles to charts slightly better than chance. Marginally. P equals point zero five four on the three-way choice. Point zero four on the ten-point rating. And one astrologer who'd advised Carlson, Teresa Hamilton, said afterwards that he followed none of her suggestions.

Hang on. So the most famous anti-astrology study is... pro-astrology?

No. And Ertel is careful. His own words: the results are insufficient to deem astrology empirically verified, but sufficient to regard Carlson's negative verdict as untenable.

Which we should say out loud, even though it's inconvenient.

Especially because it's inconvenient. One study never settles anything. So look at everything else. Geoffrey Dean and Ivan Kelly reviewed more than forty studies, over seven hundred astrologers, all trying to match charts to people. No better than guesswork. Even when they were given every piece of information they asked for. Even when they said they were confident they'd got it right.

Confidence and accuracy coming apart. Oldest story in psychology.

Dean also tracked two thousand one hundred and one people born in London in the same week of May, nineteen fifty-eight. Time twins. Nearly identical skies. If charts set your life, those lives should rhyme.

And they didn't. What did astrologers say to that?

Roy Gillett, president of the Astrological Association of Great Britain, told the Telegraph the findings should be treated with extreme caution, and accused Dean of setting out to discredit astrology. Which, honestly, is a fair thing to worry about.

Okay. Pune. You left me hanging.

Twenty-seven of the fifty-one sent answers back. Some major astrological organisations boycotted it, sensing a trap. Each astrologer got forty charts. They'd been told in advance that twenty-eight out of forty would count as real skill. The average came in marginally BELOW a coin toss.

Below? You could beat them with a ten-rupee coin.

Then they handed all two hundred charts to representatives of an astrology institute. Same result. And the authors wrote that many astrologers treated their own sub-coin-toss scores as proof of their gift. They had to be told what real predictive success would even look like.

That's the part that gets me. Not that they failed. That they couldn't tell.

Because the feeling of being understood is real even when the mechanism isn't. Your brain is a pattern engine. It scores every hit and quietly deletes the misses. Astrology just gives it a sky to point at. So next time something describes you perfectly... ask whether it would also have fit the stranger sitting next to you.

And if it would?

Then it was never the stars doing the work. It was how badly you wanted the description to be yours.