How often have you read a headline like “New Study Shows That Coffee May Cause Cancer”? The problem with such studies is that many are wrong. When other researchers try to replicate the same findings in a subsequent study, the relationship disappears. This is known as the replication crisis in science. It first received widespread attention in 2005 when Dr. John Ioannidis published a paper provocatively titled “Why Most Published Research Findings Are False.”

Despite increased focus and concern in the scientific community, the crisis continues and shows no signs of abating. Drs. Michael Muthukrishna and Joseph Henrich recently published a perspective paper in Nature Human Behaviour in which they claim that persuading scientists to work within a theoretical framework would reduce the problem of replication.

A Quick Explanation

The reasons for the replication crisis are many and complex, including fraud, but one major cause is confirmation bias. To understand this, imagine a journal of luck science. Every week, this journal publishes a paper by recent lottery winners on what method they used to win. Some read the winning numbers in tea leaves, some used a coin flip, while others used relatives’ Social Security numbers.

Out of the millions of people who play the lottery there usually will be one or more winners by pure chance every week. No method is involved. That’s why if you tested the winners’ methods the following week, they would all fail to replicate their success.

The problem is that the luck journal publishes only the winners. The losers won’t publish because failure is not very interesting. This produces a publication bias for random results that happen to be correct by chance.

The Hockey Stick Graph

The most famous case of such a biased finding was a study published in 1999 by Dr. Michael Mann. It showed 900 years of flat temperature followed by 100 years of rapid warming. Its shape quickly led it to be nicknamed the Hockey Stick Graph, and it played a key role in the 2001 U.N. Intergovernmental Panel on Climate Change Third Assessment Report.

It is perhaps the most important graph in the history of science, because it was instrumental in scaring the living daylights out of politicians. Until that study, the climate skeptics were on par with the global-warming alarmists. The science debate was still raging, and no definite winner had been declared. After politicians saw that graph, they were convinced that humans were destroying the climate. Without it, the Paris Climate Agreement and the Green New Deal would be unthinkable.

The problem is that it was a bogus study, constructed in much the same manner as the hypothetical luck journal of lottery winners. Mann had the equivalent of millions of lottery tickets at his disposal, and so he was guaranteed to find whatever result he was looking for.

In 2006, the result was finally settled when highly qualified statisticians led by Dr. Edward Wegman produced a report for Congress showing that Mann’s method could reproduce a graph of any desired shape. It was junk science.

Improved Framework

Although the study by Muthukrishna and Henrich primarily targeted psychology and clinical medicine, their ideas apply equally to climate science, which is characterized by a lack of coherent methodology.

…“climatology,” no such field of science officially exists.

Despite the common usage of the term “climatology,” no such field of science officially exists. It is a highly interdisciplinary hodgepodge of intersecting expertise from a multitude of fields, with no overarching theoretical framework. That is why so many researchers resort to vague and vacuous methods like “scientific consensus” to determine truth.

That is also why bogus science like the hockey stick graph could not only easily pass through peer review but also be allowed to influence public policy without proper quality control and independent verification.

As such, the replication crisis runs deeper than anyone may suspect. In this time of fake news and dismal trust in the media, science still is held in high regard by most. But that may not continue into the future.

4 Comments

Skeptic

Mr. Onar,
it is not enough to call “bogus” a stuty to prove that it is bogus. It actually requires… a study.
Infact there have been further studies by other people to confront the validity of the ‘hockey stick’ chart. They confirm that it is not a fraud and that mean global temperature is rising.
Please see: https://skepticalscience.com/broken-hockey-stick.htm

If you want to call the ‘hockey stick’ chart a fraud, you can to that.
What you can’t do is ‘prove’ that is is a fraud.

Nina Teicholz in her book, “The Big Fat Surprise” went back and looked at the landmark papers in Food Science finding vast amounts of junk science and ignored results of previous good work that didn’t fit various political and economic agendas. I recommend it.

Kenneth Weiss

Americans love to be taken advantage off. Climate Change is a hoax. Ask the men and women who support it. If they are sure it exists they also support it. Ask them how much money hacve they personally given to the cause. Probably 0 whybecause it is the goverment that will tax us throught the workplace. There is no proof and there will never be proof so please get your head out of your ass and realize that MAN DOES NOT CONTROL THE WEATHER ONLY THE PLANET CONTROLS THE WEATHER MAN HAS NO CONTOL .

Misterknowitall

Actually “Climate Change” itself isn’t a hoax but the claim that it is caused by humans emitting a little bit of CO2 is most definitely nonsense.
There is always “climate change” since the earth is never at a steady state when it comes to climate. Everything is cyclical.
The media is always trying to associated CO2 with “pollution” but the fact is CO2 is an ESSENTIAL gas and is necessary for life to exist on the planet. How can an essential gas be considered pollution? Especially when it is in such a small concentration. (400ppm is only 0.04%)

International Correspondent at LibertyNation.com. Onar is a Norwegian author who has written extensively on politics, technology, and science. He has a mathematics and physics background and has been a technological entrepreneur for twenty years, working in areas ranging from biomass gasification and AI to 3D cameras and 3D TV. He is currently also the Editor of the alternative news site Ekte Nyheter (Authentic News) in Norway. Onar is the author of The Climate Bubble (2007) and The Art of War (2008).

We Recommend

About the author

International Correspondent at LibertyNation.com. Onar is a Norwegian author who has written extensively on politics, technology, and science. He has a mathematics and physics background and has been a technological entrepreneur for twenty years, working in areas ranging from biomass gasification and AI to 3D cameras and 3D TV. He is currently also the Editor of the alternative news site Ekte Nyheter (Authentic News) in Norway. Onar is the author of The Climate Bubble (2007) and The Art of War (2008).