Bayesian statistics theorem holds its own - but use with caution

Bayes' theorem spelt out in blue neon at the offices of Autonomy in Cambridge. Credit: Wikipedia / CC

(Phys.org) —In a Perspective in Science magazine this week, a Stanford Professor of Statistics re-examines Bayes' Theorem, its varying fortunes over the two-and-a-half centuries since it was proposed, and its current boom in popularity and likely future.

Bayes' Theorem was proposed by Thomas Bayes in the 18th century, and it combines newly acquired data with prior data to predict an outcome. In his paper, Professor Bradley Efron of Stanford University, presents the example of predicting whether twins are likely to be fraternal or identical in his overview of the theorem.

In Professor Brad Efron's example, there are two categories of data to be considered: the newly acquired data (that sonograms show a pregnant woman is carrying twin boys), and the prior data (the fact that one-third of twins are identical). Identical twins are twice as likely to produce twin boy sonograms because identical twins are always the same sex while fraternal twins have only a 50:50 chance of being the same sex.

Bayes' theorem combines these data in the formula.

P(A|B) = [P(B|A) x P(A)] / P(B)

where P(A|B) is the conditional probability of A given B, and P(B|A) is the conditional probability of B given A. In the example, A is the twins being identical, a prior with probability = 1/3. B is the "sonogram shows twin boys". Genetics imply P(B|A) = 1/2, giving P(A|B) = (1/2) x (1/3) / (1/3) = 1/2.

The formula correctly predicts the twins have an equal probability of being fraternal or identical.

The theorem has proved its worth, such as in 2012 when it was used to successfully predict the outcome of the U.S. presidential election in all 50 states before the final vote counts were available. Despite its success it has always been regarded with some suspicion by statisticians, particularly because it has been used when genuine prior data is unavailable or uncertain.

Efron also compares more recent statistical theories such as frequentism to Bayes' theorem, and looks at the newly proposed fusion of Bayes' and frequentist ideas in Empirical Bayes. Frequentism has dominated for a century and does not use prior information, considering future behavior instead.

Statistical theorems are important because they are widely used in areas such as medical research. Efron reports that in his work as an editor of a statistics journal, he found around 25 percent of papers used Bayers' theorem and most were based on uninformative priors, which counts against it, but on the other hand he notes that the current environment of data being produced in "fire hose" quantities means Bayers' theorem could effectively connect disparate inferences.

Efron uses another example to explain the problem: a study of 52 men with prostate cancer and 50 healthy controls looked at the activity of 6033 genes in the hope of identifying genes expressed differently in the patients. They calculated a test statistic (z) for each gene, with a normal bell-shaped distribution if there was no difference between patients and controls, but with larger values if there were differences.

The resulting histogram looked normal except for 28 of the genes on the right of the distribution, having z>3.40 values. These could represent real or false discoveries, since some z values are bound to be large even in the null hypothesis (no difference between patient/control gene expression). The frequentist theorem predicts false discovery rate (FDR) to be below 10%, which means only 2.8 of these are false. The Bayes theorem suggests the probability of nullness is also 10%, but no prior evidence is used, and the prior is estimated from the data itself. Efron says this "statistical jujitsu" is Empirical Bayes, which is essentially a fusion of frequentist and Bayes ideas that says that when there are large numbers of parallels (as in the 6033 gene study), the data "carry within them their own prior distribution."

Efron warns that Bayes' theorem can be used if genuine prior information is available but caution is needed if there are uninformative priors. For parallel cases, Empirical Bayes methods can be used effectively.

AbstractThe term "controversial theorem" sounds like an oxymoron, but Bayes' theorem has played this part for two-and-a-half centuries. Twice it has soared to scientific celebrity, twice it has crashed, and it is currently enjoying another boom. The theorem itself is a landmark of logical reasoning and the first serious triumph of statistical inference, yet is still treated with suspicion by most statisticians. There are reasons to believe in the staying power of its current popularity, but also some signs of trouble ahead.

General theory of meromorphic functions in the complex plane began in the nineteenth century, when E. Picard proved his famous 'Picard's little theorem'. Then, in the 1920s, R. Nevanlinna created the modern theory of meromorphic ...

Tiny Anolis lizards preserved since the Miocene in amber are giving scientists a true appreciation of the meaning of community stability. Dating back some 15 to 20 million years, close comparison of these exquisitely preserved ...

(Phys.org)—It was an interesting week for physics as a team made up of international researchers came up with a new theory that says dark matter acts like a well-known particle—they suggest it has similarities to pions, ...

The Tyrannosaurus rex and its fellow theropod dinosaurs that rampage across the screen in movies like Jurassic World were successful predators partly due to a unique, deeply serrated tooth structure that allowed them to easily ...

The first human inhabitants of the Americas lived in a time thousands of years before the first written records, and the story of their transcontinental migration is the subject of ongoing debate and active research. A study ...

The author writes, "The theorem has proved its worth, such as in 2012 when it was used to successfully predict the outcome of the U.S. presidential election in all 50 states before the final vote counts were available." I have never read that. Could the author reply and say where she/he got that information? It would contribute to the article.

Interesting as to why a theorem - (i.e a mathematical statement) has to lead to a 'controversy' - (contradicting arguments).

Bayesian theorem puts in mathematical form of what is obviously logical - eg. two boxes A and B contain black and white balls in 6:4 and 3:7 ratio respectively, given that box A is chosen (event B), probability of getting a black ball (event A)is (obviously) 6/(6+4) but more formally [(6/(6+3)) *((6+3)/(6+4+3+7)) ]/(1/2). .

Repeat this in unbiased manner and you will definitely converge to 0.6 after repeated number of times. - I dont see any reason for controversy if we have well understood before applying in practice.

Please sign in to add a comment.
Registration is free, and takes less than a minute.
Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.