Are all probabilities conditional probabilities? [closed]

We know that $P(A\mid B) = \frac{P(A \cap B)}{P(B)}$. So $P(B) = P(A\mid B)P(A \cap B)$. Thus are all probabilities conditional probabilities? Can one make a probability more accurate by introducing a conditional component? For example, the probability of rolling a six on a fair die is $1/6$. But can we make this more accurate by assuming prior events? More generally,
is it possible to develop probability theory based on conditional probability?

-

closed as off-topic by Nate Eldredge, Vidit Nanda, Noah Stein, David White, Ramiro de la VegaAug 6 '13 at 15:01

This question appears to be off-topic. The users who voted to close gave this specific reason:

• "This question does not appear to be about research level mathematics within the scope defined in the help center." – Vidit Nanda, Noah Stein, David White, Ramiro de la Vega
If this question can be reworded to fit the rules in the help center, please edit the question.

The definition of the words "fair die" is that the probability that each face comes up is $\frac{1}{6}$. What would it mean to make this more accurate? (Of course, in the physical world it is likely that there is no such thing as a fair die.) – JBL Jun 13 '10 at 2:53
@JBL, that's the kind of accuracy the OP is referring to: introducing a bias based on prior knowledge about the die etc. – Suresh Venkat Jun 13 '10 at 3:27
It looks like "Thus are all probabilities conditional probabilities?" can be rephrased as "It is possible to develop probability theory based on conditional probability?" R. Hahn's answer mentions some cases in which it can be done, definitely at "research level". I edited accordingly. – Margaret Friedland Aug 6 '13 at 16:29

There's an obvious algebra error in Tony's question.

In one trivial sense all probabilities are conditional: just condition on the whole "sample space". In (another?) sense, probabilities are necessarily conditional on what is known.

-

In a sense this is precisely the Bayesian persective on what probabilities mean. Rather than being the limit fraction of a number of times an event occurs, it is a strength of belief conditioned on a prior. Bayesian approaches to statistical reasoning always start with a prior belief and condition based on that.

-

It is possible to develop probability theory taking conditional probability as one of the basic definitions; see section 3.2 in this book and the references mention there. Renyi was one of the first mathematicians to favor this approach, which is described in his book Probability Theory. Part of the motivation for this approach is to directly build in the ability to condition on measure-zero events without having to make a limiting argument. Another key word related to this idea is disintegration.

So, as Kjetil mentions, it all depends on what one takes as axioms. But certainly it is possible to develop theories that take conditional probability as the centerpiece.

-

I think that's the main difference between the Bayesian approach vs. the frequentist approach, having prior knowledge is supposed to make your predictions more accurate. See [LessWrong][1]

Bailey was trained in statistics, and when he joined an insurance company he was horrified to see them using Bayesian techniques developed in 1918. They asked not "What should the new rates be?" but instead "How much should the present rates be changed?" But after a year of trying different things, he realized that the Bayesian actuarial methods worked better than frequentist methods. Bailey "realized that the hard-shelled underwriters were recognizing certain facts of life neglected by the statistical theorists." For example, Fisher's method of maximum likelihood assigned a zero probability to nonevents. But since many businesses don't file insurance claims, Fisher's method produced premiums that were too low to cover future costs.cover future costs.

[1]: http://lesswrong.com/lw/774/a_history_of_bayes_theorem/cover future costs.

-

I think this is a tricky question! and the answer depends on the exact meaning of the question. In the usual standard probability theory, based on Kolmogoro'vs axioms, in the axioms itself there are no conditional probabilities, and only later conditional probability are separately axiomatized. This seems to me a most strange procedure, and I am not sure why it is done that way. But in the lighjt of this theory, there are in fact nn-conditional probabilities. From an applied point of view, that of course do not make sense.

Others can maybe comment on alternative axiomatizations.

-

In the hope of soliciting an expert opinion rather than offering one (I am neither a probabilist nor a logician), let me bring up here the topic of logical probability. Jan Lukasiewicz came up with infinitely valued propositional logic (with values in the interval $[0,1]$), which he also viewed as a way of formalizing probability, addressing the problem of interpreting conditional probabilities as well. According to Wikipedia, Richard Threlkeld Cox later showed that any extension of Aristotelian logic to incorporate truth values between 0 and 1, in order to be consistent, must be equivalent to Bayesian probability (http://en.wikipedia.org/wiki/Cox%27s_theorem). Cox's axioms deal with the notion of plausibility of a proposition A given a proposition B.

Added: this is the relevant paper by Lukasiewicz: Die logischen Grundlagen der Wahrscheinlichkeitsrechnung, Kraków, Polska Akademia Umiejętności, 1913 English translation in Selected Works, ed. by L. Borkowski, Amsterdam-London, North- Holland Publishing Company/Warsaw, PWN, 1970, pp. 16-63

-