Lemma: Let $A_1,\ldots,A_n$ are events $n\in\mathbb{N}$ then
$$
\sum_{i=1}^n \mathbb{P}(A_i) = \mathbb{P}(\cup_{i=1}^n A_i)
$$
if and only if $A_1,\ldots,A_n$ are mutually exclusive.
Both ways are shown by an easy induction.
However, I think that we are assuming that the probability spaces are finite. Does this lemma still hold if we have a probability space $(\Omega,\mathcal{F},\mathbb{P})$ where $\mathcal{F}$ is countable or uncountably infinite.
Thanks in advance.

4$\begingroup$ This question is too easy for MO. Is it a homework problem? $\endgroup$– Bill JohnsonJan 29, 2010 at 18:39

$\begingroup$ I am asking about when we are dealing with an infinite probability space and not the easy finite probability space case. I am wondering if the easy proof extends. $\endgroup$– alext87Jan 29, 2010 at 19:04

2$\begingroup$ Alex, part of the definition of a measure is countable additivity. See en.wikipedia.org/wiki/Measure_(mathematics)#Definition $\endgroup$– Tom LaGattaJan 29, 2010 at 19:31

2$\begingroup$ This has nothing to do with the size of the measure (probability) space, either. $\endgroup$– Tom LaGattaJan 29, 2010 at 19:32

2$\begingroup$ Consider [0,1] with uniform probability density. Then 1 = Pr(x is in [0,1/2] OR x is in [1/2,1]) = Pr(x is in [0,1/2]) + Pr (x is in [1/2,1]), but the two are NOT mutually exclusive as x = 1/2 fulfills both. In general, the statement is "up to probability 0" pieces, i.e., that Pr(A_i intersect A_j) = 0 for all i different from j. $\endgroup$– Jason DeVitoJan 29, 2010 at 21:07
1 Answer
Your "lemma" is false for finite probability spaces, e.g., $\Omega = \{a,b\}, \mathbb P(\{a\})=0,\mathbb P(\{a,b\})=1, \mathbb P(\{a\} \cup \{a,b\})=1.$
After you fix it, a cannon to swat the fly is inclusionexclusion, or more specifically, the Bonferroni inequalities.
I think people are confusing your question as stated with the natural and very elementary question of whether countably additive probabilities must be uncountably additive, and the example of Lebesgue measure on $[0,1]$ shows this this is not the case.
You should very rarely do anything with the sample space itself in any intrinsic probability question. See the answer gowers gave to this question and this Tao blog entry. It's ok to have a sample space when you apply probability to something like an analysis question (e.g., proving the Weierstrauss approximation theorem using probability) or use the probabilistic method in combinatorics.

1$\begingroup$ Is it too charitable to interpret "A and B are mutually exclusive" as $\mathbb{P}(A \cap B) = 0$? This seems in keeping with the "ignore the sample space" philosophy. $\endgroup$ Jan 30, 2010 at 0:15

$\begingroup$ Yes, I agree that is the most natural way to fix it, to change the definition of mutually exclusive or replace that in the statement. Since you sometimes deal with different measures on the same space, I'd be uncomfortable redefining mutually exclusive in all circumstances. $\endgroup$ Jan 30, 2010 at 0:39

1$\begingroup$ Well, one could reserve the term disjoint for when the settheoretic meaning is truly needed... $\endgroup$ Jan 30, 2010 at 1:02

$\begingroup$ I'd qualify the last sentence with a "sometimes", namely when the sample space itself is part of the problem of interest. In many (probably most) applications of the probabilistic method the sample space will still be a distraction. $\endgroup$ Jan 30, 2010 at 1:26

1$\begingroup$ I understand. The definition of mutually exclusive is not exactly how I was using it. I assume that if two events can't occur together then they are mutually exclusive. Since events with probability $0$ can't occur I assumed they were mutually exclusive with all events. The wikipedia definition is not exactly precise on this. Thanks for all your help. $\endgroup$– alext87Jan 30, 2010 at 17:59