The Problem of the Mad King's Draft:
Suppose there is country which is ruled by a king who can be either 'mad' or 'normal.' The king rules a a large country with a continuum of citizens who have names $j$ from $[0,1]$. The citizens do not know whether the king is mad or not but believe both characters are equally likely.
The king drafts citizens. The mad king drafts $2$ citizens while the nice king drafts $4$ citizens at random, that is, each citizen is 'equally likely' to be drafted. Drafted citizens do not know how many other citizens are drafted.
What is the posterior of a citizen $j$ who is drafted by the king? This is an important question, since drafted citizens want to escape the draft if the king is mad.
It seems the obvious answer is that the correct posterior should be $1/3$. But why?
--
Ideally, I would like to find a general definition of conditional probabilities that applies to the Mad King's Draft and that is analogous to the standard definition of conditional probabilities, found, for example, on wikipedia en.wikipedia.org/wiki/Conditional_expectation
None of these standard definitions apply, which is not satisfying.
--
I eventually came up with the following definition of conditional expectations. The definition 'generalizes' the standard definition and applies to the Mad Kings' Draft. I would be interested in whether this definition (i) makes sense and (ii) whether it is in fact implied by a conventional definition.
Given a probability space $(Ω,\mathfrak{F},μ)$, let $(A_{j})$ be an uncountable family of sets $A_{j}∈F$ such that $Ω=⋃A_{j}$, and, for each $ω$, the number of $A_{j}$ such that $ω∈A_{j}$ is finite. Take some $Ω^*\in \mathfrak{F}$. I define a family of binary random variables $1_{A_{j}}(ω)$ and $1_{Ω^*}(ω)$.
Definition. The family of functions $E[1_{Ω^*}(ω)|1_{A_{j}}(ω)=1]_{j∈[0,1]}$ are conditional expectations if and only if
$\int_{\Omega } \sum_{j∈J:1_{A}(ω)=1} E[ 1_{\Omega^*}|1_{A_{j}}=1] ( \omega ) dμ = \int_{\Omega } \sum_{j∈J:1_{A}(ω)=1} 1_{\Omega^*} ( \omega ) dμ $
for all $J \in \mathfrak{B} $, with $\mathfrak{B}$ denoting the Borel $\sigma $-algebra of $\left[ 0,1% \right] $.
Note: If $(A_{j})$ partitions $Ω$, then the definition reduces to the standard definition of $E[1_{Ω^*}(ω)|1_{A_{j}}=1(ω)]$ .
--
One very good Answer suggests using Palm Probabilities. However, the formula above is implied by Palm probabilities only in the special case in which $Ω^*$ is the union of a subset of elements from $(A_{j})$. The Mad King's Draft is such a special case, because $Ω^*$ ("the king is mad") is the union over all sets in which 2 citizens are drafted. However, the approach does not work more generally.
Example 1: Both kings randomize between drafting $2$ and drafting $4$ citizens and the mad kings invites $2$ citizens with higher probability than the nice king. If the probabilities with which the two types draft $2$ are $p_{mad}$ and $p_{nice}$, respectively, what is the posterior probability that the king is mad conditional on being drafted?
Example 2: Both kings randomize between drafting none and drafting $1$ citizen and the mad kings invites $1$ citizen with higher probability than the nice king. If the probabilities with which the two types draft $0$ citizens are $p_{mad}$ and $p_{nice}$, respectively, what is the posterior probability that the king is mad conditional on being drafted? Note, (i), in this example, a drafted citizen knows that no other citizen was drafted. Note, (ii), that there is no problem with defining conditional probabilities in this example in the conventional way.
Put differently, in the two examples, the conditional probability cannot be expressed as a conditional probability of a subset of the point measures, but it needs to be expressed as a conditional probability on the set of random point processes itself.