This builds off on an old question about mixture measures: Generalized notions of mixture
Suppose $\mathcal{M}$ is a family of probability measures, and $Q$ is a probability measure over $\mathcal{M}$. We can define a mixture measure by: $$ \mu(A) = \int_A \nu(A)\,dQ(\nu). $$
Given a measurable function $g$, its integral wrt $\mu$ is naturally given by $\int g\,d\mu$. My question is: Is there a way to write this integral in terms of $\nu$ and $Q$?
I think I am just missing something very simple: For example, suppose each $\nu\in\mathcal{M}$ has a density function $f_\nu$, so that $\mu$ also has a density given by $f_{\mu}=\int f_\nu\,dQ(\nu)$. Then we can write (assuming all operations are justified, etc.): \begin{align*} \mathbb{E}_{\mu} g = \int g\,d\mu &= \int g(z)f_{\mu}(z)\,dz \\ &= \int g(z)\int f_{\nu}(z)\,dQ(\nu)\,dz \\ &= \iint g(z) f_{\nu}(z)\,dz\,dQ(\nu) \\ &= \int \mathbb{E}_{\nu}g(z)\,dQ(\nu). \end{align*}
I'm curious if a similar calculation works without assuming the existence of density functions on $\mathcal{M}$. I don't see why not, but for some reason I can't get this to work.