I asked this question on math.stackexchange and I was suggested that asking it may be more appropriate. This is part of my research which tries to extend some of Choquet's theory to some non-compact non-separable spaces (with other structures).
The only proof of Jensen inequality (and most general version) that I know is a direct consequence of the Fenchel-Moreau Theorem : If $X$ is a locally convex Hausdorff topological space, let $\mu$ be a Borel probability measure and $x\in X$ be such that for all continuous linear functional $x^\ast\in X^\ast$, $\int_X \langle y,x^\ast\rangle~d\mu=\langle x,x^\ast\rangle$ then we say that $\mu$ averages to $x$, in symbol $\mu\sim x$. The Fenchel-Moreau theorem states that the bidual of a proper l.s.c. convex function $f$ is the function itself. Recall that $f^\ast(x^\ast)=\sup_{x\in X} \langle x,x^\ast \rangle-f(x)$ and $f^{\ast\ast}(x)=\sup_{x^\ast\in X^\ast} \langle x,x^\ast\rangle-f^\ast(x^\ast)$, the theorem states that on $X$, $f=f^{\ast\ast}$.
Suppose that $\mu\sim x$ and $f$ is a proper l.s.c. convex function, then by Fenchel's inequality, for any $y\in X$ and any $x^\ast\in X^\ast$, $\langle y,x^\ast\rangle\leq f(y)+f^\ast(x^\ast)$, taking the integral over $\mu$ we get \begin{align*} \langle x,x^\ast\rangle &= \int_X \langle y,x^\ast\rangle d\mu(y)\\ &\leq \int_X \left[f(y)+f^\ast(x^\ast)\right] d\mu(y)\\ &= \int_X f ~d\mu + f^\ast(x^\ast) \end{align*} and therefore $\langle x,x^\ast\rangle-f^\ast(x^\ast)\leq \int_X f ~d\mu$ for all $x^\ast\in X^\ast$, taking the supremum of the LHS over $x^\ast\in X^\ast$ we get $f(x)=f^{\ast\ast}(x)\leq \int_X f~d\mu$.
I am wondering if the result can be extended to any measurable convex function and if there is any literature on the subject. Is there something like
For any Borel probability measure $\mu$ such that $\mu\sim x\in X$ and any bounded measurable convex functional $f:X\to\mathbb R$, $f(x)\leq \int_X f~d\mu$.
Or is there any reason to believe that this would be false ? Also if true can we generalize to other measurable spaces $X$ where all points can be separated by measurable linear functional ? The case where $X$ is the $\sigma$-algebra generated by a Banach space space would be interesting, I think that in this case we might be able to conclude that any convex bounded function (without measurability) is actually lower semi continuous.