I am trying to prove the Fenchel-Rockafellar theorem, that $$ \inf_x \left[ f(x) + g(Ax) \right] = - \inf_\beta \left[ f^\star(A^T \beta) + g^\star(-\beta) \right] $$

under the usual regularity assumptions. The general outline of my proof should work, but I run into problems at the last step:

- Argue from Fenchel-Young inequality that $\inf_x \left( f(x) + g(Ax) \right) = -(f + g\circ A)^\star(0)$.
- Compute $(f + g \circ A)^\star$ as the infimal convolution of $f^\star$ and $(g \circ A)^\star$, which gives $$ \inf_x \left( f(x) + g(Ax) \right) = - \inf_{\beta} \left( f^\star(\beta) + (g \circ A)^\star(-\beta) \right)$$
- Plug in the expression for $(g \circ A)^\star(\beta)$ and simplify.

The problem is that I get $$ (g \circ A)^\star(\beta) = \begin{cases} \infty & \beta \not\in \mathcal{R}(A^T) \\ ( g + I_{\mathcal{R}(A)} )^\star(u) & \beta = A^T u \end{cases}, $$ and computing the infimal convolution this can be written as $$ (g \circ A)^\star(\beta) = \begin{cases} \infty & \beta \not\in \mathcal{R}(A^T) \\ \inf_{\substack{u=u_1 + u_2 \\ u_2 \in \mathcal{R}(A)^\perp}} g^\star(u_1) & \beta = A^T u \end{cases}. $$

When I plug this back in step 3, I get $$ \inf_x \left( f(x) + g(Ax) \right) = - \inf_{\beta \in \mathcal{R}(A)} \left( f^\star(A^T \beta) + g^\star(-\beta) \right),$$ so I have an unwanted constraint on the right-hand side of the equality.

It may be that my calculations are wrong, but I've spent hours on them now, so I wonder if the issue is that the constraint is redundant?