Given $X$ finite, fix a continuous function $\theta \in \Delta^+ (X) \to [0,1]$, fix a probability measure $\mu^*$, and a $\varepsilon > 0$. Consider: $$ \max_{\mu \in \Delta^+ (X)} \theta (\mu), \quad \text{such that } d(\mu ,\mu^*) \leq \varepsilon $$ where $\Delta^+ (X)$ is the set of all sigma-additive probability measures with finite support, and $d(\mu ,\mu^*)$ is defined as a distance measure.
Does this optimization problem has a solution? How could I tackle such a optimization Problem?