Given a path integral $\int_{\Omega}{f(\mathbf{x})}$ with a well-posed integrand $f(\mathbf{x})$, where $\mathbf{x}$ is a path from some path space $\Omega$, one can integrate it successfully with a Markov Chain Monte Carlo method, in particular using Metropolis sampling and adequate proposal mutation strategies. This is given.
However in my case the integrand $f(\mathbf{x})$ is defined such, that (one-dimensional) delta distributions $\delta_{t_0}(t)$ occur in it in different dimensions at different (unknown) locations $t_0$. Moreover such delta distributions cannot be found by any sampling or mutation strategies or numerical optimization, as the problem of finding such a path is proved to be undecidable.
The value of the desired integral $\int_{\Omega}{f(\mathbf{x})}$ always exists and is finite, even in presence of delta distributions in the integrand.
Since I have an access to the evaluation of these delta distributions during sampling and mutation process, I attempt to regularize them using some smoothing kernel (convolution with a normalized kernel function $k_r(t)=\frac{1}{r}k\left(\frac{t}{r}\right)$ with some bandwidth $r$). This leads to a tempered integrand $f_r(\mathbf{x})$. During the integration at every step $n$ I gradually shrink the kernel bandwidth $r_n$ to zero in order to achieve $f_{r_n} \to f$ as $n \to \infty$ in spirit of serial tempering. Thus I expect the integration method to be consistent, meaning that the error introduced by tempering will vanish faster than the integral converges.
Thus I have two rather similar questions:
- Would the integral converge to proper value in presence of delta distributions in the integrand with this method? What confuses me is that the chain either tends to stuck in the vicinity of the delta distribution or would otherwise just miss it, as the mode of it becomes narrower when $n$ is large.
- What should be the cool-down schedule of the integrand $f_{r_n}$ (i.e. the shrinkage rate of the sequence $r_n$) in order to guarantee the consistent convergence of the MCMC? In other words, what are the conditions for the cool-down schedule that allows the integral to converge before the integrand $f_{r_n}$ becomes unsamplable?