This is a follow up of the question in one dimension, that asked to show that the all the maxima of the sum of Gaussian
$$f_n(x):= \sum_{i=1}^{n}e^{-(x-x_i)^2}, x_1 < x_2 < \dots < x_n$$
are strict local maxima, i.e. there's a punctured neighborhood $U*$ around each local maxima $x*$, so that the $\forall x \in U*, f(x)< f(x*),$ (instead of $f(x)\le f(x*).$)**
The accepted answer used the identity theorem for real analytic function $f_n'$ to show that indeed all the critical points of $f_n$ are isolated, which, combined with the fact that the critical points must lie in $[x_1,x_n],$ proved that the critical points were finite in number and thus the answer proved that in one dimension, the local maxima of $f_n$ are strict local maxima.
This question is its generalization to higher dimensions $x_i, x \in \mathbb{R}^p.$ So here we consider:
$$f_n(x):= \sum_{i=1}^{n}e^{-||x-x_i||^2}.$$
Note that, here the critical points $x*$ will be given by:
$$\nabla{f_n}=0$$
$$ \implies \boxed{ x*=\frac{ \sum_{i=1}^{n}e^{-||x*-x_i||^2} x_i }{ \sum_{i=1}^{n}e^{-||x*-x_i||^2} } },$$
implying that $x*$ lie in the convex hull $C$ of $\{x_1\dots x_n\},$ just like in the one dimensional case, they lied in $[x_1,x_n]$ (see above or the link to the one dimensional case given above).
But this time, unlike one dimensional case, we cannot guarantee using the identity theorem that the zeros of the $\nabla{f_n}$ are isolated, because in higher dimensions, the usual identity theorem for real analytic function doesn't hold. We do know that zeros of the gradient has zero Lebesgue measure, thanks to this post and the references therein; but this doesn't prove that the the zeros are isolated, unlike one dimensional case.
Here's an image that shows a linear combination of three, two dimensional Gaussians:
It seems to me that its local maxima are all strict local maxima. I did an image search but never found any image otherwise.
So is there a proof that the local maxima of $f_n$ are strict?
Thought: (1) Since $0< f_n(x) \le n,$ I'm thinking if we can explore the topology of $y \in (0,n], f_n^{-1}(y)$. It seems to me that $\forall y \in (0,n], f_n^{-1}(y)$ consists of the disjoint union of at most $n$ hyperspheres $S^{p-1}\subset \mathbb{R}^p.$ whose supporting hyperplanes are orthogonal to the $x_n$ axis: so for example when $p=2, f_n^{-1}(y)$ is a disjoint union of at most $n$ horizontal circles whose supporting planes are orthogonal to the $x_3$ axis. Not sure if we need Morse theory to prove this?
Thought: (2) I'm not familiar with a lot of fixed point theory, but I see that the critical points are the fixed points of the map from $\Phi: \mathbb{R}^p\to \mathbb{R}^p:$ (see the boxed equation above)
$$\Phi: x \mapsto \frac{ \sum_{i=1}^{n}e^{-||x-x_i||^2} x_i }{ \sum_{i=1}^{n}e^{-||x-x_i||^2} } $$
Now can we say something about the above map $\Phi$ that guarantees that its fixed points are isolated? I don't know, but I'm looking at this and this question on MSE that deal with isolatedness and thus finitely many Lefscetz fixed points on a compact manifold, and in our case, we know that these fixed points of $\Phi: \mathbb{R}^p\to \mathbb{R}^p$ are on a compact manifold with boundary and corners, namely $C,$ the convex hull of $\{x_1, x_2 \dots x_n\}.$ So it seems to me that all we may need to show is that: $D\Phi_{x*}$ is Lefschetz, i.e. does not have the eigenvalue $1.$ Can we show that?