This question is more or less a cross post of https://math.stackexchange.com/questions/1218660/orthogonal-functions-with-shrinking-support.
Let $X$ be a metric space (compact, if it helps) and let $Y$ be a closed subset of $X$. Fix a Borel measure $\mu$ on $X$. My question:
Is there an orthogonal set $\{u_n\}$ of functions in $L^2(X,\mu)$ such that the support of $u_n$ lies in a $2^{-n}$-neighborhood of $Y$?
I can construct such a set in the case $X = \mathbb{R}$ and $Y = \{0\}$ as follows. Partition the interval $[-2^{-n},2^{-n}]$ into subintervals $I_1, \ldots, I_{2^n}$ of equal length and define
$$u_n(t) = \begin{cases} 1 & t \in I_{2k+1} \\ -1 & t \in I_{2k} \\ 0 & t \notin [-2^{-n},2^{-n}] \end{cases}$$
This construction does not obviously generalize to much more general metric spaces. My only other idea was to apply Gram-Schmidt to an arbitrary sequence of functions whose supports converge to $Y$, but it is not clear how to do this while maintaining control of the supports.