Let $M$ and $N$ be manifolds and let $T: M \to N$ be a bijective map. Let $ \mathcal{F}(M,\mathbb{R})$ (resp.$ \mathcal{F}(N,\mathbb{R})$) be the space of all functions from $M$ (resp. $N$) to $\mathbb{R}$ and let $F_T$ denote the pullback of $T$, i.e. the map $F_T: \mathcal{F}(N,\mathbb{R}) \to \mathcal{F}(M,\mathbb{R})$ defined by $F_T(f)= f \circ T$.
Even though very little structure has been specified, the map $F_T$ is linear (as long as it is well-defined). I am looking to impose as little additional structure on $T$, $M$, $N$, $ \mathcal{F}(M,\mathbb{R})$, and $ \mathcal{F}(N,\mathbb{R})$ as possible so that $ \mathcal{F}(M,\mathbb{R})$ and $ \mathcal{F}(N,\mathbb{R})$ are Hilbert spaces with countable bases and $F_T$ is linear and can be represented as an "infinite matrix". (For example, vector space and linear map structure could be imposed until $T_F$ is just the transpose of $T$, but this would be an overkill.)
Any thoughts or ideas along these lines would be greatly appreciated. Thank you very much.