This is the picture, I have in mind.

Certainly analytic continuation gives a unique, well-defined value at $0$, if available, and generalizes Jacobi's formula:
$$ \frac{\mathrm{d} \det(A)}{\mathrm{d} \alpha} = \det(A) \operatorname{tr}\left(A^{-1} \frac{\mathrm{d} A}{\mathrm{d} \alpha}\right)$$
 from the finite dimensional situation.

If you take the circle with the Laplace operator, you actually will get the Riemann zeta function as the spectral zeta function $\zeta_A(s) = \zeta(2s)$.

But the crucial difference between the above spectral zeta functions and the number theoretic ones is that the general zeta function *does not admit a functional equation*, in fact will not analytic continue to a meromorphic function of all of $\mathbb{C}$. They do analytically continue around a neighborhood of zero, if your eigenvalues do not grow to fast.

They do not grow to fast for pseudo differential operators on compact manifolds by a generalization of Weyl's law.