What are some physical, geometric, or probabilistic interpretations of the values of the Riemann zeta function at the positive integers greater than one?
I've found some examples:
1) In MO-Q111339 on a Tamagawa number, GH states
$$\operatorname{vol}(\mathrm{SL}_2(\mathbb{R})/\mathrm{SL}_2(\mathbb{Z}))=\zeta(2).$$
2) In "Quantum Gauge Theories in Two Dimensions," Edward Witten derives
$$\operatorname{vol}(\mathcal M)=\frac{2}{(\sqrt{2}\:\pi)^{2g-2}}\zeta(2g-2)$$
from a volume form for the moduli space $\mathcal M$ of flat connections on a gauge group ($G=SU(2)$) bundle over a compact two-dimensional manifold, a Riemann surface of genus $g$, and, for a connected sum of an orientable surface of genus $g$ with $k$ Klein bottles and $r$ copies of the projective plane $RP^2$, he derives
$$\operatorname{vol}(\mathcal M) = \frac{2(1-2^{1-(2g-2+2k+r)})}{(\sqrt{2}\:\pi)^{2g-2+2k+r}} \zeta(2g-2+2k+r).$$
3) In Wikipedia on the Stefan-Boltzmann law, the black body irradiance (total energy radiated per unit surface area of a black body per unit time) is given as
$$j^{*}=2\pi\:3!\zeta(4)\:\frac{(kT)^4}{c^2 h^3}.$$
(In $n$-dimensional space, it's proportional to $n!\zeta(n+1)$, and Planck's law for the electromagnetic energy density inside the 3-D black body has an extra factor of $4/c$.)
4) In "Feynman's Sunshine Numbers," David Broadhurst gives the rate per unit surface area at which a black body at temperature $T$ emits photons as
$$2\pi\:2!\zeta(3)\:\frac{(kT)^3}{c^2 h^3}.$$
(And the density of photons inside the body has an extra factor of $4/c$.)
Motivation: I'm motivated not only by general interest, but also by MO-Q111165 and MO-Q111770. Determinants (volumes) of adjacency matrices and, therefore, the cycle index polynomials (CIPs) for the symmetric group pop up in statistical physics, e.g., in Potts q-color field theory and scaling random cluster model, and the CIPS can be "rescaled" to obtain the complete Bell polynomials (OEIS-A036040) which are related to the cumulant expansion polynomials (OEIS-A127671), both of which are related to statistical correlations and their diagrammatics (see references in OEIS-A036040).
5) The $p_n(z)$ of MO-Q111165 seem formally related to the Chern classes $c_k(V)$ of a direct (infinite) sum of line bundles $\:\:\:\: V=L_1\oplus L_2\oplus \cdots\:.$ :
With $x_{i}=c_1(L_i)$, the first Chern classes,
$$p_k(z)=k!\:c_{k}(V)=k!\:e_{k}(x_{1},x_{2}, \ldots),$$
where $e_k$ are elementary symmetric polynomials. The $\zeta(n)$ can be identified as the power sums of the first Chern classes, and then, for example,
$$3!\:c_3(V)=p_3(z)=(z+\gamma)^3-3\zeta(2)(z+\gamma)+2\zeta(3)$$ $$4!\:c_4(V)=p_4(z)=(z+\gamma)^4-6\zeta(2)(z+\gamma)^2+8\zeta(3)(z+\gamma)+3[\zeta^2(2)-2\zeta(4)].$$
Update (Nov. 16, 2012): Just found the sequence in a thesis by R. Lu, "Regularized Equivariant Euler Classes and Gamma Functions," which discusses the relationship to Chern and Pontrjagin classes.
See also "An integral lift of the Gamma-genus" and "The motivic Thom isomorphism" by Jack Morava and "Hodge theoretic aspects of mirror symmetry" by L. Katzarkov, M. Kontsevich, and T. Pantev.