I keep seeing this question percolate up. I think it deserves at least one more or less correct answer.
First, the 1d integrals $I(a,b) = \int_{\mathbb{R}} \exp(-\frac{1}{2}x^2 - ax - b x^4) dx$ certainly exist for $b \geq 0$ and are analytic in $a$ and $b$. But they're not do-able in elementary terms. Noting that $\partial_bI = \partial_a^4I$ and integrating by parts gives a 4-th order ODE in $a$: $$ 4b\partial_a^4 I - \partial_a^2 + a\partial_aI + I = 0. $$ You can solve this via Laplace transform. The boundary values along $a=0$ are integrals $\partial_a^kI = C_k\int x^k \exp(-\frac{1}{2}x^2 - b x^4)dx$, which can be reduced to sums of products of parabolic cyclinder functions and exponential functions. The cylinder functions can be expressed in terms of $\operatorname{erfc}$ by recursion, but that's as elementary as they get.
The 2nd kind of integral is (after switching back to Euclidean signature) just a multivariate generalization of the first. It can be done in an eigenbasis of C.
The 3rd integral isn't really an analogue of the first two. (The quadratic case is so degenerate as to be misleading.) That path integral is a shorthand for a limit of finite-dimensional integrals of the second kind. Fix $\Sigma = \mathbb{R}^n$. Fix in $\mathbb{R}^n$ a finite cubic lattice $L_{a,N}$ which has edges of length $a$ and $N^n$ sites. The path integral $"\int e^{-\int_\Sigma (q(\phi,\phi) + b\phi^4) dx}\mathcal{D}(\phi)"$ is meant to be defined to be a certain limit $a\to 0, N\to\infty$ of integrals of the form $$ \int_{Map(L_{a,N}, \mathbb{R})} e^{-\int_{L_{a,N}} Q(a)(f,f)(l) + B_4(a) f^4(l) dl} df $$ The critical distinction here is that the coefficients $Q(a)$ and $B_4(a)$ are functions of the lattice spacing. One is supposed to choose these functions so as to fix the lower order moments of the resulting measures to be given functions of $q$ and $b$. The theory of renormalization tells you how to select these functions: Basically, you can integrate out the field $f$ on half of the sites and get a theory on the lattice $L_{2a,N/2}$. This theory should still have the same limit $N\to\infty$, $a\to 0$.
The case $n=1$ is basically the theory of Ornstein-Uhlenbeck measures, and its relation to quantum mechanics. No renormalization required here.
In $n=2$ and $n=3$ some of these path integrals are known to exist -- and known to have moments -- due to the efforts of the constructive QFT school associated with Glimm & Jaffe.
In $n=4$, it is generally believed that no such limit exists, except for the degenerate case when $b=0$. The evidence is numerical and circumstantial at the moment. I don't believe any general proof has been given.
In $n \geq 5$, it is actually proven that no such limits exist, for pure scalar field theories. IIRC IIRC, this is due to Aizenman, Brydges, and Spencer. Edit: Per Malek, this is due to Aizenman, Brydges, and Spencer & Froehlich have priority.