You mean an infinite-dimensional Hilbert space. The answer is no.

 Suppose $p(z)$ has distinct roots $\alpha_1, \alpha_2$.  Define a sequence $x_1, x_2, \ldots$ in the unit sphere of $H$ such that 

 1. $x_1,\ldots, x_n$ are linearly independent for all $n$.
 2. $\|x_i - x_{i+1}\| \to 0$ as $i \to \infty$.
 3. the sequence is dense in the unit sphere of $H$.

Define $A$ on the linear span of the sequence so that $A x_i = \alpha_1 x_i$ if $i$ is odd, $\alpha_2 x_i$ otherwise.

On the other hand, if $p$ has only one root, say $p(z) = (z - \alpha)^d$, then 
with the same sequence as above take $A x_i = \alpha x_i + x_{i+1}$ for $i$ not divisible by $d$, $\alpha x_i$ otherwise.