Yes.  Any finitely generated module in category O is a quotient of a finite generated projective, and thus a quotient of a module with a finite Verma module filtration.  Thus, any infinite dimensional module tensored with a Verma module has weight multiplicities that grow too fast (faster than a constant times the Kostant partition function), so it can't be in category O.