I think it's not true :
Let $X=Spec(A)$ with $A=k[x,y,z]/(x^2-y^2-z^2)$ be a quadratic cone. Let $Y$ be a line through the origin of the cone : its ideal is $I=(z,x-y)$. We calculate :
$$X'=Proj_{A}A[t,u]/(zt-(x+y)u),$$$$X'=Proj_{A}A[t,u]/(zt-(x+y)u,(x-y)t-zu),$$ [EDIT : THE FORMULA HAS BEEN CORRECTED]
where, in the graded $A$-algebra $A+I+I^2+....$ we denoted $t$ and $u$ the degree one generators corresponding to $z$ and $x-y$. Now, quotienting by $x$, $y$, and $z$, we calculate the fiber over the origin of this blow-up It is Proj(k[t,u]), which is a positive-dimensional projective line !