This is a follow up question to my previous one, thanks to Karl and Angelo for their answers, and to the commenters: Smooth variety contained in another smooth variety
If $X$ is a local complete intersection (irreducible) subvariety of codimension two in $\mathbb P^n$ (we may assume $X$ is smooth if it helps, but I don't think it's necessary) then we know by Bertini's theorem there exists an irreducible hypersurface $Y$ containing $X$. Can we choose $Y$ such that $X$ is a Cartier divisor on $Y$ ?