It is possible to use the Chern classes modulo an odd prime $p$ to give a quick argument in all cases. Let $T^n \subset U(n)$ denote the maximal torus, then we know
$$H^*(BU(n); \Bbb F_p) \cong H^*(BT^n; \Bbb F_p)^{S_n} \cong H^*((\Bbb{CP}^\infty)^n; \Bbb F_p)^{S_n} \cong \Bbb F_p[e_1, \cdots, e_n]$$
where $e_i = e_i(z_1, \cdots, z_n)$ are the elementary symmetric polynomials in the generators ("Chern roots") $z_1, \cdots, z_n$ of the $i$-th factor of $H^*(\Bbb{CP}^\infty; \Bbb F_p)$ appearing above. Note that from Chern-Weil theory, $e_i$ are the mod $p$ reduction of the universal Chern classes. Observe $H^*(BU(n); \Bbb F_p)$ is an $\mathcal{A}_p$-module where $\mathcal{A}_p$ is the Steenrod $p$-th power algebra. We compute a portion of this module structure below.
The first Steenrod power of $e_m$ can be computed as follows:
$$\begin{align*}P^1(e_m) = P^1(\mathrm{Sym}(z_1 z_2 \cdots z_m)) &= \mathrm{Sym}(z_1^p z_2 \cdots z_m) \\ &= \mathrm{Sym}(z_1^{p-1}) \mathrm{Sym}(z_1 z_2 \cdots z_m) - \mathrm{Sym}(z_1^{p-1} z_2 \cdots z_{m+1})\end{align*}$$
where $\mathrm{Sym}$ denotes symmetrization under the action of $S_n$ on the indices, where we normalize by dividing out by $1/d!$ where $d$ is the number of variables in the monomial. We can induct donwards until we reach
$$\begin{align*}\mathrm{Sym}(z_1^2 z_2 \cdots z_{m+p-2}) = \ & \mathrm{Sym}(z_1) \mathrm{Sym}(z_1 z_2 \cdots z_{m+p-2}) \\ &- (m+p-1) \mathrm{Sym}(z_1 z_2 \cdots z_{m+p-1})\end{align*}$$
Combined with Newton's identities, this shows $P^1(e_m)$ is a polynomial in $e_1, \cdots, e_{m+p-1}$ and in fact from above we see $e_{m+p-1}$ has degree $1$ in this identity with associated coefficient $m+p-1$, so turning that around we get $(m+p-1)e_{m+p-1}$ is a polynomial in $e_1, \cdots, e_{m+p-2}, P^1(e_m)$.
Suppose $S^{2n}$ has an almost complex structure. Suppose $n \geq 4$ so that there is an odd prime $p < n$ which does not divide $n$. Letting $m = n-p+1 > 0$ above, and using invertibility of $m+p-1 = n$ modulo $p$, we obtain that $c_n$ is a polynomial in $c_1, \cdots, c_{n-1}, P^1(c_{n-p+1})$ modulo $p$. This is a contradiction because $c_n(S^{2n}) = \chi(S^{2n}) = 2$ is nonzero modulo an odd prime, whereas all the lower-dimensional Chern classes vanish integrally as $S^{2n}$ has no cohomology below dimension $2n$.
This leaves only finitely many possibilities, $n = 1, 2, 3$, and $n = 2$ can be ruled out by the Pontryagin class argument as explained by mme above.