Are you sure about the factor of $3$ in Koszul's formula? The computation below does not give such a factor, and it gives a stronger result.
Let $X_i$ be any basis of the left-invariant vector fields (where the indices run from $0$ to $n$), with $[X_i,X_j] = c^k_{ij}X_k$, where, of course, $c^k_{ij}=-c^k_{ji}$ (and where here, as below, we use the summation convention that we sum over repeated indices in any given term if no summation is explicitly given). Let $\langle,\rangle$ be an $\mathrm{ad}$-invariant inner product, with $\langle X_k,X_l\rangle = g_{kl}$. Then $\mathrm{ad}$-invariance is just the equation
$$
g_{lk}c_{ij}^k + g_{jk}c_{il}^k = 0.
$$
If we assume that the $X_i$ are $\langle,\rangle$-orthonormal, then $g_{kl} = \delta_{kl}$, so $c^k_{ij} = - c^j_{ik}$, i.e., $c^i_{jk}$ is skew-symmetric in all its indices.
For simplicity, let's agree to write $c^i_{jk} = c_{ijk}$, when the $X_i$ are orthonormal with respect to an $\mathrm{ad}$-invariant $\langle,\rangle$, which I'll assume from now on.
Now consider the dual $1$-forms $\theta_i$ to the vector fields $X_i$. By the formula relating exterior derivative and Lie bracket, they satisfy
$$
\mathrm{d}\theta_i = -\tfrac12\,c_{ijk}\,\theta_j\wedge\theta_k
= -\sum_{j<k} c_{ijk}\,\theta_j\wedge\theta_k\,.
$$
By definition, the Cartan form is just
$$
\omega = -\tfrac16\,c_{ijk}\,\theta_i\wedge\theta_j\wedge\theta_k
= -\sum_{i<j<k} c_{ijk}\,\theta_i\wedge\theta_j\wedge\theta_k\,.
$$
Let $\alpha = \theta_0$. Then, according to your definition,
$$
\omega_2 = -\sum_{0<j<k}\,c_{0jk}\,\theta_0\wedge\theta_j\wedge\theta_k
= \theta_0\wedge\mathrm{d}\theta_0 = \alpha\wedge\mathrm{d}\alpha\,,
$$
which is a stronger result than Koszul claimed (although the factor of $3$ in his formula is mysterious), while
$$
\omega_3 = -\sum_{0<i<j<k}\,c_{ijk}\,\theta_i\wedge\theta_j\wedge\theta_k\,.
$$
Remark: By the way, the definition that you give for 'the' Cartan form is a bit odd, because this form definitely depends on choice of the inner product, as you can see, since, if you double the metric, you'll double the Cartan form. This isn't so serious in the simple case because it's just a matter of a scale, but in the general semi-simple case, you run the risk of having many different 'Cartan forms'. However, maybe this isn't such a bad defect, since it's not possible, even in the simple case, to define 'the' Cartan form for all simple groups so that pullback to every simple subgroup $H$ of $G$ yields 'the' Cartan form of $H$. (Just look at the various $\mathrm{SU}(2)$ subgroups of $G$ when there is more than one such subgroup up to conjugacy.)