The answer to this question is yes. 

Indeed, let $a:=\alpha$, and suppose $1\le a\le2$. Without loss of generality (wlog), $1<a\le2$, $EX^a<\infty$, and $Y$ takes only values in a fixed finite set $S\subset[0,\infty)$. The inequality in question is equivalent to the following: 
\begin{equation}
	h(t):=h_{X,Y}(t):=[E(X+tY)^a-E^a(X+tY)]^{1/a}-(EX^a-E^a X)^{1/a}-t(EY^a-E^a Y)^{1/a}\le0
\end{equation}
for all $t\ge0$, and hence to the condition $h'(0)\le0$ (because $\frac d{dt}h_{X,Y}(t)=\frac d{du}h_{X+(t+u)Y,Y}(u)|_{u=0}$). 
In turn, the condition $h'(0)\le0$ can be rewritten as 
\begin{equation}
	(EX^{a-1}Y-E^{a-1}X\,EY)(EX^a-E^a X)^{1/a-1}\le(EY^a-E^a Y)^{1/a}, 
\end{equation}
and then in this H\"older-like form: 
\begin{equation}
	F(\mu):=(EX^{a-1}Y-E^{a-1}X\,EY)_+^a-(EX^a-E^a X)^{a-1}(EY^a-E^a Y)\le0, 
\end{equation}
where $u_+^a:=\max(0,u)^a$ and 
$\mu=\mu_Y$ is the probability distribution of $Y$, with the random variable (r.v.) $X$ considered fixed.

Obviously, the function $F$ is convex on the simplex $M_S$ of all probability distributions $\mu_Y$ on $S$. So, the maximum of $F$ on $M_S$ is attained when $\mu$ is a Dirac measure -- that is, when the r.v. $Y$ is a nonnegative constant $c$, so that  
$F(\mu)=c^a(EX^{a-1}-E^{a-1}X)_+^a=0$, because $1<a\le2$ and hence $EX^{a-1}\le E^{a-1}X$. So, the maximum of $F$ on the simplex $M_S$ is $0$, which completes the proof for the case $1\le a\le2$. 

Moreover, following the lines of the above proof, it should be clear that the inequality in question fails to hold in general for any $a>2$. Indeed, then, for instance, $F(\mu)=\frac12-(\frac12)^{a-1}>0$ if $Y=1$ and $P(X=0)=P(X=1)=1/2$, which implies $h'(0)>0$, which implies $h(t)>0$ for small enough $t>0$.