The constraints can be reformulated as linear matrix inequalities (LMIs). In the book "Convex Optimization" by Boyd and Vandenberghe, LMI first shows up in the Example 2.10. Please see the following:
First, reformulate the constraint $\frac{(x+y)^2}{\sqrt{y}} \leq x - y + 5$ as a matrix inequality. Moving everything to one side, we have $x - y + 5 - \frac{(x+y)^2}{\sqrt{y}} \geq 0$. Follow Appendix A.5.5 in Boyd and Vandenberghe and define $A:=\sqrt{y}, B:=(x+y), C:=x-y+5$, we have the original inequality as $S:=C - B^\top A^{-1}B \geq 0$. Note that $A=\sqrt{y} > 0$ as $y>0$. Observe that $S$ is actually the Schur complement of $A$ in $X$ defined in the following:
$$X:=\begin{bmatrix} x-y+5 & x+y \\ x+y & \sqrt{y} \end{bmatrix}.$$
With the condition for positive definiteness of Schur complement, the following is true:
$$ A > 0, S > 0 \Leftrightarrow X \succ 0 \tag{1}.$$
Hence, the first constraint with fraction can be rewritten as the matrix inequality $X\succ 0$.
Second, we introduce a slack variable $s$ and reform LMI (1) as the following constraints:
$$\begin{align}
\begin{bmatrix} x-y+5 & x+y \\ x+y & s \end{bmatrix} \succ 0 \tag{2} \\
\sqrt{y} > s > 0 \tag{3}
\end{align}$$
Lastly, taking square of the first part of inequality (3) on both side and appy Schur complement again to get the following LMI:
$$
\begin{bmatrix} y & s \\ s & 1 \end{bmatrix} > 0 \tag{4}
$$
With the above three steps, you can represent the set in your problem as the set described by LMI (2) and (4). Since the LMI are affine in all decision variables, the set is convex.