This is a very interesting conjecture of large scale property of hypergeometric distribution.
Let $a>1$ be a integer constant, $N\in\mathbb{N_+}$, for any $x<N-1$, consider $N+(a-1)x$ balls in a bag, in which $ax$ of them are colored white and the other $N-x$ are colored black. Now randomly select $N$ balls without replacement from the bag. Let random variable $X$ denote the number of white balls selected. For another $y=x+1$, we also select $N$ balls from a bag with $N+(a-1)y$ balls, in which $ay$ are colored white, then we get a similar random variable $Y$.
In short, $X \sim H(N+(a-1)x,ax,N)$ and $Y \sim H(N+(a-1)y,ay,N)$, with $y=x+1$.
We want to prove that $\mathbb{E}(\frac{xy}{X}-\frac{xy}{Y})\rightarrow \frac{1}{a}$, when $N\rightarrow\infty$. The convergence is uniform w.r.t to $x$, namely, the convergence rate is independent of $x$. (For large enough $N$, the expectation can be arbitrarily close to $1/a$, regardless of which $x<N-1$ we choose. See the comment of the first answer.)
It is likely that the convergence must use a suitable coupling of $X$ and $Y$.