I like to expand on this (unanswered) [MSE question][1].

Take the following, nicely symmetrical, telescoping series for $\zeta(s)$:

$$\displaystyle \zeta(s) = \frac{1}{2\,(s-1)} \left(1+\sum _{n=1}^{\infty } \left( {\frac {n+1}{(n+1)^{s}}} - \frac{2\,(1-s)}{n^s}-{\frac {n-1}{\left( n-1 \right) ^{s}}}\right) \right), \qquad -1<\Re(s)<1$$

Now remove the $1$-term by subtracting $\sum _{n=1}^{\infty } \left( {\frac {1}{(n+1)^{s}}} - \frac{1}{n^s}\right)=-1$ from the series and we get the following, a bit less symmetrical, series that now also only converges in the critical strip:

$$\displaystyle \zeta(s) = \frac{1}{2\,(s-1)} \left(\sum _{n=1}^{\infty } \left( {\frac {n}{(n+1)^{s}}} - \frac{1-2\,s}{n^s} - {\frac {n-1}{\left( n-1 \right) ^{s}}}\right) \right), \qquad 0<\Re(s)<1$$ 

The numerator of the middle term is the only one dependent on $s$ and interestingly its real part only becomes $0$ when $\Re(s)=\frac12$. So, the numerator in the middle being purely imaginary seems to be a critical factor for exactly balancing the sum of the three divergent series to zero (assuming the RH). 

I would appreciate any suggestions/tips on how to better assess the impact of the middle term numerator on the total sum. I have not gotten much further than taking $s=\frac12$ and getting this simple expression: $$\displaystyle \zeta\left(\frac12\right) = \sum _{n=1}^{\infty } \left(\sqrt{n-1} -{\frac {n}{\sqrt{n+1}}}\right)$$.

Thanks.


  [1]: https://math.stackexchange.com/questions/1078948/are-these-known-telescoping-series-for-zeta-left-frac12-right