Skip to main content
3 of 4
added 312 characters in body
Carlo Beenakker
  • 188.3k
  • 18
  • 448
  • 651

The OP asks for a "reputable source", I would think that Press and Teukolsky's Numerical Recipes [section 5.7 in The Book] qualifies as such. As they explain, if you approximate $f'(x)\approx h^{-1}[f(x+h)-f(x)]$ the truncation error (from higher order terms in the Taylor expansion) is of first order in the small increment $h$. You can improve this to a truncation error of second order by symmetrizing, $f'(x)\approx (2h)^{-1}[f(x+h)-f(x-h)]$.

This can be readily generalized to higher order derivatives, just by repeatedly differentiating each term. The second derivative becomes $$f''(x)=h^{-2}\left[f(x+h)+f(x-h)-2f(x)\right].$$

This is discussed in some detail at this MSE question.

Carlo Beenakker
  • 188.3k
  • 18
  • 448
  • 651