The unreasonable effectiveness of Padé approximation I am trying to get an intuitive feel for why Padé approximation works so well. Given a truncated Taylor/Maclaurin series it "extrapolates" it beyond the radius of convergence.
But what I can't grasp is how it manages to approximate the original function better than the series itself does, having only "seen" the information present in the series and without having access to the original function. My naive feeling is that if you start with the Taylor series, you can't do better than it in terms of approximation error, only in terms of, say, stability or computation time. But obviously the Padé approximation does do better. So — what explains its "unreasonable effectiveness"?
UPDATE: Here is a graph from p.5 of Baker and Graves-Morris - Padé Approximants, 2nd ed., that illustrates the phenomenon that puzzles me.
 (source)
 A: Your intuition is correct but the quality of any approximation lies with the remainder (of the truncated series). Pade's approx. will not be better than Taylor's in the vicinity of the approximated point (e.g. around x = a). However, the remainder/error term diverges fast the farther we are from x = a. For Taylor expansion truncated at the nth term it diverges as (x-a)^(n+1)! For pade expansion it also diverges but at much slower rate. This is why it is considered “better than” Taylor’s expansion.
A: There is plenty of mathematics, eg. by D.J. Newman, to show that analytic functions on a neighborhood of the disk can be approximated extremely well on the disk by rational functions. The pade approximation to the exponential function at zero does exceptionally well. Just because there is a power series definition of $\exp$ does not make it the best choice. For example, the $\exp$ function has no zeroes. The polynomial of degree $k$ has $k$ zeros. The pade approximation has $k/2$ zeros and poles. Turns out they are better positioned.
Why does anyone think a power series approximation that touches to maximal degree somehow do better than a rational approximation with a similar maximal touching?
A: The function used in the example has an asymptotic value of $1/2$ as $x\to \infty$
A Maclaurin expansion will only either go to infinity or negative infinity as x goes to infinity.  In order to match for a little while, different powers of x have to be balanced, but that balance won't last for long.
The thing that makes Pade's expansion incredible is that a Pade expansion can match the asymptotic behavior of functions like the one given. A simple approximation like $$y=\frac{1+x}{1+2x}$$ will approach the same asymptotic and at about the same rate.
A: My intuition is based on a few things. One, Pade approximants are a generalization of the Taylor series, in that by finding the Pade approximate of a rational function from its Taylor series, one might actually find the the exact rational function itself, which is not possible with Taylor series. Second, this accounts for singularities since the approximations are rational and third, if a function tends to a specific value one can use the $n/n$ approximant to obtain accurate global behavior or, if it tends to that value and then diverges from it after a while, still the approximant covers that behavior also. I think the added value comes not from the coefficient information but from the information of the cleverness put in by Pade himself. Sometimes mathematical restructuring is information enough itself.
