Is there a reason why integrals are so much easier to evaluate than sums? - MathOverflow

Is there a reason why integrals are so much easier to evaluate than sums?

2011-02-18T00:19:18Z

One possibility is the integration by substitution formula. But this doesn't explain why $\int_1^{\infty}x^{-3}dx$ is easy to evaluate (and rational) whilst $\sum_1^{\infty}n^{-3}$ is unknown (and seemingly not a simple combination of well known numbers). It is true that $x^{-3}$ has a simple inverse derivative whilst $n^{-3}$ does not have a known simple inverse difference, but is there more to it than that?

Answer by Robby Slaughter for Is there a reason why integrals are so much easier to evaluate than sums?

2011-02-18T00:26:34Z

It might be more accurate to suggest that we are more familiar with easy integrals than easy sums.

That is, there has been much more work done (and certainly much more practical experience, especially among engineers and scientists) with integrals than sums. The world is (seems) mostly continuous, so we focus primarily on integration.

That might seem like a non-answer but it's the one that comes to mind.

Answer by Gerhard Paseman for Is there a reason why integrals are so much easier to evaluate than sums?

2011-02-18T00:31:21Z

It depends on the object being summed/integrated. There are examples of sums that are handled by the theory of hypergeometric functions whose integrals would probably defeat most CAS systems out there.

They are different because the methods to simplify both processes are different. The focus (in American education) on the integral is because there were more examples of application in the mid 20th century. With the advent of algorithm design and applied combinatorics, more weight is being placed on evaluation of sums; even so, I think it is safe to say that integration will continue to be emphasized over summation for the near future.

Gerhard "Ask Me About System Design" Paseman, 2011.02.17

Answer by Sándor Kovács for Is there a reason why integrals are so much easier to evaluate than sums?

2011-02-18T00:41:22Z

This is a layman's answer. I'm by no means near an expert on integrals.

My first reaction to this question was that I am not sure that I agree and that since sums are integrals, this does not even make sense. Then I realized that the statement can be rephrased as

Continuous functions are easier to integrate than discontinuous ones

If we put it that way then perhaps the answer is

a) a lot of things are easier to do with a continuous function, or

b) in particular it is easier to find the indefinite integral of a continuous function than of a discontinuous one. Especially since the second one cannot have a nice anti-derivative (For instance it cannot be continuously differentiable for one).

Disclaimer This is a soft-answer and is not intended to contain mathematically rigorous statements or self-evident truths.

Answer by Theo Johnson-Freyd for Is there a reason why integrals are so much easier to evaluate than sums?

2011-02-18T02:04:32Z

I'm not sure this question is appropriate for MO, but I'll play along. One of the main reasons integrals of elementary functions are easier to algebraically evaluate than sums of elementary functions is that derivatives are much better behaved than differences. For a fairly mellow example, consider the product rule: $$ \partial(f\cdot g) = (\partial f)\cdot g + f\cdot (\partial g) \quad\quad \Delta(f\cdot g) = (\Delta f)\cdot g + f\cdot (\Delta g) + (\Delta f) \cdot (\Delta g)$$ (Here $\Delta f(n) = f(n+1) - f(n)$, and $\partial$ is the usual smooth derivative; $\cdot$ denotes multiplication.) So "integration by parts" is slightly simpler than "summation by parts". But since there exists a product rule for differences, there also exists a "summation by parts" formula.

On the other hand, there is no chain rule for differences: $$ \partial(f\circ g) = ((\partial f) \circ g) \cdot \partial g \quad\quad \Delta(f\circ g) = ?????$$ If you try to write down chain rules, you'll find they're very complicated, and require weird appearances of integrals/sums.

The chain rule for derivatives is precisely the u-substitution formula for integrals, and as you say in your question, there is no similar formula for sums.

Related to both of these is that power functions $n\mapsto n^\alpha$ have very nice derivatives and not-nice differences. At least the difference of a polynomial is a polynomial, but in general in a function with non-smooth parts / poles (like $n\mapsto n^\alpha$ for $\alpha \not\in \mathbb N$), taking differences generally create more poles. So it's extremely hard to imagine anti-differencing a function with only one pole — the antidifference would have to have many poles, that magically almost cancel upon differencing.

However, I'd like to emphasize that all of this answer has to do with algebraic methods (finding "closed form expressions"). $\sum_{n=1}^\infty n^{-3}$ is a perfectly good number, and $m \mapsto \sum_{n=1}^m n^{-3}$ is a perfectly good sequence; it's just that we don't know the answer to certain questions about them, and we can't write them as compositions of a certain very restricted set of symbols. One can compute these things very accurately. For any given $m$, I can, with a little time, give you the value of $\sum_{n=1}^m n^{-3}$ as a rational number. I can also compute, again given enough time, $\sum_{n=1}^\infty n^{-3}$ to as good accuracy as you want. Indeed, I can compute it more accurately (i.e. faster for a given accuracy) than I can for some other functions that you do have in your limited vocabulary of "basic" functions (assuming your vocabulary is what I expect it is).

Answer by Ramsey for Is there a reason why integrals are so much easier to evaluate than sums?

2011-02-18T03:25:07Z

While I don't really think that this is an answer to your question in the generality that you ask it (indeed, it says nothing of the one example you cite), here is something that comes to mind.

Integrals of $x^n$ for positive $n$ are much simpler than sums of $x^n$. The reason is that in evaluating the former, one first evaluates the latter and then passes to a limit. It is in this limiting process that all the "hard stuff" vanishes, and one is basically left with leading terms. In other words, in this case, the limiting processes of calculus eliminate all but what is, on some level, dominant behavior.

The same (vague) argument can be made of derivatives versus differences (as in Theo's answer). Finite differences may as well be hugely large scale differences - there's no objective scale. Derivatives, on the other hand, capture something that is in retrospect much simpler - truly local behavior.

Answer by Kevin O'Bryant for Is there a reason why integrals are so much easier to evaluate than sums?

2011-02-18T06:24:12Z

Well, some things are easier in one place, and other things are easier in the other. The many assertions in answers that integrals of $x^n$ are easier than the corresponding sums is misleading. In the continuous world, $x^n$ is a very natural object. In the discrete world, however, the natural object is the falling factorial: $x^{\underline{n}}$ is defined as $x(x-1)\dots(x-n+1)$. Compute the derivative of $x^{\underline{n}}$ and you get a mess. Compute the forward difference and you get the beautifully simple $f(x+1)-f(x) = (x+1)^{\underline{n}} - x^{\underline{n}} = n x^{\underline{n-1}}$.

That is, $$\sum_{i=1}^n i^9= \frac{1}{20} n^2 (n+1)^2 \left(n^2+n-1\right) \left(2 n^4+4 n^3-n^2-3 n+3\right)$$ is a little messy. Certainly messier than $\int x^9 dx$. On the other hand,
$$\sum_{i=1}^n i^{\underline{9}} = \frac1{10} (n+1)^{\underline{10}}.$$ while the integral $\int x^{\underline{9}}dx$ is bad enough that I dare you to work it out by hand.

The truth here is that the discrete world is often easier (and more fundamental, too), but history has prejudiced us to be more familiar with the continuous world. Zeilberger (who else?) has written passionately about this, and if you know of other sources for discrete calculus (online or off) please add them as comments to this answer!

Answer by Richard Stanley for Is there a reason why integrals are so much easier to evaluate than sums?

2011-02-18T17:39:41Z

Riemann integrals are defined to be limits of sums. In this context, integrals are easier since if we can evaluate the sums explicitly then the limit is generally straightforward to compute. For instance, let $\mathcal{P}$ be a convex polytope with integer vertices. Let $i(\mathcal{P},n)$ be the number of integer points in the dilation $n\mathcal{P}$, $n\geq 1$ (the Ehrhart polynomial of $\mathcal{P}$). Often one can express $i(\mathcal{P},n)$ as an iterated sum, and one can express the volume of $\mathcal{P}$ as a completely analogous iterated integral. By the definition of Riemann integral, the leading coefficient of $i(\mathcal{P},n)$ is the volume of $\mathcal{P}$, so the integral is easier to compute. As a specific example, let $\mathcal{P}$ be the triangle with vertices $(0,0), (1,0), (0,1)$. The iterated sum is $\sum_{j=0}^n\sum_{k=0}^j 1 = {n+2\choose 2}$, while the iterated integral is $\int_{x=0}^1\int_{y=0}^x 1\hspace{.1em}dy\hspace{.1em}dx = 1/2$.