Different ways of thinking about the derivative

Question

In Thurston's philosophical paper, "On Proof and Progress in Mathematics", Thurston points out that mathematicians often think of a single piece of mathematics in many different ways. As an example, he singles out the concept of the derivative of a function, and gives seven different elementary ways of thinking about it:

(1) Infinitesimal: the ratio of the infinitesimal change in the value of a function to the infinitesimal change in a function.
(2) Symbolic: the derivative of $x^n$ is $nx^{n-1}$, the derivative of $\sin(x)$ is $\cos(x)$, the derivative of $f \circ g$ is $f' \circ g * g'$, etc.
(3) Logical: $f'(x) = d$ if and only if for every $\epsilon$ there is a $\delta$ such that when $0 \lt | \Delta x | \lt \delta, |\frac{f(x + \Delta x) - f(x)}{\Delta x} - d| \lt \delta$
(4) Geometric: the derivative is the slope of a line tangent to the graph of the function, if the graph has a tangent.
(5) Rate: the instantaneous speed of $f(t)$, when $t$ is time.
(6) Approximation: The derivative of a function is the best linear approximation to the function near a point.
(7) Microscopic: The derivative of a function is the limit of what you get by looking at it under a microscope of higher and higher power.

Thurston goes on to state that "The list continues; there is no reason for it ever to stop," so let's keep it rolling! Can you come up with other ways of thinking about the derivative? I should remark that this is a list of different ways of thinking about the derivative, which isn't the same thing as a list of different formal definitions of the derivative. Remember to limit yourself to one answer per post.

Answer 1

The derivative of a Regular Type is its Type of One-Hole Context

This is a surprising computational application related to Qiaochu's example, but different enough to warrant some explanation. Apologies for some of my hand-waveyness.

In a suitably pure programming language (like Haskell) we can think of data types as being objects of a category and functions (suitably qualified) as arrows. We often want to build one type from another. For example, given a type $X$ we can form the type $X\times X$, the type of pairs of $X$'s. Similarly we can form coproducts which correspond to objects that can be of one type or another. Eg. if $Y=X+X^2$ then $Y$ is a type which contains either an $X$ or a pair of $X$'s. The functions that construct one type from another, call them type constructors, can naturally be thought of as functors. So $P$ defined by $P(X)=X^2$ is a functor. If $(x,y)$ is in $X^2$ then $Pf(x,y)=(f(x),f(y))$. Types form a semiring.

Sometimes we want to make a 'hole' in a type constructors. If $F$ is a type constructor, then $F(A)$ can be thought of as a container of elements of type $A$. An "$F$ with a hole in it" is one of these containers but with one of its elements removed, but still keeping information about where the element was removed from. For example consider $F(X)=X^3$. $F$ makes triples of $X$'s. A triple with a hole in it consists of just two $X$'s as well as enough information to tell where the third element was removed from. There are just three places it could have come from, so we can describe the removal site using a type with just three elements. Call it $3$. So a triple with a hole in it is a pair consisting of an element of type $3$ and an element of type $X^2$. Ie. $3X^2$. This is $F'(X)$.

This works more generally. We make holes in type constructors by differentiating them.

It even works with recursive types. For example, a list of $X$'s is, by definition, either the empty list, or a pair consisting of an $X$ and a list. We have an equation

$L(X)=1+XL(X)$.

We can differentiate this to get

$L'(X)=L(X)+XL'(X)$

This gives a recursive equation for a type of a list with a hole in it. This is in fact an example of a type called a zipper. Used in many places such as this application. In the particular case of lists $L'(X)$ defines a pair of lists of $X$'s.

(Much of this applies in the category $Set$ but the recursive equations can introduce some issues of well-foundedness if taken too literally.)

Many of the usual properties of derivatives acquire straightforward computational interpretations: linearity, the product rule, the chain rule, even the Faà di Bruno formula.

Anyway, check out the papers which have none of the errors I've probably introduced. There's also a close relationship with combinatorial species.

(Curiously, you can also make sense of finite differences of types even though we only have a semiring and don't have subtraction of types.)

Answer 2

Algebraic: a derivation on a ring $R$ is an additive map $R \rightarrow R$ that satisfies the product rule (with suitable generalizations allowing modules, etc.)

This is related to the Symbolic way of thinking on Thurston's list, but is not identical to that (e.g., it leads to important characterizations of separability for field extensions).

Answer 3

There are two closely related interpretations of the derivative of a generating function in combinatorics.

• If $A(x) = \sum a_n x^n$ counts the number of $A$-structures on an $n$-element ordered set, then $A'(x) = \sum na_n x^{n-1}$ counts the number of ways to add a distinguished element to an $n-1$-element ordered set and to choose an $A$-structure on the result.

• If $A(x) = \sum \frac{a_n}{n!} x^n$ counts the number of $A$-structures on an $n$-element set, then $A'(x) = \sum \frac{a_n}{(n-1)!} x^{n-1}$ counts the number of ways to add an element to an $n-1$-element set and to choose an $A$-structure on the result.

Actually in combinatorics it is more natural (in both setups) to consider $x \frac{d}{dx}$, which is referred to as "pointing." This opens up a lot of interesting ideas; for example, one can interpret certain differential equations combinatorially and try to find their solutions symbolically.

Answer 4

Marsden & Weinstein use the "method of exhaustion" to define the derivative without limits.

Answer 5

I like a different geometric interpretation from the graphical one. If you think about a function $f : \mathbb{R} \to \mathbb{R}$ as a transformation on the real line $\mathbb{R}$, then the interpretation of $f'(x)$ is that it's the scaling factor of this transformation near the point $x$.

This interpretation is good for a geometric understanding of the change-of-variables formula for integrals. It also makes the chain rule pretty plain.

Answer 6

In smooth infinitesimal analysis, one can prove that a curve can't be a set of points but can instead be built out of line segments whose lengths are nilsquare infinitesimals (different from the infinitesimals of NSA, which obey the transfer principle). The derivative is then simply the slope of one such segment.

A good intro that doesn't require any knowledge of category theory is Bell, A primer of infinitesimal analysis.

Answer 7

I think the answers so far do not really take account of Kevin's remark:

I should remark that this is a list of different ways of thinking about the derivative, which isn't the same thing as a list of different formal definitions of the derivative.

We could just copy from http://en.wikipedia.org/wiki/Derivative_%28generalizations%29 or cite Fermat categories .... Perhaps this is an alternative way:

Smoothing: Continuity in $p$ asserts roughly that you can draw the graph in one line. Differentiabilty is the next step towards smoothness: The line has no zig-zags / edges. The derivative is then the direction of the line.

Answer 8

For me the derivative is a measure of a function's sensitivity to a small change in its input. So it tells you, for any given input, what the ratio of the change in output over the a small change in input (which caused the change in output).

Answer 9

If $R$ is a ring, then a derivation $\partial : R \to R$ is a vector field over the scheme $\mathrm{Spec} R$.

Answer 10

An algebraic definition which works for at least polynomials: Consider the ring $\mathbb{R}[dx]/(dx^2)$ the derivative of a function $f(x)\in \mathbb{R}[x]$ could be defined implicitly by $$f'(x)dx +(dx^2) = f(x+dx)-f(x)+(dx^2).$$

Answer 11

The intuitive idea is that the derivative is zero if there is a local minimum or maximum.

The derivative is then the (tangent of) the angle by which we have to rotate the graph around that point in order to get a local minimum or maximum.

You could probably cook up some sort of way to think about what happens when the function vanishes to odd order (first of all, no matter how you rotate it, there will not be a local minimum or maximum).