36
$\begingroup$

Terms like "in the natural way" or "the natural X" are used frequently in mathematical writing. While it is certainly clear most of the time what is meant, on occasion, I have been confounded. The word "natural" seems to be one of the most ambiguous terms used in formal mathematics. I have never seen anyone actually define it. People just use it and expect others to understand it.

What exactly is meant by "natural" in mathematical writing?

$\endgroup$
5
  • 7
    $\begingroup$ It isn't used consistently in mathematics, but in settings that are category-friendly there is a precise meaning, as Daniel Miller mentions. IMO this is for the best as words like "natural" are really primarily in the namespace (to bring in some CS terminology) of the English language and no subject should "own" it. $\endgroup$ Mar 1, 2011 at 0:06
  • 26
    $\begingroup$ A good rule of thumb is "the X which requires no arbitrary choices." I think this covers the less formal usages pretty well. $\endgroup$ Mar 1, 2011 at 0:50
  • 5
    $\begingroup$ ...A problem with that is that sometimes "the X which requires no choices" is ambiguous. $\endgroup$ Mar 1, 2011 at 1:26
  • 11
    $\begingroup$ @Qiaochu: Do you mean to say that there isn't a canonical name for such X? ;) $\endgroup$
    – Mark Grant
    Mar 1, 2011 at 7:01
  • 2
    $\begingroup$ I should say I noticed that 99% of authors (that I read) state that a certain morphism $f:X\to Y$ is a natural isomorphism (for instance) and 1% of them actually show naturality, the others considering that proving it is an isomorphism is all that's really needed. I think this does not help our beloved adjective to gain much reputation. $\endgroup$ Jul 20, 2012 at 4:58

11 Answers 11

36
$\begingroup$

Actually, there is an exact meaning, but it is not always used in that sense. For two functors $\mathsf F,\mathsf G:\mathscr A\to \mathscr B$ a natural transformation is a morphism of functors $\eta:\mathsf F\to\mathsf G$ that is compatible with the functors in the obvious (sic!) way.

For instance if $\mathsf F={\rm id}$ is the identity and $\mathsf G=(\underline{\quad} )^{*}$ is the dual of finite-dimensional vector spaces, then even though $\mathsf F(V)\simeq \mathsf G(V)$, there is no natural transformation between $\mathsf F$ and $\mathsf G$ that gives this isomorphism. On the other hand $\mathsf F$ is naturally isomorphic to $\mathsf D:=\mathsf G\circ\mathsf G$ via the natural transformation induced by the usual map to the double dual.

Of course, often people say "there is a natural choice of" whatever. That usually means that the "choice" actually does not involve a "choice". In other words, two different people would be expected to make the same choice.

There is however a danger involved that some authors overlook. There are situations when there are more than one natural choices to make. In other words, just because two choices are both natural, one should not assume that they are necessarily the same. For instance, often one can end up with $(-1)$-times the other choice (say for a map) and then whether they are equal or their sum is zero makes a big difference. For an example, consider choosing a generator of the infinite cyclic group, a.k.a., $(\mathbb Z,+)$. One might be led to believe that "the" natural choice of a generator for $(\mathbb Z,+)$ is $1\in \mathbb Z$, but as long as this is only a group there is no way to distinguish $1\in \mathbb Z$ and $-1\in \mathbb Z$. They both generate the group and they are each other's inverses. In other words, there are two natural choices of a generator of the group $(\mathbb Z,+)$. Of course, once it is a ring, then $1\in \mathbb Z$ is the unity, while $-1\in \mathbb Z$ is not, and there is only one choice for the unity, but actually then the question of this choice being natural is moot since there is only one choice at all, so it's kind of silly to say it is natural.

Addendum (to answer the question raised in the comment below by unknown)

A two dimensional vector space does not have a "natural" inner product. A two dimensional vector space with a chosen basis does: If $V$ is a vector space (over the field $k$) with basis $\mathbf v_1,\mathbf v_2\in V$ then one can define a "natural" inner product by $<\mathbf a,\mathbf b>:=a_1b_1+a_2b_2$ where $\mathbf a=a_1\mathbf v_1+a_2\mathbf v_2$ and $\mathbf b=b_1\mathbf v_1+b_2\mathbf v_2$. But this is only natural after the basis has been chosen. Basically the problem is that the definition of the inner product depends on the choice of the basis, so this definition is only natural if there is a natural choice of a basis (assuming there is no other structure present that could give a natural inner product; for more on this see the example of the wedge product below).

For instance if $V$ is given with a basis as above, then there is a natural choice of a basis (called the dual basis) for $V^*$ the dual space of $V$: Let $\phi_1: V\to k$ be defined by $\phi_1(\mathbf v_1)=1$, $\phi_1(\mathbf v_2)=0$ and extended by linearity and similarly $\phi_2: V\to k$ be defined by $\phi_2(\mathbf v_1)=0$, $\phi_2(\mathbf v_2)=1$ and extended by linearity. So, if you already have a chosen basis on $V$ you can find a natural choice of a basis on $V^*$ and with that you can find a natural choice of an inner product, but this will not be a natural choice if you consider the vector space without the given basis.

Otherwise, I agree, it is hard to tell what people mean by "natural". As said by many people in various answers, the essence is whether you can do the construction without making a sort of a random choice when choosing a different element would be equally good. In this example, to give an inner product you need to give a basis and unless you have some extra structure, choosing any given basis is equal to choosing any other, so the choice is non-natural.

On the other hand if there is some extra structure on the vector space then there may be a natural choice for an inner product, or more generally for a bilinear form. For instance if your vector space is a space of differential forms on a manifold, then there is no natural choice of basis, but there is a natural choice of an alternating bilinear form: the wedge product. This is actually pretty good, because this means that it is possible to define this on a manifold locally: picking a chart is a non-natural choice and defining the wedge product of two differential forms locally seems like it depends on a lot of choices, but it ends up being independent of these in the sense that choosing a different chart you get the same wedge product it just looks different because it is in a different basis.

Addendum 2 (I realized that this might be an interesting comment while writing this answer to another MO question).

Here is an example of the importance of naturality: Suppose $M$ is a manifold and $U\subseteq M$ and open set. Then there is a natural homomorphism from the ring of regular functions on $M$ to the ring of regular functions on $U$. (If you like adjust "regular" for your favourite category; continuous, smooth, holomorphic, etc.). It can happen that this homomorphism is an isomorphism and then it has nice consequences. However, it is often important that in order to get the nice consequence one needs that the homomorphism induced by the embedding is an isomorphism and not that there exists some isomorphism. In other words, one could say that the natural homomorphism (=the one induced by the embedding $U\subseteq M$) is an isomorphism. For an explicit example where this matters see the above mentioned answer.

$\endgroup$
7
  • 4
    $\begingroup$ The contradiction in "natural choice" is SO NICE! $\endgroup$ Mar 2, 2011 at 2:21
  • $\begingroup$ Hi, Sandor. Your answer and John Sidles' answer seem to be competing for the #1 spot. I know very little about category theory. I asked Sandor to try to explain your answer in terms of a simple example using a two-dimensional vector space and the "natural" inner product. Another thing that is still confusing me, is that even if there are "natural" choices under category theory, that still requires the reader take category theory as an assumption. If they do no such thing, I suppose it invalidates any formal notion and renders the word having only its "ordinary speech" definition. $\endgroup$
    – user6137
    Mar 3, 2011 at 16:12
  • $\begingroup$ Hi unknown, I am not sure what you are asking. I don't think there is a natural inner product on a two-dimensional vector space. But this may be what you are asking. I'll try to add something in the answer above. $\endgroup$ Mar 3, 2011 at 20:27
  • 1
    $\begingroup$ In some cases, there is no "natural" (in the plain English sense) choice of a natural transformation; and this is not something outlandish. For example, it comes up in the context of acyclic models in homological algebra. See Theorem 8 in Chapter Four, Section 2 of Spanier's algebraic topology. Every construction of a natural transformation involves choosing a basis. $\endgroup$ Mar 7, 2011 at 6:32
  • $\begingroup$ @Amritanshu: yes, my example of the wedge product is such a case. This was partly my point. $\endgroup$ Mar 7, 2011 at 7:20
26
$\begingroup$

Edit  As an example of the increasing prevalence of the notion of naturality in contemporary mathematics, it is notable that Shinichi Mochizuki’s four preprints asserting a proof of the ABC conjecture employ the word "natural" and its derivatives on more than six hundred occasions (for details and several related quotations, see this post on Gödel's Lost Letter and P=NP).


In accord with Daniel Miller's answer above, the study of "naturality" as a formal abstraction in mathematics can be traced back largely to two articles by Saunders Mac Lane and Samuel Eilenberg: Natural isomorphisms in group theory (1942) and General theory of natural equivalences (1945). Both articles are well worth reading.

How did these ideas arise? Roughly speaking, Eilenberg and MacLane began by recognizing that if an arbitrary choice of coordinates makes a difference to the quantities you are calculating and/or the theorems you are proving, then those quantities and theorems are not natural. Mac Lane has described this process in The development and prospects for category theory (1996) as follows:

I emphasize that the notions category and functor were not formulated or put in print until the idea of a natural transformation was also at hand.
Thus, one good start for students is to acquire a thorough practical grasp of naturality in the context of coordinate transformations in linear algebra and differential geometry.

A concrete example of a canonical usage of "naturality", which is accompanied by an extensive motivating discussion, is given in John Lee's Introduction to Smooth Manifolds as the following lemma:

Lemma 12.16: (Naturality of the Exterior Derivative)

If $G\colon M\to N$ is a smooth map, then the pullback map $G^\star\colon \mathcal{A}^k(N)\to \mathcal{A}^k(M)$ commutes with $d$. That is, for all $\omega \in \mathcal{A}^k(N)$, we have $G^\star(d\omega) = d(G^\star\omega)$.

As a commutative diagram the above lemma exhibits a canonical form:

$$\begin{array}{c@{}ccc@{}c} &&d&&\\ &\mathcal{A}^k(N)&\longrightarrow&\mathcal{A}^{k+1}(N)\\[2ex] G^\star\!\!\!\!\!\!&\big\downarrow&&\big\downarrow&\!\!\!\!\!\!\!G^\star\\[2ex] &\mathcal{A}^k(M)&\longrightarrow&\mathcal{A}^{k+1}(M)\\ &&d&& \end{array}$$

Being interested in practical applications of geometrically "natural" formalisms for quantum systems engineering, I've studied the usage in MacSciNet reviews of the words "natural*" (chiefly "natural" and "naturality") and "universal*" (chiefly "universal" and "universality").

Here are the numbers; their use is burgeoning!

  • Year-Range (natural*, universal*)
  • 2001-2005: (16788 uses, 05288 uses)
  • 1996-2000: (14880, 04977)
  • 1991-1995: (12550, 04432)
  • 1986-1990: (10335, 03343)
  • 1981-1985: (08775, 03013)
  • 1976-1980: (07402, 02412)
  • 1971-1975: (05668, 02040)
  • 1966-1970: (03466, 01167)
  • 1961-1965: (02211, 00610)
  • 1956-1960: (01368, 00406)
  • 1951-1955: (00880, 00253)
  • 1946-1950: (00502, 00107)
  • 1941-1945: (00251, 00060)

So to judge by the literature, it seems that we are entering into a Golden Era of mathematical "naturality" and "universality" ... we can hope so, anyway! :)

$\endgroup$
9
  • 6
    $\begingroup$ This is off-topic, but I can't resist: how did you manage to do that? $\endgroup$ Mar 1, 2011 at 1:27
  • 9
    $\begingroup$ The AMS MathSciNet site accepts wild card characters and year ranges -- thus searching the field "Review Text" for "natural*" captures all usages of both "natural" and "naturality. The arxiv's "full text search" option is wonderful too --- yes, the 21st century is paradise for lovers of history and lexicography! :) $\endgroup$ Mar 1, 2011 at 1:43
  • 4
    $\begingroup$ Google has an amazing tool to chart word and sentence usage through time. Sadly enough you can't select the subject. $\endgroup$ Mar 1, 2011 at 14:19
  • 2
    $\begingroup$ Yes, the above chart showing a 60-fold increase in MathSciNet reviews employing "natural*" was inspired by Google'AS ngrams showing for "naturality" a 6-fold increase in frequency in the years 1942-1992. Moreover, the arxiv's whole-text search engine shows us that usage of "naturality" is steadily leaking from mathematics into physics, computer science, and engineering. This reflects (IMHO) an ongoing, transformational change in the global STEM enterprise that originated largely in fundamental mathematical research begun in the 1940s; it shows us the power of mathematics to shape thinking. $\endgroup$ Mar 1, 2011 at 15:31
  • 8
    $\begingroup$ Clearly the use of "natural" is increasing, but is it increasing faster than the volume of MathSciNet? I would presume that both the total rate of mathematics production is going up, and also that MathSciNet comes much closer to indexing the full text of 2000 mathematics than 1945 mathematics. $\endgroup$
    – Max
    Mar 3, 2011 at 21:50
12
$\begingroup$

As several people have mentioned, there is a precise technical meaning in category theory. This does not fully capture the informal meaning. For example, consider the category $\mathbf{Groups}$ of groups and homomorphisms, and write $Z(G)$ for the centre of $G$. This does not give a functor $\mathbf{Groups}\to\mathbf{Groups}$ (because a homomorphism $\phi:G\to H$ need not carry $Z(G)$ into $Z(H)$), but it is certainly a natural construction in an informal sense. However, we can consider the subcategory $\mathbf{Groups}'$ of groups and isomorphisms, and then $Z$ will give a functor $\mathbf{Groups}'\to\mathbf{Groups}$. This kind of categorical naturality with respect to isomorphisms is much closer to the informal meaning. I would say that any informally natural construction is categorically functorial/natural with respect to isomorphisms, but there are counterexamples to the converse. For example, there is a forgetful functor $U:\mathbf{Rings}\to\mathbf{Sets}$ and a transformation $\alpha:U\to U$ given by

$$ \alpha_R(a) = 182567 a^{46} - 17576 a^9$$

This is a natural transformation in the sense of category theory, but obviously involves choices that are essentially arbitrary.

$\endgroup$
3
  • 3
    $\begingroup$ I disagree that this last transformation is not "natural" in informal sense. There is one such transformation for every polynomial with integer coefficients and the only "choice" we make is which polynomial to use. In other words we choose which transformation we define, but there is no "choice" involved in the definition of the transformation itself. The point is that this definition is uniform in the sense that one formula works equally well for an arbitrary ring $R$ and does not depend on any of its intrinsic properties... $\endgroup$ Mar 1, 2011 at 6:42
  • 5
    $\begingroup$ ...This is exactly the meaning of the word "natural" in the categorical context: transformation between functors defined on some category $\mathcal{C}$ is natural when its definition depends only on properties shared by all objects of $\mathcal{C}$. This is of course subjective, but it corresponds pretty well to my own informal understanding of the word "natural". $\endgroup$ Mar 1, 2011 at 6:42
  • 7
    $\begingroup$ Functors are of course not the only natural constructions in category theory. Taking automorphism groups is also quite natural. The center is a construction of this type, and there is nothing informal about this: Grp can be regarded as a 2-category whose objects are groups regarded as one-object categories, whose morphisms are functors between groups (group homomorphisms), and whose 2-morphisms are natural transformations of such functors. Then the 2-automorphisms of the identity morphism G -> G form a group isomorphic to Z(G). $\endgroup$ Mar 1, 2011 at 14:20
8
$\begingroup$

According to Mac Lane (as I remember it from Categories for the Working Mathematician), Eilenberg and Mac Lane invented categories so they could talk about functors, and they wanted to talk about functors so they could define "natural."

$\endgroup$
8
$\begingroup$

The sense in which "natural" is used by many modern mathematicians (as coming from natural transformation of functors) is different from "canonical" (which means that it does not involve making any choices beyond the data given). The fact that both these adjectives often apply to the same object (e.g., the embedding of a vector space in its double dual), should not serve as an excuse to confuse their meanings-something can be natural without being canonical, and something can be canonical without being natural, as I shall illustrate with examples from group theory.

For the record, here is the official definition of a natural transformation.

If $\mathcal C$ and $\mathcal D$ are categories, $F_1$ and $F_2$ are functors $\mathcal C\to \mathcal D$, then a natural transformation $F_1\to F_2$ is a family of morphisms $N(X):F_1(X)\to F_2(X)$ in $\mathcal D$ (one for each object $X$ of $\mathcal C$) such that for every morphism $f:X\to Y$ in $\mathcal C$, $N(Y)\circ F_1(f)=F_2(f)\circ N(X)$.

It should be noted that natural applies to a family of morphisms, not to a single morphism.

The groupoid associated to a group

Let $G$ be a group. Let $\mathcal C$ be the category with one object $*$, with $\mathrm{Hom}(*,*)=G$, composition being determined by the group law. This category $\mathcal C$ is known as the groupoid associated to $G$. Note that

  • A functor $F:\mathcal C\to \mathcal C$ is determined by what it does to morphisms (at the level of objects, it just takes $*$ to $*$). One easily checks that the monoid of functors $\mathcal C\to \mathcal C$ is isomorphic to the monoid of endomorphsims $G\to G$.
  • If $F_1$ and $F_2$ are two functors $\mathcal C\to \mathcal C$ (identify them with endomorphisms of $G$) then a morphism $g:*\to *$ (identify it with an element of $G$) is a natural transformation if and only if $g\circ F_1(h)=F_2(h)\circ g$ for all $h\in G$.

Natural, but not canonical

The natural endomorphisms of the identity functor $\mathcal C\to \mathcal C$ are the morphisms in the center of $G$. Only the identity element here could be considered canonical. The others would be non-canonical, at least until more data is provided.

Canonical, but not natural

If $F_1$ and $F_2$ are two distinct functors $\mathcal C\to \mathcal C$ (group homomorphisms $G\to G$), then the identity morphism $*\to *$ (which is indisputably canonical) is not a natural transformation $F_1\to \mathcal F_2$.

$\endgroup$
9
  • 1
    $\begingroup$ I'm afraid I don't understand your first example. Surely there is only one natural endomorphism of the identity functor, given by the morphism which sends * to *? $\endgroup$
    – Mark Grant
    Mar 2, 2011 at 8:19
  • 1
    $\begingroup$ Mark, there is in fact one morphism $*\to *$ for each element of $G$. $\endgroup$ Mar 2, 2011 at 9:09
  • 1
    $\begingroup$ Well, my problem was with the content. In particular, you have not explained why you need the center of $G$ and why you are talking about morphisms instead of endomorphisms. In particular, in your second example, what does a morphism (say the identity) has anything to do with a natural transformation. Yes, it is not a natural transformation, but my left shoe isn't either. $\endgroup$ Mar 7, 2011 at 7:19
  • 1
    $\begingroup$ I need the center of $G$ because $g\in G$ is a natural endomorphism of the identity functor if and only if $g\circ h=h\circ g$ for all $h\in G$ (this follows from the definition of a natural transformation). $\endgroup$ Mar 8, 2011 at 0:39
  • 1
    $\begingroup$ Where it says "If $F_1$ and $F_2$ are two functors $∗\to∗$", it should say "If $F_1$ and $F_2$ are two functors $\mathcal C\to\mathcal C$". $\endgroup$ Jun 7, 2011 at 23:00
6
$\begingroup$

I'm not sure if this is what you are looking for, but the word "natural" is often used to imply that the object being discussed is in fact a Natural Transformation. For example, the isomorphism $V\cong V^{**}$ between a finite dimensional vector space and its double dual is natural in the sense that it is a natural isomorphism between functors. The same holds for the isomorphism $G/\mbox{Ker}\:\phi\cong H$ when $\phi:G\to H$ is a surjective homomorphism and $G,H$ are groups.

$\endgroup$
2
  • $\begingroup$ Possibly I am confused, but do you really mean to say 'the isomorphism between a vector space and its dual'? $\endgroup$
    – user9072
    Mar 1, 2011 at 0:26
  • 4
    $\begingroup$ It should say "the isomorphism $V\cong V^{**}$ between a finite-dimensional vector space and its double dual" (given by $v\mapsto$ evaluation on $v$). $\endgroup$ Mar 1, 2011 at 0:56
5
$\begingroup$

One issue I have with all of the answers is that mathematical writing is writing by humans. Much of the language in a mathematical paper written by a human is plain language, intended to impart understanding from one human to another human, rather than formal language intended to codify a proof. In proving many existence theorems, one has to make a rather wild guess at the definition of the object whose existence is asserted, long before one is able to carry out the actual proof that the object satisfies all of the required properties of the theorem. Such wild guesses have many different motivations in humans. I often use the word "natural" to let my reader know what motivated me to guess at the right object. Sometimes the motivation was background knowledge or experience, sometimes it was just blind intuition which I cannot account for, and sometimes it is motivated by what felt "natural". I would not assert that there is any formal mathematical definition for this use of "natural". I suppose we'll have to wait to see what happens with this term once mathematical papers are written by computers to impart understanding from one computer to another.

$\endgroup$
0
4
$\begingroup$

There is a book called Natural operations in differential geometry, which as far as I know captures what natural means for a differential geometer. Natural bundles are defined basically as functors from the category of manifolds with local diffeomorphisms to the category of fibered manifolds. Natural operator between natural bundles is then a local operator which commutes with local diffeomorphisms.

$\endgroup$
3
$\begingroup$

Typically, there is no exact meaning, beyond 'reasonable or expected in a particular situation' as in plain English.

One thing that is close to giving a precise meaning to 'natural' is given in Daniel Miller's answer.

However, not at all every usage of 'natural' in mathematical writing falls into this category. So, the situation is just as you describe: the choice or the way was the only one that seemed reasonable to the author and thus it was the natural one. And, yes, sometimes when reading it this can be frustrating. Though, I should add, that avoiding to write it (and similar things) can be really hard.

Assuming you are not yet reading mathematics for too long a time, let me end this, in some way unhelpful, answer by mentioning that over time one develops the same or a similar sense of 'reasonable and expected' as most authors (at least in ones field of expertise) and thus the situation (at least subjectively) becomes considerably better over time.

Note: I am a different unknown.

$\endgroup$
1
  • $\begingroup$ @Quid: When I wrote my (much more recent) answer I somehow overlooked yours, which is closest in spirit to what I was trying to say. $\endgroup$
    – Lee Mosher
    Jul 20, 2012 at 13:42
2
$\begingroup$

I perceive that a "natural" solution to a problem differs from other solutions in that in addition to all the properties of other solutions, it also satisfies some additional requirements which either particularly useful for the solution's purpose or greatly simplify the expressions.

Just for example, when one speaks about interpolation of a function over a number of points, the "natural" solution will differ from the infinitely many other solutions in that it will also satisfy certain functional equations of the original function not only on the domain of definition of the original function, but also in the intermediate points. Thus one can speak about natural generalization/interpolation of the function.

For example, Gamma function is a natural generalization of factorial (up to a shift) because in addition to satisfying the functional equations of factorial in integer points it also satisfies the same equations in other points and has other useful properties.

The exponential function with base e is also natural in that in addition to having all properties of exponential function it also has a unique property of being its own derivative.

$\endgroup$
-2
$\begingroup$

For me, a natural constraint on some parameters in a theorem, is that without these constraints, either the theorem is false for obvious reasons, or trivial on the complement of the constraints but the proof method needs these constraints.

For example, in many theorems, it is natural to consider only odd primes.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.