# If d/dx is an operator, on what does it operate?

If $\frac{d}{dx}$ is a differential operator, what are its inputs? If the answer is "(differentiable) functions" (i.e., variable-agnostic sets of ordered pairs), we have difficulty distinguishing between $\frac{d}{dx}$ and $\frac{d}{dt}$, which in practice have different meanings. If the answer is "(differentiable) functions of $x$", what does that mean? It sounds like a peculiar hybrid of mathematical object (function) with mathematical notation (variable $x$).

Does $\frac{d}{dx}$ have an interpretation as an operator, distinct from $\frac{d}{dt}$, and consistent with its use in first-year Calculus?

-
I don't think this is, at least as stated, a good question for MO (and apparently I am not the only one, because I did not go as far as to downvote). Also, I would challenge some of your assumptions. The notation $\frac{df}{dx}$ is used very frequently in the books I'm reading, for instance. Also, does $\frac{d}{dx}$ denote a single operator? As Poincare remarked: "Mathematics is the art of giving the same name to different things". – Thierry Zell Dec 4 '12 at 16:30
Mathematics is a human activity, hence it often benefits from some en.wikipedia.org/wiki/Abuse_of_notation – Qfwfq Dec 4 '12 at 17:14
Jason -- you could try asking this on math.stackexchange.com; there is a chance you'll get a detailed answer there. – algori Dec 4 '12 at 17:39
I find this question to be both deeper and more interesting than it appears by the comments that some others here do. So I have voted to reopen, and would look forward to reading a thoughtful answer that takes the issue seriously. – Joel David Hamkins Dec 4 '12 at 18:10
I've always thought of $x$ as just a choice of coordinate on the $1$-manifold $\mathbb R$ (i.e. picking a diffeomorphism with a standard'' copy of $\mathbb R$). Without choosing coordinates, we have for each function $f:\mathbb R \to \mathbb R$ a linear operator $df$ on each tangent space. Picking a coordinate function $x$ allows us to express these as numbers, hence we get a function $df/dx$. – Sam Gunningham Dec 4 '12 at 23:41

(From the post on my blog:)

To my way of thinking, this is a serious question, and I am not really satisfied by the other answers and comments, which seem to answer a different question than the one that I find interesting here.

The problem is this. We want to regard $\frac{d}{dx}$ as an operator in the abstract senses mentioned by several of the other comments and answers. In the most elementary situation, it operates on a functions of a single real variable, returning another such function, the derivative. And the same for $\frac{d}{dt}$.

The problem is that, described this way, the operators $\frac{d}{dx}$ and $\frac{d}{dt}$ seem to be the same operator, namely, the operator that takes a function to its derivative, but nevertheless we cannot seem freely to substitute these symbols for one another in formal expressions. For example, if an instructor were to write $\frac{d}{dt}x^3=3x^2$, a student might object, "don't you mean $\frac{d}{dx}$?" and the instructor would likely reply, "Oh, yes, excuse me, I meant $\frac{d}{dx}x^3=3x^2$. The other expression would have a different meaning."

But if they are the same operator, why don't the two expressions have the same meaning? Why can't we freely substitute different names for this operator and get the same result? What is going on with the logic of reference here?

The situation is that the operator $\frac{d}{dx}$ seems to make sense only when applied to functions whose independent variable is described by the symbol "x". But this collides with the idea that what the function is at bottom has nothing to do with the way we represent it, with the particular symbols that we might use to express which function is meant. That is, the function is the abstract object (whether interpreted in set theory or category theory or whatever foundational theory), and is not connected in any intimate way with the symbol "$x$". Surely the functions $x\mapsto x^3$ and $t\mapsto t^3$, with the same domain and codomain, are simply different ways of describing exactly the same function. So why can't we seem to substitute them for one another in the formal expressions?

The answer is that the syntactic use of $\frac{d}{dx}$ in a formal expression involves a kind of binding of the variable $x$.

Consider the issue of collision of bound variables in first order logic: if $\varphi(x)$ is the assertion that $x$ is not maximal with respect to $\lt$, expressed by $\exists y\ x\lt y$, then $\varphi(y)$, the assertion that $y$ is not maximal, is not correctly described as the assertion $\exists y\ y\lt y$, which is what would be obtained by simply replacing the occurrence of $x$ in $\varphi(x)$ with the symbol $y$. For the intended meaning, we cannot simply syntactically replace the occurrence of $x$ with the symbol $y$, if that occurrence of $x$ falls under the scope of a quantifier.

Similarly, although the functions $x\mapsto x^3$ and $t\mapsto t^3$ are equal as functions of a real variable, we cannot simply syntactically substitute the expression $x^3$ for $t^3$ in $\frac{d}{dt}t^3$ to get $\frac{d}{dt}x^3$. One might even take the latter as a kind of ill-formed expression, without further explanation of how $x^3$ is to be taken as a function of $t$.

So the expression $\frac{d}{dx}$ causes a binding of the variable $x$, much like a quantifier might, and this prevents free substitution in just the way that collision does. But the case here is not quite the same as the way $x$ is a bound variable in $\int_0^1 x^3\ dx$, since $x$ remains free in $\frac{d}{dx}x^3$, but we would say that $\int_0^1 x^3\ dx$ has the same meaning as $\int_0^1 y^3\ dy$.

Of course, the issue evaporates if one uses a notation, such as the $\lambda$-calculus, which insists that one be completely explicit about which syntactic variables are to be regarded as the independent variables of a functional term, as in $\lambda x.x^3$, which means the function of the variable $x$ with value $x^3$. And this is how I take several of the other answers to the question, namely, that the use of the operator $\frac{d}{dx}$ indicates that one has previously indicated which of the arguments of the given function is to be regarded as $x$, and it is with respect to this argument that one is differentiating. In practice, this is almost always clear without much remark. For example, our use of $\frac{\partial}{\partial x}$ and $\frac{\partial}{\partial y}$ seems to manage very well in complex situations, sometimes with dozens of variables running around, without adopting the onerous formalism of the $\lambda$-calculus, even if that formalism is what these solutions are essentially really about.

Meanwhile, it is easy to make examples where one must be very specific about which variables are the independent variable and which are not, as Todd mentions in his comment to David's answer. For example, cases like

$$\frac{d}{dx}\int_0^x(t^2+x^3)dt\qquad \frac{d}{dt}\int_t^x(t^2+x^3)dt$$

are surely clarified for students by a discussion of the usage of variables in formal expressions and more specifically the issue of bound and free variables.

-
I am grateful to Joel for his support of the question, including this interesting answer. Certainly $\frac{d}{dx}$ is similar to a quantifier: It "shields" occurrences of the variable $x$ in its scope from direct substitution. It is defined in terms of the limit, which also binds a variable, as a quantifier could. It is a very strange quantifier, though, as $x$ once again occurs free in the ("bound"?) expression $\frac{d}{dx} x^3$ since $\frac{d}{dx} x^3 = 3x^2$. – Jason Howald Dec 6 '12 at 19:35
Jason, yes, I agree with that. (Quid, I'd have to say that I enjoy your more mathematically substantive comments much more.) – Joel David Hamkins Dec 6 '12 at 23:53
@Joel David Hamkins: I deleted my comment (after all it is under your answer). However, the pattern of behavior (in my perception) showed by OP is something I find problematic for the site. But well I will live with this. – user9072 Dec 7 '12 at 7:25
@quid: if there is a pattern of behavior that you think is problematic enough to refer to publicly, then you should probably voice your concerns at meta. – Todd Trimble Dec 7 '12 at 8:40
@quid: this will be my last comment on this topic. Of course you are entitled to your opinion. My own opinion is that you are reading way too much into this, and seemingly getting huffy over very little. The OP has hardly said anything at all: he just asked two brief questions and a made a pertinent comment, last I checked. I don't really care if you open a meta discussion, but it would be better to discuss this issue there, if you want to get anything off your chest, and stick to mathematical issues here. Again that's just my opinion. – Todd Trimble Dec 7 '12 at 18:26

I repeat (a variant of) my comment, even though I agree that it is shallow and has low entertainment value.

As long as we are only looking at functions in one variable, there is only one differential operator $D$, which may be called $\frac d{dx}$ or $\frac{d}{dt}$ depending on the context.

If you look at a composite function $f \circ g$, you may introduce the notation/abbreviation $x=g(t)$, $y=f(x)$, then

• $\frac {d}{dx} f$ or $\frac d {dx} y$ is just $D(f)$,
• and by $\frac{d}{dt} f$ or $\frac d{dt} y$ you mean $D(f\circ g)$.

So here both $\frac {d}{dx}$ and $\frac {d}{dt}$ have a meaning, and the meaning is different.

When we look at functions in, say, two variables (do they appear in first year calculus?), we implicitly introduce an (arbitrary) order of variables, say x is the first and t the second, and $\frac{\partial}{\partial x}$ is the partial derivative with respect to the first variable. This makes sense even if you treat functions as "variable-agnostic" sets of ordered pairs. (Which I do all the time, and do not find peculiar at all. Tastes differ.)

Of course, the intended meaning always depends on the context. If $f$ is a binary function, $\frac d {dt} f$ may be a variant notation for $\frac{\partial}{\partial t}f$, or it may be understood that we are really looking at a unary function $\hat f$ obtained by composing $f$ with some function $t \mapsto (x(t), y(t))$.

-

Two answers: (1) Distribution theory. On the space $\mathcal D'(\mathbb R)$ of continuous linear forms on $\mathcal D(\mathbb R)=C_c^\infty(\mathbb R)$ it is easy to define the first derivative: $$\langle\frac{du}{dx},\phi\rangle_{\mathcal D'(\mathbb R),\mathcal D(\mathbb R)}= -\langle u,\frac{d\phi}{dx}\rangle_{\mathcal D'(\mathbb R),\mathcal D(\mathbb R)}.$$ You get the ordinary derivative of a differentiable function, also $H'=\delta$ ($H$ is the Heaviside function, characteristic function of $\mathbb R_+$, $\delta$ the Dirac mass), $$\frac{d}{dx}(\ln \vert x\vert)=\text{pv}\frac{1}{x}$$ and many other classical formulas. In particular, you can define the derivative of any $L^1_{loc}$ function, of course not pointwise but as above.

(2) Operator theory. In $L^2(\mathbb R)$, you consider the subspace $H^1(\mathbb R)=${$u\in L^2(\mathbb R), u'\in L^2(\mathbb R)$}, where the derivative is taken in the distribution sense. Then the operator $d/dx$ is an unbounded operator with domain $H^1(\mathbb R)$. It is even possible to prove that the operator $\frac{d}{idx}$ is selfadjoint.

-
I do not think this answers the question in any way, however it highlights a shortcoming of it. So thanks for the long comment. – user9072 Dec 5 '12 at 11:22
@quid: How is "d/dx can be viewed as an operator on distributions/Sobolev spaces" not an answer in any way to "on what does d/dx operate/what are its inputs"? What are the particular shortcomings of the question you have in mind? – Martin Dec 5 '12 at 12:41
@user49437: Is now $d/dt$ also an operator on this space? If so, is it the same as $d/dx$ or perhaps the zero-operator or still something else. While what you quote is in the title the actual question was definitely not about giving spaces where a derivative is 'nicely' definable. One shortcoming of the question is that it does not make precise what $d/dx$ should even mean at all. There are, any number of ways to define some map somewhere one might reasonaby call '$d/dx$' consistent with calculus; specifically, is the context strictly single variable or not (cf Goldstern) – user9072 Dec 5 '12 at 14:09
Thanks for the clarification. Well, I still think this does provide an answer to the the title + the first and last sentences without "distinct from d/dt". The rest of the post is apparently homotopic to an interesting question that eludes me so far, so I'm curious to see what answer Joel David Hamkins has prepared... – Martin Dec 5 '12 at 17:09
@user49437: You are welcome. And, it is true what you say, but it is my understanding the point of the question is precisely and only the 'distinct from d/dt' thing. But I agree it is not quite clear what OP wants. – user9072 Dec 5 '12 at 17:24

I am a little late to the question but wanted to add a low-tech answer which somehow complements JDH's answer:

The operators $\frac{d}{dx}$ and $\frac{d}{dt}$ are as distinguishable as $f(x)$ and $f(t)$.

Probably this formulation is a little too vague but it should just reflect that writing $d/dx$ says how one has named the free variables. As already illustrated, one gets into notational ambiguities in cases as $\frac{d}{dt} f(t,x(t))$...

-

Edit: obviously some people didn't realise this answer was tongue-in-cheek. Also, I read the question differently to others, given its ambiguity, and didn't bother with the last (possibly most crucial) part of the question.

The gist of my answer was an expansion of Sam Gunningham's comment, namely that the operator "$\frac{\mathrm{d}}{\mathrm{d}x}$" is actually the restriction of a functor on the category of pointed smooth manifolds and pointed maps, to the subcategory consisting of 1-dimensional vector spaces over $\mathbb{R}$. The idea of coordinate-independence is captured in the principle of equivalence (the violation of which used to jokingly be called "evil" by some people), in that mathematics can't tell the difference between diffeomorphic manifolds, and so whatever we call this operator, $\frac{\mathrm{d}}{\mathrm{d}x}$ or $\frac{\mathrm{d}}{\mathrm{d}t}$ or what-have-you, they are all naturally isomorphic, and so indistinguishable in the 1-variable case. I do take the point, hashed out in the comments below, that in the multi-variable case things are more subtle, and I cede to Golderstern's answer.

But the punchline is that the category of manifolds can be defined in many different ways: from material sets, from structural sets, via synthetic differential geometry or via Fermat theories, so I contend there is not a single answer to (my reading of the) question.

I find the statement

"(differentiable) functions" (i.e., variable-agnostic sets of ordered pairs)

exceeding peculiar. A differentiable function is a certain arrow in the category of smooth manifolds, and even better, it's a arrow in the category where objects are finite-dimensional $\mathbb{R}$-vector spaces $E^n$ (for all $n$) with the usual topology. The tangent bundle functor takes a smooth function $f\colon E^n \to E^m$ and returns a smooth function $df\colon TE^n \to TE^m$ (the tangent bundle of $E^n$ is diffeomorphic to $E^{2n}$, hence again a vector space). Let us say we are in the case $n=1$. We can restrict this function to the tangent space of $E^1$ at $0$ and get a smooth function $E \to E^m$. No coordinates were chosen here.

But how did you get this category of manifolds? I hear you ask. Well, I started with the category of sets and did the usual thing. But how did this category of sets turn up? Well, to give the short answer, ETCS. The longer answer is that the category of sets (or rather, a category of sets strong enough to formalise all of undergraduate calculus and in fact most of mathematics) can be defined in terms of a first order theory. (Aside, if it irks you to miss out of the more hard-core parts of ZFC, use the foundational theory SEAR-C instead - it likewise doesn't define functions as sets of ordred pairs.)

At no point did I define a function to be a set of ordered pairs, and everything is independent of choices of coordinates.

Alternatively, we just say that $d/dx$ is an operation in the Fermat theory of $C^\infty$-rings. In this sense, smooth functions can be seen as models for a theory which is far more focussed than set theory, and there is no flab, in that this theory only talks about smooth functions.

[If you are asking questions that assume $df(t)/dt$ and $df(x)/dx$ are somehow distinguishable, and bringing foundational definitions into basic calculus, then expect answers that answer with a similar level of chutzpah]

-
I think it is quite natural that (possibly naive) foundational questions are asked in a basic calculus course. Of course it is difficult to answer them at the right level. I think that the idea "a relation is a set of ordered pairs, a function is a special kind of relation" can be understood and applied by first year students, even if they may reject it when (or if) they later take a category-theoretic viewpoint. – Goldstern Dec 5 '12 at 13:40
I agree with Joel that the question is more about careful use of syntax (e.g., the proper manipulation of free vs. bound variables), and maybe not so much about things like set-theoretic foundations. It's connected with a familiar kind of abuse of notation seen in calculus courses where one writes $f(x)$ for a function when one really means $\lambda x. f(x)$. Here's an illustration of the trouble one can get into: we sometimes express FTC in the form $\frac{d}{d x} \int_a^x g(t) dt = g(x)$. Now suppose you ask a student to differentiate the function $F(x) = \int_a^x g(t) - g(x) dt$. (cont.) – Todd Trimble Dec 5 '12 at 14:35
Do you just substitute $x$ for $t$ in the integrand and get $g(x) - g(x) = 0$? No? Then how do you explain the rule properly? This would get into an interesting discussion of how variables are treated. – Todd Trimble Dec 5 '12 at 14:36
@quid: I'm glad you understand me better. But as I see it, the main issue the OP has is: what is the precise role of the notation "$x$" when we write $\frac{d}{dx}$, and this is the syntactic issue that I (and I think Joel) want to address. He or she only brings in the bit about "differentiable functions as sets of ordered pairs" to say that that doesn't address the problem at hand (so let's not get deflected by that). A careful treatment of what I think is worrying OP would center on how the correct handling of variables, which is an important issue made more piquant by invoking (cont.) – Todd Trimble Dec 5 '12 at 19:37
@quid: Concerning "more 'classroom' than 'computer algebra development'": I've found that calculus classrooms often include students who want to compute by explicit, precise rules, just like a computer algebra system (only less sophisticated), and who get very confused when they are told (or they merely get the impression) that the correct manipulation of symbols in mathematics depends on thinking about what the symbols mean. Such thinking is, for them, a mystery; they want (at least) that this "meaning" be unambiguously inferrable from what is written. I think that underlies this question. – Andreas Blass Dec 6 '12 at 0:59