**Remark:** All the answers so far have been very insightful and on point but after receiving public and private feedback from other mathematicians on the MathOverflow I decided to clarify a few notions and add contextual information. 08/03/2020.

## Motivation:

I recently had an interesting exchange with several computational neuroscientists on whether organisms with spatiotemporal sensory input can simulate physics without computing partial derivatives. As far as I know, partial derivatives offer the most quantitatively precise description of spatiotemporal variations. Regarding feasibility, it is worth noting that a number of computational neuroscientists are seriously considering the question that human brains might do reverse-mode automatic differentiation, or what some call backpropagation [7].

Having said this, a large number of computational neuroscientists(even those that have math PhDs) believe that complex systems such as brains may simulate classical mechanical phenomena without computing approximations to partial derivatives. Hence my decision to share this question.

## Problem definition:

Might there be an alternative formulation for mathematical physics which doesn't employ the use of partial derivatives? I think that this may be a problem in reverse mathematics [6]. But, in order to define equivalence a couple definitions are required:

**Partial Derivative as a linear map:**

If the derivative of a differentiable function $f: \mathbb{R}^n \rightarrow \mathbb{R}^m$ at $x_o \in \mathbb{R}^n$ is given by the Jacobian $\frac{\partial f}{\partial x} \Big\lvert_{x=x_o} \in \mathbb{R}^{m \times n}$, the partial derivative with respect to $i \in [n]$ is the ith column of $\frac{\partial f}{\partial x} \Big\lvert_{x=x_o}$ and may be computed using the ith standard basis vector $e_i$:

\begin{equation} \frac{\partial{f}}{\partial{x_i}} \Big\lvert_{x=x_o} = \lim_{n \to \infty} n \cdot \big(f(x+\frac{1}{n}\cdot e_i)-f(x)\big) \Big\lvert_{x=x_o} \tag{1} \end{equation}

This is the general setting of numerical differentiation [3].

**Partial Derivative as an operator:**

Within the setting of automatic differentiation [4], computer scientists construct algorithms $\nabla$ for computing the dual program $\nabla f: \mathbb{R}^n \rightarrow \mathbb{R}^m$ which corresponds to an operator definition for the partial derivative with respect to the ith coordinate:

\begin{equation} \nabla_i = e_i \frac{\partial}{\partial x_i} \tag{2} \end{equation}

\begin{equation} \nabla = \sum_{i=1}^n \nabla_i = \sum_{i=1}^n e_i \frac{\partial}{\partial x_i} \tag{3} \end{equation}

Given these definitions, a constructive test would involve creating an open-source library for simulating classical and quantum systems that doesn’t contain a method for numerical or automatic differentiation.

## The special case of classical mechanics:

For concreteness, we may consider classical mechanics as this is the general setting of animal locomotion, and the vector, Hamiltonian, and Lagrangian formulations of classical mechanics have concise descriptions. In all of these formulations the partial derivative plays a central role. But, at the present moment I don't have a proof that rules out alternative formulations. Has this particular question already been addressed by a mathematical physicist?

Perhaps a reasonable option might be to use a probabilistic framework such as Gaussian Processes that are provably universal function approximators [5]?

## Koopman Von Neumann Classical Mechanics as a candidate solution:

After reflecting upon the answers of Ben Crowell and gmvh, it appears that we require a formulation of classical mechanics where:

- Everything is formulated in terms of linear operators.
- All problems can then be recast in an algebraic language.

After doing a literature search it appears that Koopman Von Neumann Classical Mechanics might be a suitable candidate as we have an operator theory in Hilbert space similar to Quantum Mechanics [8,9,10]. That said, I just recently came across this formulation so there may be important subtleties I ignore.

## Related problems:

Furthermore, I think it may be worth considering the following related questions:

- What would be left of mathematical physics if we could not compute partial derivatives?
- Is it possible to accurately simulate any non-trivial physics without computing partial derivatives?
- Are the operations of multivariable calculus necessary and sufficient for modelling classical mechanical phenomena?

## A historical note:

It is worth noting that more than 1000 years ago as a result of his profound studies on optics the mathematician and physicist Ibn al-Haytham(aka Alhazen) reached the following insight:

Nothing of what is visible, apart from light and color, can be perceived by pure sensation, but only by discernment, inference, and recognition, in addition to sensation.-Alhazen

Today it is known that even color is a construction of the mind as photons are the only physical objects that reach the retina. However, broadly speaking neuroscience is just beginning to catch up with Alhazen’s understanding that the physics of everyday experience is simulated by our minds. In particular, most motor-control scientists agree that to a first-order approximation the key purpose of animal brains is to generate movements and consider their implications. This implicitly specifies a large class of continuous control problems which includes animal locomotion.

Evidence accumulated from several decades of neuroimaging studies implicates the role of the cerebellum in such internal modelling. This isolates a rather uniform brain region whose processes at the circuit-level may be identified with efficient and reliable methods for simulating classical mechanical phenomena [11,12].

As for the question of whether the mind/brain may actually be modelled by Turing machines, I believe this was precisely Alan Turing’s motivation in conceiving the Turing machine [13]. For a concrete example of neural computation, it may be worth looking at recent research that a single dendritic compartment may compute the xor function: paper, discussion.

## References:

- William W. Symes. Partial Differential Equations of Mathematical Physics. 2012.
- L.D. Landau & E.M. Lifshitz. Mechanics ( Volume 1 of A Course of Theoretical Physics ). Pergamon Press 1969.
- Lyness, J. N.; Moler, C. B. (1967). "Numerical differentiation of analytic functions". SIAM J. Numer. Anal. 4: 202–210. doi:10.1137/0704019.
- Naumann, Uwe (2012). The Art of Differentiationg Computer Programs. Software-Environments-tools. SIAM. ISBN 978-1-611972-06-1.
- Michael Osborne. Gaussian Processes for Prediction. Robotics Research Group Department of Engineering Science University of Oxford. 2007.
- Connie Fan. REVERSE MATHEMATICS. University of Chicago. 2010.
- Richards, B.A., Lillicrap, T.P., Beaudoin, P. et al. A deep learning framework for neuroscience. Nat Neurosci 22, 1761–1770 (2019). https://doi.org/10.1038/s41593-019-0520-2
- Wikipedia contributors. "Koopman–von Neumann classical mechanics." Wikipedia, The Free Encyclopedia. Wikipedia, The Free Encyclopedia, 19 Feb. 2020. Web. 7 Mar. 2020.
- Koopman, B. O. (1931). "Hamiltonian Systems and Transformations in Hilbert Space". Proceedings of the National Academy of Sciences. 17 (5): 315–318. Bibcode:1931PNAS...17..315K. doi:10.1073/pnas.17.5.315. PMC 1076052. PMID 16577368.
- Frank Wilczek. Notes on Koopman von Neumann Mechanics, and a Step Beyond. 2015.
- Daniel McNamee and Daniel M. Wolpert. Internal Models in Biological Control. Annual Review of Control, Robotics, and Autonomous Systems. 2019.
- Jörn Diedrichsen, Maedbh King, Carlos Hernandez-Castillo,Marty Sereno, and Richard B. Ivry. Universal Transform or Multiple Functionality? Understanding the Contribution of the Human Cerebellum across Task Domains. Neuron review. 2019.
- Turing, A.M. (1936). "On Computable Numbers, with an Application to the Entscheidungsproblem". Proceedings of the London Mathematical Society. 2 (published 1937). 42: 230–265. doi:10.1112/plms/s2-42.1.230. (and Turing, A.M. (1938). "On Computable Numbers, with an Application to the Entscheidungsproblem: A correction". Proceedings of the London Mathematical
- ALBERT GIDON, TIMOTHY ADAM ZOLNIK, PAWEL FIDZINSKI, FELIX BOLDUAN, ATHANASIA PAPOUTSI, PANAYIOTA POIRAZI, MARTIN HOLTKAMP, IMRE VIDA, MATTHEW EVAN LARKUM. Dendritic action potentials and computation in human layer 2/3 cortical neurons. Science. 2020.

“differential”geometry, sorry. For another example, recasting the nominally very “second-order” law that particles move on geodesics, see §§13–15 of Sternberg’s Einstein lectureGeneral Covariance and the Passive Equations of Physics. $\endgroup$ – Francois Ziegler Mar 5 at 21:18