"Must read" papers in numerical analysis - MathOverflow

"Must read" papers in numerical analysis

2012-07-17T01:37:24Z

In 1993, Prof. L.N. Trefethen published a NA-net posting with a list of thirteen paper he used for teaching the seminar Classic Papers in Numerical Analysis. In Trefethen's words, ... this course provided a satisfying vison of the broad scope of numerical analysis and the sense of excitement at what a diversity of beautiful and powerful ideas have been invented in this field.

Prof. Trefethen's list (links):

Cooley & Tukey (1965) the Fast Fourier Transform
Courant, Friedrichs & Lewy (1928) finite difference methods for PDE
Householder (1958) QR factorization of matrices
Curtiss & Hirschfelder (1952) stiffness of ODEs; BD formulas
de Boor (1972) calculations with B-splines
Courant (1943) finite element methods for PDE
Golub & Kahan (1965) the singular value decomposition
Brandt (1977) multigrid algorithms
Hestenes & Stiefel (1952) the conjugate gradient iteration
Fletcher & Powell (1963) optimization via quasi-Newton updates
Wanner, Hairer & Norsett (1978) order stars and applications to ODE
Karmarkar (1984) interior pt. methods for linear prog.
Greengard & Rokhlin (1987) multipole methods for particles

Most readers of this note, according Prof. Trefethen, will have thought of other classic authors and papers that should have been on the list.

The question is: In your opinion, what are other classic authors and papers that should be in a must read list of papers in numerical analysis?

Answer by Denis Serre for "Must read" papers in numerical analysis

2012-07-17T05:37:08Z

P. D. Lax & B. Wendroff. On the stability of difference schemes, Communications on Pure and Applied Mathematics 15, pp 363–371 (1962).

Answer by David Ketcheson for "Must read" papers in numerical analysis

2012-07-17T08:23:02Z

S.K. Godunov, A difference method for numerical calculation of discontinuous solutions of the equations of hydrodynamics, Matematicheskii Sbornik (1959). (in Russian)

Virtually all modern methods for nonlinear hyperbolic PDEs are based on this.

Answer by PaPiro for "Must read" papers in numerical analysis

2012-07-17T12:29:42Z

J. von Neumann, H.H. Goldstine, Numerical Inverting of Matrices of High Order, Bull. Amer. Math. Soc., Vol. 53, No. 11, pp. 1021-1099, 1947.

According to J. Grcar, Birthday of Modern Numerical Analysis, available here or here, this paper is considered the first paper in modern analysis because it is the first to study rounding error and because much of the paper is an essay on scientific computing (albeit with an emphasis on numerical linear algebra).

Answer by Andrew T. Barker for "Must read" papers in numerical analysis

2012-07-17T13:52:36Z

Fermi, Pasta, Ulam, Studies of Nonlinear Problems, unpublished report from Los Alamos National Laboratory, 1955.

This paper arguably started the numerical investigation of nonlinear dynamics and chaos, which has become a huge field. See for example Ford, The Fermi-Pasta-Ulam problem: Paradox turns discovery, Physics Reports 213 (2002) pp. 271-310 for a review.

Answer by GHH for "Must read" papers in numerical analysis

2012-07-17T13:54:25Z

J. Crank and P. Nicolson (1947) A practical method for numerical evaluation of solutions of partial differential equations of the heat-conduction type. Mathematical Proceedings of the Cambridge Philosophical Society 43, pp. 50-67

Answer by Pedro Mendes for "Must read" papers in numerical analysis

2012-07-17T15:39:00Z

Metropolis N, Ulam S (1949) The Monte Carlo method J. Am. Stat. Assoc. 44:335-341

Marsaglia G (1968) Random numbers fall mainly in the planes. Proc. Natl. Acad. Sci. USA 61:25-28

Answer by Ed Gorcenski for "Must read" papers in numerical analysis

2012-07-17T18:28:46Z

It is not a classic paper, but I would add Xiu, D. and Karniadakis, G.E, "The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations," which can be found here.

I mention this paper because Generalized Polynomial Chaos is still underrepresented in many fields, though it has found much use in engineering applications. It is not precisely a magic bullet, but in some cases it can drastically reduce computational demand in uncertainty analysis. The aforementioned paper is a good summary of the method.

Answer by timur for "Must read" papers in numerical analysis

2012-07-17T20:18:55Z

Jinchao Xu, Iterative methods by space decomposition and subspace correction, SIAM Review 34(4):581-613, 1992.

Answer by none for "Must read" papers in numerical analysis

2012-07-21T11:51:33Z

Edward N. Lorenz (1963). "Deterministic Nonperiodic Flow". Journal of the Atmospheric Sciences 20 (2): 130–141.

This demonstrated the butterfly effect.

Answer by PaPiro for "Must read" papers in numerical analysis

2012-08-24T10:40:24Z

L.F. Richardson, The Approximate Arithmetical Solution by Finite Differences of Physical Problems Involving Differential Equations, with an Application to the Stresses in a Masonry Dam, Proceedings of the Royal Society of London, 1910, available here.

From the Abstract,

The object of this paper is to develop methods whereby the differential equations of physics may be applied more freely than hitherto in the approximate form of difference equations to problems concerning irregular bodies. (... ...).

Both for engineering and for many of the less exact sciences, such as biology, there is a demand for rapid methods, easy to be understood and applicable to unusual equations and irregular bodies. If they can be accurate, so much the better ; but 1 per cent, would suffice for many purposes. It is hoped that the methods put forward in this paper will help to supply this demand.

According CFD-Online, this 50 page paper is a key paper in Computational Fluid Dynamics.

Answer by rdm for "Must read" papers in numerical analysis

2012-08-24T22:35:33Z

Any mention of de Boor should also include Jos Stam's work: http://www.dgp.toronto.edu/~stam/reality/Research/pub.html

(Especially his siggraph 1999 course notes, which cover a number of useful approaches for dealing with b-splines.)