Fourier vs Laplace transforms

Question

In solving a linear system, when would I use a Fourier transform versus a Laplace transform? I am not a mathematician, so the little intuition I have tells me that it could be related to the boundary conditions imposed on the solution I am trying to find, but I am unable to state this rigorously or find a reference that discusses this. Any help would be appreciated. Thanks.

Answer 1

Here is a heuristic point of view from engineering considerations. I must confess I do not fully know the mathematical reasons.

Suppose you want to consider $f(t)$, a function of time, $t$. Imagine that as we look at the direction of positive $t$-axis, the graph of $f(t)$ s like looking behind to the trail $f$ left in time. If you do not care about the future, ie the case $t < 0$, then it makes sense to use Laplace transform, because the transform integral goes from $0$ to $\infty$. On the other hand, if you care about the future also, it makes more sense to consider the Fourier transform. The transformation integral here goes from $-\infty$ to $\infty$.

So if you want to include future in your analysis, then Fourier transform is the way. This makes sense in electrical engineering applications for example, where you consider sinusoidal signals and you have an idea of what is going to come.

However for some physical systems, you only have the data of what happened until then. And you want all your analysis to be based on this, without predicting the future. Then Laplace transforms is the way.

If you do not care about the future, ie if you can declare $f(t) = 0$ for $t < 0$, then the Laplace and Fourier transforms coincide: The Fourier transform is nothing but the Laplace transform evaluated on the imaginary axis. Such systems are called causal systems: the response depends only on what happened so far. This a terminology from control systems or signal processing.

For control systems engineering, stability of electrical networks, etc., Laplace transformation defines a more natural transfer function, and is easier to deal with, and the poles and zeros would immediately tell you about the stability of the network under consideration. Here we use Laplace transforms rather than Fourier, since its integral is simpler.

For instances where you look at the "frequency components", "spectrum", etc., Fourier analysis is always the best. The Fourier transform is simply the frequency spectrum of a signal. If you know that the sin/cos/complex exponentials would behave nicely, you might as well want to express a function in terms of these and observe how it behaves then.

Another example is solving the wave equation. Fourier himself used Fourier series/transforms for heat conduction problems.

Answer 2

Laplace transforms appear in physics because of causality: a response function $R(t-t')$ which gives the response at time $t$ to a force at time $t'$ should vanish for $t\lt t'$, in order not to violate the temporal relation between cause and effect. Because $R(t)=0$ for $t<0$ its integral transform is the Laplace rather than the Fourier transform.

Answer 3

Fourier transform (FT) - (roughly) a tool to visualize ANY signal as a sum of sinusoids.

Laplace transform (LT) - a tool to analyze the stability of systems.

Why can't we use FT to analyze systems? because it cannot handle exponentially growing signals. That in turn is because a signal needs to be absolutely integrable(necessary, but not sufficient condition) for it to have a FT.

On the other hand, LT is specially designed (by Laplace himself after he rejected the thesis of Fourier and extended FT) to handle exponentially growing signals so that now you could if a system has an exponentially growing output ( $a > 0$ where $s = a + jw$) or exponentially decaying output ($a < 0$).

Therefore if you have a square wave type signal and you wanted to break it up into sinusoids of various frequencies, you'd use FT and on the other hand, if you have a system and you want to understand how stable it is, then you'd try to get LT of it's impulse response to further analyze the systems relative stability.

Answer 4

For typical practical usage it is essential to know what properties has the system you are trying to describe. Usually you are able even get some insights about possible shape of solution before you really solve equations, only by means of symmetry considerations. So then you have to consider one or another transform not because of formal effectiveness, but because your solution has to have practical interpretation! What do you do with solution if you do not have any interpretation for example for coefficients of equations you get?

Fourier transformation sometimes has physical interpretation, for example for some mechanical models where we have quasi-periodic solutions ( usually because of symmetry of the system) Fourier transformations gives you normal modes of oscillations. Sometimes even for nonlinear system, couplings between such oscillations are weak so nonlinearity may be approximated by power series in Fourier space. Many systems has discrete spatial symmetry ( crystals) then solutions of equations has to be periodic so FT is quite natural ( for example in Quantum mechanics). With any of normal modes you may tie finite energy, sometimes momentum etc. invariants of motion. So during evolution, for linear system, such modes do not couple each other, and system in one of this state leaves in it forever. Every linear physical system has its spectrum of normal modes, and if coupled with some external random source of energy ( white noise), its evolution runs through such states from the lowest possible energy to the greatest.

It depends on initial conditions and boundary values and restrictions but for finite systems and linear equations Fourier Transform gives you transformation from linear differential equation to matrix one ( which is nearly always soluble and has clear theory and meaning) whilst Laplace Transform from DE to algebraic one with all advantages and disadvantages of it.

Laplace transform gives you solution in terms of decaying exponents so it is quite useful in relaxation processes, but it has no physical interpretation, usually no invariants are connected to any "vectors" of such representation, there is no discrete version of such transform with physical meaning. It is used in various engineering problems such that electrical circuits, queue theory etc. many equations in diffusion processes has easy Laplace transform solutions.

Definitely it would be easier to advice you what method of solution to use if you would describe what is the process you are trying to describe.

References: try to Google such words: energy spectrum, normal modes, eigenstates, eigenvectors in context of linear differential equations - solving DE by means of integral transforms in practical way is usually described in books on Mathematical Methods in Physics, and is connected to response functions, distribution theory, Hilbert and Banach functional spaces etc. It is very very broad area. What is more, if you asking in specific context ( for example in context of stochastic processes, or quantum mechanics) , then probably you are looking for some certain interpretation of such transforms and not for formal theory. This differences sometimes tricky because mount of mathematical books focus on existence theorems etc. which for many applications are obvious ( providing we have working, well formulated model, which ususaly we have!)

It is very difficult to get one useful reference without knowledge of area of application, because its are is such frequently used method! In analogue on mathematics level is like ask for application of metric spaces, or Stokes theorem and its meaning: it so broad area that probably you may just put in in every other area ad it fit! Nearly every Quantum Mechanics book will have explanation and interpretation of Fourier method. Laplace transform will be used in every books regarding signal processing! Many of them have very well and practical introduction to such methods. I prefer physical books, for example Byron Fuller "Mathematical Methods of Physics" for intermediate level.

Here you have many, many references: http://mathworld.wolfram.com/FourierTransform.html Here you have another one list: http://www.ericweisstein.com/encyclopedias/books/FourierTransforms.html

Answer 5

For many years I have tried to obtain a good answer for the Laplace and Fourier transforms relationship. Many of the explanations just mention that the relationship is that s=a+jw, so the Fourier transform becomes a special case of the laplace transform. Sad explanation. Better explanations deals that Laplace is used for stability studies and Fourier is used for sinusoidal responses of systems. Using that information, I conclude that as systems are stable if the real part of s is negative, that is to say there is a transient that will vanish in time, in those cases, it is enaugh to use Fourier. Of course you will lose the insight of the transient part. Laplace should be able to determine the full response of a system, be it stable or unstable, including transient parts.

Answer 6

The solution pattern behind is like this:

Using a transform is like changing your point of view. In some cases the problem might get such easy under the new point of view, that you are able to solve the problem there and then you take the obtained solution and transform back to your original point of view.

Here we might try to solve a differential equation, thus looking for some function (or distribution) which fullfills the differential equation and additional conditions.

The Laplace transform has this nice property:

$f'(t) = s F(s) - f(0)$

This means a transformed differential equation will have the derivative $f'(t)$ replaced by the above term, so a simple equation with just occurences of $F(s)$ and the start condition $f(0)$ are left. Such an equation we can solve for the unknown $F(s)$ by simple algebra.

The change of point of view from $t$-domain to $s$-domain made the problem of solving the differential equation easier by replacing it with an algebraic equation.

The trickier part is transforming back the found solution $F(s)$ to $f(t)$ by applying an inverse Laplace transformation (or looking it up in some table).

The Fourier transform has a similar property:

$f'(x) = 2\pi i \,t\, F(t)$

which in a sense transforms the differential operator $\partial_x = \partial / \partial x$ into a multiplication with the variable $t$.

This is used to solve differential equations like the diffusion equation, wave equation, Schrödinger equation, Klein-Gordon equation etc. by turning them into algebraic equations, as $\Delta = \sum \partial_i \partial_i$ gets transformed into $\sum x_i x_i$.

Again you solve it and then transform back.