What is the difference between matrix theory and linear algebra? - MathOverflow most recent 30 from http://mathoverflow.net 2013-06-19T15:19:09Z http://mathoverflow.net/feeds/question/11669 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra What is the difference between matrix theory and linear algebra? kolistivra 2010-01-13T17:17:41Z 2010-04-04T18:10:56Z <p>Hi,</p> <p>Currently, I'm taking matrix theory, and our textbook is Strang's Linear Algebra. Besides matrix theory, which all engineers must take, there exists linear algebra I and II for math majors. What is the difference,if any, between matrix theory and linear algebra?</p> <p>Thanks!</p> http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra/11670#11670 Answer by Steve Huntsman for What is the difference between matrix theory and linear algebra? Steve Huntsman 2010-01-13T17:23:10Z 2010-01-13T17:23:10Z <p>The difference is that in matrix theory you have chosen a particular <a href="http://en.wikipedia.org/wiki/Basis%5F%28linear%5Falgebra%29" rel="nofollow">basis</a>.</p> http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra/11679#11679 Answer by Qiaochu Yuan for What is the difference between matrix theory and linear algebra? Qiaochu Yuan 2010-01-13T18:29:28Z 2010-01-13T18:29:28Z <p>Let me elaborate a little on what Steve Huntsman is talking about. A matrix is just a list of numbers, and you're allowed to add and multiply matrices by combining those numbers in a certain way. When you talk about matrices, you're allowed to talk about things like the entry in the 3rd row and 4th column, and so forth. In this setting, matrices are useful for representing things like transition probabilities in a Markov chain, where each entry indicates the probability of transitioning from one state to another. You can do lots of interesting numerical things with matrices, and these interesting numerical things are very important because matrices show up a lot in engineering and the sciences.</p> <p>In linear algebra, however, you instead talk about <strong>linear transformations,</strong> which are <strong>not</strong> (I cannot emphasize this enough) a list of numbers, although sometimes it is convenient to use a particular matrix to write down a linear transformation. The difference between a linear transformation and a matrix is not easy to grasp the first time you see it, and most people would be fine with conflating the two points of view. However, when you're given a linear transformation, you're not allowed to ask for things like the entry in its 3rd row and 4th column because questions like these depend on a <strong>choice of basis.</strong> Instead, you're only allowed to ask for things that don't depend on the basis, such as the rank, the trace, the determinant, or the set of eigenvalues. This point of view may seem unnecessarily restrictive, but it is fundamental to a deeper understanding of pure mathematics.</p> http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra/12842#12842 Answer by Anweshi for What is the difference between matrix theory and linear algebra? Anweshi 2010-01-24T14:00:45Z 2010-03-30T21:57:38Z <p>Matrix theory is the specialization of linear algebra to the case of finite dimensional vector spaces and doing explicit manipulations after fixing a basis. More precisely: The algebra of $n \times n$ matrices with coefficients in a field $F$ is isomorphic to the algebra of $F$-linear homomorphisms from an $n$-dimensional vector space $V$ over $F$, to itself. And the choice of such an isomorphism is precisely the choice of a basis for $V$. </p> <p>Sometimes you need concrete computations for which you use the matrix viewpoint. But for conceptual understanding, application to wider contexts and for overall mathematical elegance, the abstract approach of vector spaces and linear transformations is better.</p> <p>In this second approach you can take over linear algebra to more general settings such as modules over rings(PIDs for instance), functional analysis, homological algebra, representation theory, etc.. All these topics have linear algebra at their heart, or, rather, "is" indeed linear algebra..</p> http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra/19884#19884 Answer by Konrad Waldorf for What is the difference between matrix theory and linear algebra? Konrad Waldorf 2010-03-30T22:06:44Z 2010-03-30T22:06:44Z <p>Let me quote without further comment from Dieudonné's "Foundations of Modern Analysis, Vol. 1".</p> <blockquote> <p>There is hardly any theory which is more elementary [than linear algebra], in spite of the fact that generations of professors and textbook writers have obscured its simplicity by preposterous calculations with matrices. </p> </blockquote> http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra/19923#19923 Answer by John Stillwell for What is the difference between matrix theory and linear algebra? John Stillwell 2010-03-31T08:06:31Z 2010-03-31T08:06:31Z <p>A counter-quotation to the one from Dieudonné:</p> <blockquote> <p>We share a philosophy about linear algebra: we think basis-free, we write basis-free, but when the chips are down we close the office door and compute with matrices like fury.</p> </blockquote> <p>(Irving Kaplansky, writing of himself and Paul Halmos)</p> http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra/20076#20076 Answer by zhaoliang for What is the difference between matrix theory and linear algebra? zhaoliang 2010-04-01T14:45:47Z 2010-04-01T14:45:47Z <p>My opinion: matrix theory mostly deals with matrix of a paticular kind , or a few relevant ones. But linear algebra cares about the general, underlying structrue. </p> http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra/20108#20108 Answer by Jon for What is the difference between matrix theory and linear algebra? Jon 2010-04-01T21:08:12Z 2010-04-04T18:10:56Z <p>Although some years ago I would have agreed with the above comments about the relationship between Linear Algebra and Matrix Theory, I DO NOT agree any more! </p> <p>See, for example Bhatia's "Matrix Analysis" GTM book. For example, doubly-(sub)stochastic matrices arise naturally in the classification of unitarily-invariant norms. They also naturally appear in the study of quantum entanglement, which really has nothing to do with a basis. (In both instances, all sorts of NONarbitrary bases come into play, mainly after the spectral theorem gets applied.)</p> <p>Doubly-stochastic matrices turn out to be useful to give concise proofs of basis-independent inequalities, such as the non-commutative Holder inequality:</p> <p>tr |AB| $\le$ $||A||_p$ $||B||_q$</p> <p>with 1/p+1/q=1, $|A|=(A^*A)^{1/2}$, and $||A||_p = (tr |A|^p)^{1/p}$</p> http://mathoverflow.net/questions/11669/what-is-the-difference-between-matrix-theory-and-linear-algebra/20130#20130 Answer by XX for What is the difference between matrix theory and linear algebra? XX 2010-04-02T02:24:30Z 2010-04-02T02:24:30Z <p>I'm with Jon. Matrices don't always appear as linear transformations. Yes, you can look at them as linear transformations, but there are times when it's better not to and study them for their own right. Jon already gave one example. Another example is the theory of positive (semi)definite matrices. They appear naturally as covariance matrices of random vectors. The notions like schur complements appear naturally in a course in matrix theory, but probably not in linear algebra.</p>