LS. LINEAR SYSTEMS LS.1 Review of Linear Algebra In these notes, we will investigate a way of handling a linear system of ODE’s directly, instead of using elimination to reduce it to a single higher-order equation. This gives im-portant new insights into such systems, and it is usually a more convenient and faster way of solving them. The method makes use of some elementary ideas about linear algebra and matrices, which we will assume you know from your work in multivariable calculus. Your textbook contains a section (5.3) reviewing most of these facts, with numerical examples. Another source is the 18.02 Supplementary Notes, which contains a beginning section on linear algebra covering approximately the right material. For your convenience, what you need to know is summarized briefly in this section. Consult the above references for more details and for numerical examples. 1. Vectors. A vector (or n-vector) is an n-tuple of numbers; they are usually real numbers, but we will sometimes allow them to be complex numbers, and all the rules and operations below apply just as well to n-tuples of complex numbers. (In the context of vectors, a single real or complex number, i.e., a constant, is called a scalar.) The n-tuple can be written horizontally as a row vector or vertically as a column vector. In these notes it will almost always be a column. To save space, we will sometimes write the column vector as shown below; the small T stands for transpose, and means: change the row to a column. a = (a1, . . . , an) row vector a = (a1, . . . , an)T column vector These notes use boldface for vectors; in handwriting, place an arrow �a over the letter. Vector operations. The three standard operations on n-vectors are: addition: (a1, . . . , an) + (b1, . . . , bn) = (a1 + b1, . . . , an + bn) . multiplication by a scalar: c (a1, . . . , an) = (ca1, . . . , can) scalar product: (a1, . . . , an) · (b1, . . . , bn) = a1b1 + . . . + anbn . 2. Matrices and Determinants. An m × n matrix A is a rectangular array of numbers (real or complex) having m rows and n columns. The element in the i-th row and j-th column is called the ij-th entry and written aij . The matrix itself is sometimes written (aij ), i.e., by giving its generic entry, inside the matrix parentheses. A 1 × n matrix is a row vector; an n × 1 matrix is a column vector. Matrix operations. These are addition: if A and B are both m× n matrices, they are added by adding the corresponding entries; i.e., if A = (aij ) and B = (bij ), then A + B = (aij + bij ). multiplication by a scalar: to get cA, multiply every entry of A by the scalar c; i.e., if A = (aij ), then cA = (caij ). 12 18.03 NOTES: LS. LINEAR SYSTEMS matrix multiplication: if A is an m × n matrix and B is an n × k matrix, their product AB is an m × k matrix, defined by using the scalar product operation: ij-th entry of AB = (i-th row of A) · (j-th column of B)T . The definition makes sense since both vectors on the right are n-vectors. In what follows, the most important cases of matrix multiplication will be (i) A and B are square matrices of the same size, i.e., both A and B are n × n matrices. In this case, multiplication is always possible, and the product AB is again an n × n matrix. (ii) A is an n × n matrix and B = b, a column n-vector. In this case, the matrix product Ab is again a column n-vector. Laws satisfied by the matrix operations. For any matrices for which the products and sums below are defined, we have (A B) C = A (B C) (associative law) A (B + C) = A B + A C, (A + B) C = A B + A C (distributive laws) A B ⇒= B A (commutative law fails in general) Identity matrix. We denote by In the n × n matrix with 1’s on the main diagonal (upper left to bottom right), and 0’s elsewhere. If A is an arbitrary n × n matrix, it is easy to check from the definition of matrix multiplication that A In = A and InA = A . In is called the identity matrix of order n; the subscript n is often omitted. Determinants. Associated with every square matrix A is a number, written |A| or detA, and called the determinant of A. For these notes, it will be enough if you can calculate the determinant of 2 × 2 and 3 × 3 matrices, by any method you like. Theoretically, the determinant should not be confused with the matrix itself; the determinant is a number, the matrix is the square array. But everyone puts vertical lines on either side of the matrix to indicate its determinant, and then uses phrases like “the first row of the determinant”, meaning the first row of the corresponding matrix. An important formula which everyone uses and no one can prove is (1) det(A B) = detA · detB . Inverse matrix. A square matrix A is called nonsingular or invertible if detA ⇒= 0. If A is nonsingular, there is a unique square matrix B of the same size, called the inverse to A, having the property that B A = I, and A B = I . This matrix B is denoted by A−1 . To confirm that a given matrix B is the inverse to A, you only have to check one of the above equations; the other is then automatically true. Different ways of calculating A−1 are given in the references. However, if A is a 2 × 2 matrix, as it usually will be in the notes, it is easiest simply to use the formula for it:3 LS.1 REVIEW OF LINEAR ALGEBRA ⎞ ⎠ ⎞ ⎠ 1 d −b (2) A = a b A−1 = . c d |A|−c a Remember this as a procedure, rather than as a formula: switch the entries on the main diagonal, change the sign of the other two entries, and divide every entry by the determinant. (Often it is better for subsequent calculations to leave the determinant factor outside, rather than to divide all the terms in the matrix by detA.) As an example of (2), ⎞ ⎠ −1 ⎞ ⎠ ⎞ ⎠ 1 −2 1 4 2 2 1 = = −1 4 2 1 1 1 1 . 2 2 To calculate the inverse of a nonsingular 3 × 3 matrix, see for example the 18.02 notes. 3. Square systems of linear equations. Matrices and determinants were origi-nally invented to handle in an efficient way the solution of a system of simultaneous linear equations. This is still one of their most important uses. …
View Full Document
Unlocking...