8.4 Systems of Linear Equations: Matrix Inverses
We concluded Section by showing how we can rewrite a system of linear equations as the matrix equation where and are known matrices and the solution matrix of the equation corresponds to the solution of the system. In this section, we develop the method for solving such an equation. To that end, consider the system
To write this as a matrix equation, we follow the procedure outlined on page. We find the coefficient matrix , the unknowns matrix and constant matrix to be
In order to motivate how we solve a matrix equation like , we revisit solving a similar equation involving real numbers. Consider the equation . To solve, we simply divide both sides by and obtain . How can we go about defining an analogous process for matrices? To answer this question, we solve again, but this time, we pay attention to the properties of real numbers being used at each step. Recall that dividing by is the same as multiplying by , the so-called multiplicative inverse 1 of .
If we wish to check our answer, we substitute into the original equation
Thinking back to Theorem, we know that matrix multiplication enjoys both an associative property and a multiplicative identity. What's missing from the mix is a multiplicative inverse for the coefficient matrix . Assuming we can find such a beast, we can mimic our solution (and check) to as follows
The matrix is read `-inverse' and we will define it formally later in the section. At this stage, we have no idea if such a matrix exists, but that won't deter us from trying to find it.2 We want to satisfy two equations, and , making necessarily a matrix.3 Hence, we assume has the form
for real numbers , , and . For reasons which will become clear later, we focus our attention on the equation . We have
This gives rise to two more systems of equations
At this point, it may seem absurd to continue with this venture. After all, the intent was to solve one system of equations, and in doing so, we have produced two more to solve. Remember, the objective of this discussion is to develop a general method which, when used in the correct scenarios, allows us to do far more than just solve a system of equations. If we set about to solve these systems using augmented matrices using the techniques in Section, we see that not only do both systems have the same coefficient matrix, this coefficient matrix is none other than the matrix itself. (We will come back to this observation in a moment.)
To solve these two systems, we use Gauss-Jordan Elimination to put the augmented matrices into reduced row echelon form. (We leave the details to the reader.) For the first system, we get
which gives and . To solve the second system, we use the exact same row operations, in the same order, to put its augmented matrix into reduced row echelon form (Think about why that works.) and we obtain
which means and . Hence,
We can check to see that behaves as it should by computing
As an added bonus,
We can now return to the problem at hand. From our discussion at the beginning of the section on page, we know
so that our final solution to the system is .
As we mentioned, the point of this exercise was not just to solve the system of linear equations, but to develop a general method for finding . We now take a step back and analyze the foregoing discussion in a more general context. In solving for , we used two augmented matrices, both of which contained the same entries as
We also note that the reduced row echelon forms of these augmented matrices can be written as
where we have identified the entries to the left of the vertical bar as the identity and the entries to the right of the vertical bar as the solutions to our systems. The long and short of the solution process can be summarized as
Since the row operations for both processes are the same, all of the arithmetic on the left hand side of the vertical bar is identical in both problems. The only difference between the two processes is what happens to the constants to the right of the vertical bar. As long as we keep these separated into columns, we can combine our efforts into one `super-sized' augmented matrix and describe the above process as
We have the identity matrix appearing as the right hand side of the first super-sized augmented matrix and the left hand side of the second super-sized augmented matrix. To our surprise and delight, the elements on the right hand side of the second super-sized augmented matrix are none other than those which comprise . Hence, we have
In other words, the process of finding for a matrix can be viewed as performing a series of row operations which transform into the identity matrix of the same dimension. We can view this process as follows. In trying to find , we are trying to `undo' multiplication by the matrix . The identity matrix in the super-sized augmented matrix keeps a running memory of all of the moves required to `undo' . This results in exactly what we want, . We are now ready to formalize and generalize the foregoing discussion. We begin with the formal definition of an invertible matrix.
Note that, as a consequence of our definition, invertible matrices are square, and as such, the conditions in Definition force the matrix to be same dimensions as , that is, . Since not all matrices are square, not all matrices are invertible. However, just because a matrix is square doesn't guarantee it is invertible. (See the exercises.) Our first result summarizes some of the important characteristics of invertible matrices and their inverses.
The proofs of the properties in Theorem rely on a healthy mix of definition and matrix arithmetic. To establish the first property, we assume that is invertible and suppose the matrices and act as inverses for . That is, and . We need to show that and are, in fact, the same matrix. To see this, we note that . Hence, any two matrices that act like are, in fact, the same matrix.4 To prove the second property of Theorem, we note that if is invertible then the discussion on page shows the solution to to be , and since is unique, so is . Conversely, if has a unique solution for every matrix , then, in particular, there is a unique solution to the equation . The solution matrix is our candidate for . We have by definition, but we need to also show . To that end, we note that . In other words, the matrix is a solution to the equation . Clearly, is also a solution to the equation , and since we are assuming every such equation as a unique solution, we must have . Hence, we have , so that and is invertible. The foregoing discussion justifies our quest to find using our super-sized augmented matrix approach
We are, in essence, trying to find the unique solution to the equation using row operations.
What does all of this mean for a system of linear equations? Theorem tells us that if we write the system in the form , then if the coefficient matrix is invertible, there is only one solution to the system that is, if is invertible, the system is consistent and independent.5 We also know that the process by which we find is determined completely by , and not by the constants in . This answers the question as to why we would bother doing row operations on a super-sized augmented matrix to find instead of an ordinary augmented matrix to solve a system; by finding we have done all of the row operations we ever need to do, once and for all, since we can quickly solve any equation using one multiplication, .
In Example Example 1, we see that finding one inverse matrix can enable us to solve an entire family of systems of linear equations. There are many examples of where this comes in handy `in the wild', and we chose our example for this section from the field of electronics. We also take this opportunity to introduce the student to how we can compute inverse matrices using the calculator.
Exercises
In Exercises -, find the inverse of the matrix or state that the matrix is not invertible.
This exercise is a continuation of Example in Section and gives another application of matrix inverses. Recall that given the position matrix for a point in the plane, the matrix corresponds to a point rotated counterclockwise from where
- Find .
- If rotates a point counterclockwise , what should do? Check your answer by finding for various points on the coordinate axes and the lines .
- Find where corresponds to a generic point . Verify that this takes points on the curve to points on the curve .
A Sasquatch's diet consists of three primary foods: Ippizuti Fish, Misty Mushrooms, and Sun Berries. Each serving of Ippizuti Fish is 500 calories, contains 40 grams of protein, and has no Vitamin X. Each serving of Misty Mushrooms is 50 calories, contains 1 gram of protein, and 5 milligrams of Vitamin X. Finally, each serving of Sun Berries is 80 calories, contains no protein, but has 15 milligrams of Vitamin X.9
- If an adult male Sasquatch requires 3200 calories, 130 grams of protein, and 275 milligrams of Vitamin X daily, use a matrix inverse to find how many servings each of Ippizuti Fish, Misty Mushrooms, and Sun Berries he needs to eat each day.
- An adult female Sasquatch requires 3100 calories, 120 grams of protein, and 300 milligrams of Vitamin X daily. Use the matrix inverse you found in part (a) to find how many servings each of Ippizuti Fish, Misty Mushrooms, and Sun Berries she needs to eat each day.
- An adolescent Sasquatch requires 5000 calories, 400 grams of protein daily, but no Vitamin X daily.10 Use the matrix inverse you found in part (a) to find how many servings each of Ippizuti Fish, Misty Mushrooms, and Sun Berries she needs to eat each day.
Matrices can be used in cryptography. Suppose we wish to encode the message `BIGFOOT LIVES'. We start by assigning a number to each letter of the alphabet, say , and so on. We reserve to act as a space. Hence, our message `BIGFOOT LIVES' corresponds to the string of numbers `2, 9, 7, 6, 15, 15, 20, 0, 12, 9, 22, 5, 19.' To encode this message, we use an invertible matrix. Any invertible matrix will do, but for this exercise, we choose
Since is matrix, we encode our message string into a matrix with rows. To do this, we take the first three numbers, 2 9 7, and make them our first column, the next three numbers, 6 15 15, and make them our second column, and so on. We put 's to round out the matrix.
To encode the message, we find the product
So our coded message is `12, 1, , 42, 3, , 100, 36, , , 39, , 38, 57, .' To decode this message, we start with this string of numbers, construct a message matrix as we did earlier (we should get the matrix again) and then multiply by .
- Find .
- Use to decode the message and check this method actually works.
- Decode the message `14, 37, , 128, 21, , 31, 65, '
- Choose another invertible matrix and encode and decode your own messages.
- Using the matrices from Exercise, from Exercise and from Exercise, show and . That is, show that .
- Let and be invertible matrices. Show that and compare your work to Exercise in Section.
In Exercises -, use one matrix inverse to solve the following systems of linear equations.
In Exercises -, use the inverse of from Exercise above to solve the following systems of linear equations.
Answers
- is not invertible
- is not invertible
- So and .
- So and .
- So and .
- So , and .
- So , and .
- So , and .
- The adult male Sasquatch needs: 3 servings of Ippizuti Fish, 10 servings of Misty Mushrooms, and 15 servings of Sun Berries daily.
- The adult female Sasquatch needs: 3 servings of Ippizuti Fish and 20 servings of Sun Berries daily. (No Misty Mushrooms are needed!)
- The adolescent Sasquatch requires 10 servings of Ippizuti Fish daily. (No Misty Mushrooms or Sun Berries are needed!)
- `LOGS RULE'
The coefficient matrix is from Exercise above so the inverse we need is .
The coefficient matrix is from Exercise, so
Adapted from Precalculus, 3rd corrected edition, by Carl Stitz and Jeff Zeager (stitz-zeager.com), licensed under CC BY-NC-SA 3.0. Changes were made: reformatted as an accessible XYZ web edition. License: CC-BY-NC-SA-3.0.