9.1 Systems of Linear Equations: Gaussian Elimination
Up until now, when we concerned ourselves with solving different types of equations there was only one equation to solve at a time. Given an equation , we could check our solutions geometrically by finding where the graphs of and intersect. The -coordinates of these intersection points correspond to the solutions to the equation , and the -coordinates were largely ignored. If we modify the problem and ask for the intersection points of the graphs of and , where both the solution to and are of interest, we have what is known as a system of equations, written as
The `curly bracket' notation means we are to find all pairs of points which satisfy both equations.
We assume the reader has some experience with systems of equations from high school algebra - specifically systems of linear equations comprised of two equations and two unknowns. We encourage the reader to read through Section A.6 before proceeding if for no other reason than to refresh themselves on the basic mechanics and vocabulary involved. In order to move this section beyond a review of high school algebra, we define what is meant by a linear equation in variables.
Instead of using more familiar variables like , , and even and/or in Definition 9.1, we use subscripts to distinguish the different variables. We have no idea how many variables may be involved, so we use numbers to distinguish them instead of letters. (There is an endless supply of distinct numbers.)
As an example, the linear equation represents the same relationship between the variables and as the equation does between the variables and . And, just as we cannot combine the terms in the expression , we cannot combine the terms in the expression .
Coupling more than one linear equation in variables results in a system of linear equations in n variables. When solving these systems, it becomes increasingly important to keep track of what operations are performed to which equations and to develop a strategy based on the kind of manipulations (substitution and elimination) taught in high school. To this end, we first remind ourselves of the maneuvers which can be applied to a system of linear equations that result in an equivalent system.1
The first move, while it obviously admits an equivalent system, seems silly to state, but our perception will change as we consider more equations and more variables in this, and later sections.
Consider the system of equations
We have , so we substitute this into the second equation to obtain . Substituting and into the first equation we get . This gives . The reader can verify that these values of , and satisfy all three original equations.
It is tempting for us to write the solution to this system by extending the usual notation to and list our solution as . The question quickly becomes what does an `ordered triple' like represent? Just as ordered pairs are used to locate points on the two-dimensional plane, ordered triples can be used to locate points in space.3
Moreover, just as equations involving the variables and describe graphs of one-dimensional lines and curves in the two-dimensional plane, equations involving variables , , and describe objects called surfaces in three-dimensional space. Each of the equations in the above system can be visualized as a plane situated in three-space. Geometrically, the system is trying to find the intersection, or common point, of all three planes. If you imagine three sheets of notebook paper each representing a portion of these planes, you will start to see the complexities involved in how three such planes can intersect.
Below is a sketch of the three planes. It turns out that any two of these planes intersect in a line,4 so our intersection point is where all three of these lines meet.
Figure 9.1
Since the geometry for equations involving more than two variables is complicated, we will focus our efforts on the algebra. Returning to the system
we note the reason it was so easy to solve is because of its structure. The third equation is solved for and the second equation involves only and . Since the coefficient of is , it makes it easy to solve for using our known value for . Lastly, the coefficient of in the first equation is making it easy to substitute the known values of and and then solve for .
We formalize this pattern below for the most general systems of linear equations. Again, we use subscripted variables to describe the general case. The variable with the smallest subscript in a given equation is typically called the leading variable of that equation.
In our previous system, if we make the obvious choices , , and , we see that the system is in triangular form.6 An example of a more complicated system in triangular form is
Our goal henceforth will be to transform a given system of linear equations into triangular form using the moves in Theorem 9.1.
Like all algorithms, Gaussian Elimination has the advantage of always producing what we need, but it can also be inefficient at times. For example, when solving the second system in Example 9.1.1, it is clear after we eliminated the 's in the second step to get the system
that equations and , taken together, produce a contradiction. (We have identical left hand sides and different right hand sides.) However, the algorithm takes an additional two steps to reach this conclusion.
We also note that substitution in Gaussian Elimination is delayed until all the elimination is done, whence the name back-substitution. This may also be inefficient in many cases.
Lastly, we note that the last system in Example 9.1.1 is underdetermined,10 and as it is consistent, we necessarily have free variables in our answer. We close this section with a standard `mixture' type application of systems of linear equations which features an application of a consistent dependent system.
Exercises
In Exercises -, put each system of linear equations into triangular form and solve the system if possible. Classify each system as consistent independent, consistent dependent, or inconsistent.
Find two other forms of the parametric solution to Exercise above by reorganizing the equations so that or can be the free variable.
At The Crispy Critter's Head Shop and Patchouli Emporium along with their dried up weeds, sunflower seeds and astrological postcards they sell an herbal tea blend. By weight, Type I herbal tea is 30% peppermint, 40% rose hips and 30% chamomile, Type II has percents 40%, 20% and 40%, respectively, and Type III has percents 35%, 30% and 35%, respectively. How much of each Type of tea is needed to make 2 pounds of a new blend of tea that is equal parts peppermint, rose hips and chamomile?
Discuss with your classmates how you would approach Exercise above if they needed to use up a pound of Type I tea to make room on the shelf for a new canister.
If you were to try to make 100 mL of a acid solution using stock solutions at and , respectively, what would the triangular form of the resulting system look like? Explain.
Answers
Because triangular form is not unique, we give only one possible answer to that part of the question. Yours may be different and still be correct.
Consistent independent Solution
Consistent independent Solution
Consistent dependent Solution for all real numbers
Inconsistent No solution
Consistent dependent Solution for all real numbers
Consistent independent Solution
Consistent independent Solution
Inconsistent no solution
Consistent independent Solution
Consistent independent Solution
Consistent independent Solution
Consistent dependent Solution for all real numbers
Inconsistent no solution
Consistent independent Solution
Consistent dependent Solution for all real numbers
Consistent dependent Solution for all real numbers and
Consistent independent Solution
Inconsistent No solution
If is the free variable then the solution is and if is the free variable then the solution is .
pounds of Type I, pounds of Type II and pounds of Type III where .
Adapted from Precalculus, Preliminary 4th Edition (integrated calculus), by Carl Stitz and Jeff Zeager (stitz-zeager.com), licensed under CC BY-NC-SA 3.0. Changes were made: reformatted as an accessible XYZ web edition. License: CC-BY-NC-SA-3.0.
These eBooks are a prerelease and are not yet certified conformant with WCAG 2.1 AA or ADA Title II. Every page is built against an automated accessibility gate, and the published editions will meet ADA Title II requirements when they release in late September 2026. If something is unusable, please tell us.