Linear Algebra, Interactive EditionXYZ Homework Edition

⇩ Download ▾

2.5 When a Third Vector Is Redundant

The previous section left a matrix with two columns and a plane's worth of reach, and closed on an obvious idea for enlarging it: add another column. Keep 𝐯1=(1,0,0.5)\mathbf{v}_1 = (1, 0, 0.5) and 𝐯2=(0,1,0.5)\mathbf{v}_2 = (0, 1, 0.5), and bring in a third vector

𝐯 3 = ( 1 , 1 , h ) \mathbf{v}_3 = (1, 1, h)

whose tip sits above or below the point (1,1)(1, 1) at a height hh you control. The first two vectors span the plane z=0.5x+0.5yz = 0.5x + 0.5y, and the question is whether 𝐯3\mathbf{v}_3 buys anything. It does exactly when it escapes that plane — a vector already lying in the sheet adds only combinations the sheet already contained. The figure below hangs the third vector on a slider so you can watch it escape, land, and escape again.

A semi-transparent tilted plane through the origin, the span of a red vector (1, 0, 0.5) and a blue vector (0, 1, 0.5) that both lie flat inside it. A green vector runs from the origin to (1, 1, h), and an amber segment drops from its tip to a white dot marking the point (1, 1, 1) on the plane, measuring how far the green vector stands out of the sheet. A slider h moves the green tip up and down. When h is 1 the amber segment closes to nothing, the green vector lies in the plane, and it equals the red plus the blue; at every other h the green vector escapes the plane and the three vectors together reach all of space.Explore in 3D (opens in a new tab)

A semi-transparent tilted plane through the origin, the span of a red vector (1, 0, 0.5) and a blue vector (0, 1, 0.5) that both lie flat inside it. A green vector runs from the origin to (1, 1, h), and an amber segment drops from its tip to a white dot marking the point (1, 1, 1) on the plane, measuring how far the green vector stands out of the sheet. A slider h moves the green tip up and down. When h is 1 the amber segment closes to nothing, the green vector lies in the plane, and it equals the red plus the blue; at every other h the green vector escapes the plane and the three vectors together reach all of space.

The plane spanned by the red 𝐯1=(1,0,0.5)\mathbf{v}_1 = (1, 0, 0.5) and the blue 𝐯2=(0,1,0.5)\mathbf{v}_2 = (0, 1, 0.5), both lying flat in it, with the green 𝐯3=(1,1,h)\mathbf{v}_3 = (1, 1, h) running from the origin to a tip the slider hh raises and lowers. The amber segment measures the gap from that tip down to the white dot at (1,1,1)(1, 1, 1), which is where the plane sits underneath it.

Explore the figure

  1. At the default h=2h = 2 the green vector stands clear of the sheet and the amber gap is one unit long. Orbit until you are convinced that no amount of red and blue — stretched, flipped, added — could ever reach that tip, because every combination of them stays in the plane.
  2. Drag hh down to 11. The gap closes, the white dot swallows the green tip, and the green vector lies flat in the sheet. It has arrived at (1,1,1)(1, 1, 1), which is 𝐯1+𝐯2\mathbf{v}_1 + \mathbf{v}_2: the third vector has become a combination of the first two.
  3. Keep dragging to h=0h = 0. The green vector escapes again, now leaving the plane on the underside. Escape is the ordinary situation; the landing at h=1h = 1 was the accident.
  4. Sweep hh across the whole slider and count the settings at which the green vector lies in the plane. As in the last section, the plane is a graph z=0.5x+0.5yz = 0.5x + 0.5y, so the vertical line through (1,1)(1, 1) meets it exactly once — so among all the heights, exactly one makes the third vector redundant.

The test, and what it measures

The definition names what you watched. Vectors 𝐯1,…,𝐯k\mathbf{v}_1, \dots, \mathbf{v}_k are linearly independent when the only combination of them equal to the zero vector is the one with all coefficients zero. If some combination with a coefficient that is not zero produces 0\mathbf{0}, they are dependent, and that combination is called a dependency relation.

Run the test. We need every (c1,c2,c3)(c_1, c_2, c_3) with c1𝐯1+c2𝐯2+c3𝐯3=0c_1\mathbf{v}_1 + c_2\mathbf{v}_2 + c_3\mathbf{v}_3 = \mathbf{0}, which is three equations, one per coordinate:

c 1 + c 3 = 0 , c 2 + c 3 = 0 , 0.5 c 1 + 0.5 c 2 + h c 3 = 0 c_1 + c_3 = 0, \qquad c_2 + c_3 = 0, \qquad 0.5c_1 + 0.5c_2 + hc_3 = 0

The first two hand over c1=−c3c_1 = -c_3 and c2=−c3c_2 = -c_3 immediately. Substituting both into the third leaves

− 0.5 c 3 − 0.5 c 3 + h c 3 = ( h − 1 ) c 3 = 0 -0.5c_3 - 0.5c_3 + hc_3 = (h - 1)\,c_3 = 0

and now everything hinges on the factor h−1h - 1. If h≠1h \ne 1 it is nonzero, forcing c3=0c_3 = 0, hence c1=c2=0c_1 = c_2 = 0: only the trivial combination works, and the three vectors are independent. If h=1h = 1 the factor dies, c3c_3 is free, and taking c3=−1c_3 = -1 gives the dependency relation

𝐯 1 + 𝐯 2 − 𝐯 3 = 0 \mathbf{v}_1 + \mathbf{v}_2 - \mathbf{v}_3 = \mathbf{0}

which is step 2 of your exploration, written algebraically.

The quantity h−1h - 1 that decided everything has a name you have already met in a different costume. Arrange the three vectors as the columns of a matrix and take its determinant.

−1+h-1 + h
The determinant of the three columns ✓ Computed · mojocas 0.1.0 ✓ Agrees with the text The determinant of the three columns, computed exactly by mojocas 0.1.0, and confirmed to agree with the result stated in the text.

The three vectors stacked as columns and handed to a computer algebra system: the determinant is exactly the factor h−1h - 1 that the elimination produced. It is nonzero for every hh but one, and it vanishes at h=1h = 1 — the single slider setting at which the green vector lands in the plane. Chapter 4 explains why a determinant knows this: it is measuring the volume of the box the three vectors build, and a box whose three edges lie in one plane has no volume at all.

Independence is about spans, not about vectors

Dependence is not a defect of any one vector; it is a statement about the set. At h=1h = 1 the relation 𝐯1+𝐯2−𝐯3=0\mathbf{v}_1 + \mathbf{v}_2 - \mathbf{v}_3 = \mathbf{0} can be solved for any of the three, so each is a combination of the other two and no one of them is the redundant one. What is true is that the set carries a passenger: some vector can be dropped without shrinking the span, which is why "redundant" describes the situation better than it describes any member of it.

That is also the practical payoff. When the three are independent — every hh but one — their span is all of ℝ3\mathbb{R}^3, so the equation A𝐱=𝐛A\mathbf{x} = \mathbf{b} from the last section becomes solvable for every target 𝐛\mathbf{b}, and solvable in exactly one way. When h=1h = 1 the span stays the plane it was, most targets remain out of reach, and the ones in reach are now reachable in infinitely many ways: adding any multiple of (1,1,−1)(1, 1, -1) to a solution gives another solution, since that combination contributes nothing.

An original work of XYZ Homework, built around interactive XYZ 3D figures. Chapters 1–6 follow the topic sequence of Interactive Linear Algebra (Margalit & Rabinoff, Georgia Tech, GNU FDL). Chapter 0's scope (its topics, their order, and the idea each figure shows) follows the Vectors chapter of Ximera's Linear Algebra: An Interactive Introduction. The prose, worked examples and figures were written for this book, which is not affiliated with or endorsed by the authors of either work. License: CC-BY-NC-SA-4.0.

These eBooks are a prerelease and are not yet certified conformant with WCAG 2.1 AA or any other accessibility standard. Every page is built against an automated accessibility gate, and our target for the published editions is WCAG 2.2 Level AA. If something is unusable, please tell us.