Login
📚 Discrete Mathematics
Chapters ▾
⇩ Download ▾

3.5 Induction

Mathematical induction is a proof technique, not unlike direct proof or proof by contradiction or combinatorial proof.1 In other words, induction is a style of argument we use to convince ourselves and others that a mathematical statement is always true. Many mathematical statements can be proved by simply explaining what they mean. Others are very difficult to prove—in fact, there are relatively simple mathematical statements which nobody yet knows how to prove. To facilitate the discovery of proofs, it is important to be familiar with some standard styles of arguments. Induction is one such style. Let's start with an example:

Stamps

Perhaps in investigating the problem above you picked some amounts of postage, and then figured out whether you could make that amount using just 8-cent and 5-cent stamps. Perhaps you did this in order: can you make 1 cent of postage? Can you make 2 cents? 3 cents? And so on. If this is what you did, you were actually answering a sequence of questions. We have methods for dealing with sequences. Let's see if that helps.

Actually, we will not make a sequence of questions, but rather a sequence of statements. Let P ( n ) be the statement “you can make n cents of postage using just 8-cent and 5-cent stamps.” Since for each value of n , P ( n ) is a statement, it is either true or false. So if we form the sequence of statements

P ( 1 ) , P ( 2 ) , P ( 3 ) , P ( 4 ) ,

, the sequence will consist of T 's (for true) and F 's (for false). In our particular case the sequence starts

F , F , F , F , T , F , F , T , F , T , F , F , T ,

because P ( 1 ) , P ( 2 ) , P ( 3 ) , P ( 4 ) are all false (you cannot make 1, 2, 3, or 4 cents of postage) but P ( 5 ) is true (use one 5-cent stamp), and so on.

Let's think a bit about how we could find the value of P ( n ) for some specific n (the “value” will be either T or F ). How did we find the value of the n th term of a sequence of numbers? How did we find a n ? There were two ways we could do this: either there was a closed formula for a n , so we could plug in n into the formula and get our output value, or we had a recursive definition for the sequence, so we could use the previous terms of the sequence to compute the n th term. When dealing with sequences of statements, we could use either of these techniques as well. Maybe there is a way to use n itself to determine whether we can make n cents of postage. That would be something like a closed formula. Or instead we could use the previous terms in the sequence (of statements) to determine whether we can make n cents of postage. That is, if we know the value of P ( n 1 ) , can we get from that to the value of P ( n ) ? That would be something like a recursive definition for the sequence. Remember, finding recursive definitions for sequences was often easier than finding closed formulas. The same is true here.

Suppose I told you that P ( 43 ) was true (it is). Can you determine from this fact the value of P ( 44 ) (whether it true or false)? Yes you can. Even if we don't know how exactly we made 43 cents out of the 5-cent and 8-cent stamps, we do know that there was some way to do it. What if that way used at least three 5-cent stamps (making 15 cents)? We could replace those three 5-cent stamps with two 8-cent stamps (making 16 cents). The total postage has gone up by 1, so we have a way to make 44 cents, so P ( 44 ) is true. Of course, we assumed that we had at least three 5-cent stamps. What if we didn't? Then we must have at least three 8-cent stamps (making 24 cents). If we replace those three 8-cent stamps with five 5-cent stamps (making 25 cents) then again we have bumped up our total by 1 cent so we can make 44 cents, so P ( 44 ) is true.

Notice that we have not said how to make 44 cents, just that we can, on the basis that we can make 43 cents. How do we know we can make 43 cents? Perhaps because we know we can make 42 cents, which we know we can do because we know we can make 41 cents, and so on. It's a recursion! As with a recursive definition of a numerical sequence, we must specify our initial value. In this case, the initial value is “ P ( 1 ) is false.” That's not good, since our recurrence relation just says that P ( k + 1 ) is true if P ( k ) is also true. We need to start the process with a true P ( k ) . So instead, we might want to use “ P ( 28 ) is true” as the initial condition.

Putting this all together we arrive at the following fact: it is possible to (exactly) make any amount of postage greater than 27 cents using just 5-cent and 8-cent stamps.2 In other words, P ( k ) is true for any k 28 . To prove this, we could do the following:

  1. Demonstrate that P ( 28 ) is true.
  2. Prove that if P ( k ) is true, then P ( k + 1 ) is true (for any k 28 ).

Suppose we have done this. Then we know that the 28th term of the sequence above is a T (using step 1, the initial condition or base case), and that every term after the 28th is T also (using step 2, the recursive part or inductive case). Here is what the proof would actually look like.

Formalizing Proofs

What we did in the stamp example above works for many types of problems. Proof by induction is useful when trying to prove statements about all natural numbers, or all natural numbers greater than some fixed first case (like 28 in the example above), and in some other situations too. In particular, induction should be used when there is some way to go from one case to the next – when you can see how to always “do one more.”

This is a big idea. Thinking about a problem inductively can give new insight into the problem. For example, to really understand the stamp problem, you should think about how any amount of postage (greater than 28 cents) can be made (this is non-inductive reasoning) and also how the ways in which postage can be made changes as the amount increases (inductive reasoning). When you are asked to provide a proof by induction, you are being asked to think about the problem dynamically; how does increasing n change the problem?

But there is another side to proofs by induction as well. In mathematics, it is not enough to understand a problem, you must also be able to communicate the problem to others. Like any discipline, mathematics has standard language and style, allowing mathematicians to share their ideas efficiently. Proofs by induction have a certain formal style, and being able to write in this style is important. It allows us to keep our ideas organized and might even help us with formulating a proof.

Here is the general structure of a proof by mathematical induction:

Sometimes the statement P ( n ) will only be true for values of n 4 , for example, or some other value. In such cases, replace all the 0's above with 4's (or the other value).

The other advantage of formalizing inductive proofs is it allows us to verify that the logic behind this style of argument is valid. Why does induction work? Think of a row of dominoes set up standing on their edges. We want to argue that in a minute, all the dominoes will have fallen down. For this to happen, you will need to push the first domino. That is the base case. It will also have to be that the dominoes are close enough together that when any particular domino falls, it will cause the next domino to fall. That is the inductive case. If both of these conditions are met, you push the first domino over and each domino will cause the next to fall, then all the dominoes will fall.

Induction is powerful! Think how much easier it is to knock over dominoes when you don't have to push over each domino yourself. You just start the chain reaction, and the rely on the relative nearness of the dominoes to take care of the rest.

Think about our study of sequences. It is easier to find recursive definitions for sequences than closed formulas. Going from one case to the next is easier than going directly to a particular case. That is what is so great about induction. Instead of going directly to the (arbitrary) case for n , we just need to say how to get from one case to the next.

When you are asked to prove a statement by mathematical induction, you should first think about why the statement is true, using inductive reasoning. Explain why induction is the right thing to do, and roughly why the inductive case will work. Then, sit down and write out a careful, formal proof using the structure above.

Examples

Here are some examples of proof by mathematical induction.

Note that in the part of the proof in which we proved P ( k + 1 ) from P ( k ) , we used the equation P ( k ) . This was the inductive hypothesis. Seeing how to use the inductive hypotheses is usually straight forward when proving a fact about a sum like this. In other proofs, it can be less obvious where it fits in.

We had to be a little bit clever (i.e., use some algebra) to locate the 6 k 1 inside of 6 k + 1 1 before we could apply the inductive hypothesis. This is what can make inductive proofs challenging.

In the two examples above, we started with n = 1 or n = 0 . We can start later if we need to.

The previous example might remind you of the racetrack principle from calculus, which says that if f ( a ) < g ( a ) , and f ( x ) < g ( x ) for x > a , then f ( x ) < g ( x ) for x > a . Same idea: the larger function is increasing at a faster rate than the smaller function, so the larger function will stay larger. In discrete math, we don't have derivatives, so we look at differences. Thus induction is the way to go.

Warning:

With great power, comes great responsibility. Induction isn't magic. It seems very powerful to be able to assume P ( k ) is true. After all, we are trying to prove P ( n ) is true and the only difference is in the variable: k vs. n . Are we assuming that what we want to prove is true? Not really. We assume P ( k ) is true only for the sake of proving that P ( k + 1 ) is true.

Still you might start to believe that you can prove anything with induction. Consider this incorrect “proof” that every Canadian has the same eye color: Let P ( n ) be the statement that any n Canadians have the same eye color. P ( 1 ) is true, since everyone has the same eye color as themselves. Now assume P ( k ) is true. That is, assume that in any group of k Canadians, everyone has the same eye color. Now consider an arbitrary group of k + 1 Canadians. The first k of these must all have the same eye color, since P ( k ) is true. Also, the last k of these must have the same eye color, since P ( k ) is true. So in fact, everyone the group must have the same eye color. Thus P ( k + 1 ) is true. So by the principle of mathematical induction, P ( n ) is true for all n .

Clearly something went wrong. The problem is that the proof that P ( k ) implies P ( k + 1 ) assumes that k 2 . We have only shown P ( 1 ) is true. In fact, P ( 2 ) is false.

Strong Induction

Sometimes, to prove that P ( k + 1 ) is true, it would be helpful to know that P ( k ) and P ( k 1 ) and P ( k 2 ) are all true. Consider the following puzzle:

You have a rectangular chocolate bar, made up of n identical squares of chocolate. You can take such a bar and break it along any row or column. How many times will you have to break the bar to reduce it to n single chocolate squares?

At first, this question might seem impossible. Perhaps I meant to ask for the smallest number of breaks needed? Let's investigate.

Start with some small cases. If n = 2 , you must have a 1 × 2 rectangle, which can be reduced to single pieces in one break. With n = 3 , we must have a 1 × 3 bar, which requires two breaks: the first break creates a single square and a 1 × 2 bar, which we know takes one (more) break.

What about n = 4 ? Now we could have a 2 × 2 bar, or a 1 × 4 bar. In the first case, break the bar into two 2 × 2 bars, each which require one more break (that's a total of three breaks required). If we started with a 1 × 4 bar, we have choices for our first break. We could break the bar in half, creating two 1 × 2 bars, or we could break off a single square, leaving a 1 × 3 bar. But either way, we still need two more breaks, giving a total of three.

It is starting to look like no matter how we break the bar (and no matter how the n squares are arranged into a rectangle), we will always have the same number of breaks required. It also looks like that number is one less than n :

It makes sense to prove this by induction because after breaking the bar once, you are left with smaller chocolate bars. Reducing to smaller cases is what induction is all about. We can inductively assume we already know how to deal with these smaller bars. The problem is, if we are trying to prove the inductive case about a ( k + 1 ) -square bar, we don't know that after the first break the remaining bar will have k squares. So we really need to assume that our conjecture is true for all cases less than k + 1 .

Is it valid to make this stronger assumption? Remember, in induction we are attempting to prove that P ( n ) is true for all n . What if that were not the case? Then there would be some first n 0 for which P ( n 0 ) was false. Since n 0 is the first counterexample, we know that P ( n ) is true for all n < n 0 . Now we proceed to prove that P ( n 0 ) is actually true, based on the assumption that P ( n ) is true for all smaller n .

This is quite an advantage: we now have a stronger inductive hypothesis. We can assume that P ( 1 ) , P ( 2 ) , P ( 3 ) , … P ( k ) is true, just to show that P ( k + 1 ) is true. Previously, we just assumed P ( k ) for this purpose.

It is slightly easier if we change our variables for strong induction. Here is what the formal proof would look like:

Of course, it is acceptable to replace 0 with a larger base case if needed.3

Let's prove our conjecture about the chocolate bar puzzle:

Here is a more mathematically relevant example:

Whether you use regular induction or strong induction depends on the statement you want to prove. If you wanted to be safe, you could always use strong induction. It really is stronger, so can accomplish everything “weak” induction can. That said, using regular induction is often easier since there is only one place you can use the induction hypothesis. There is also something to be said for elegance in proofs. If you can prove a statement using simpler tools, it is nice to do so.

As a final contrast between the two forms of induction, consider once more the stamp problem. Regular induction worked by showing how to increase postage by one cent (either replacing three 5-cent stamps with two 8-cent stamps, or three 8-cent stamps with five 5-cent stamps). We could give a slightly different proof using strong induction. First, we could show five base cases: it is possible to make 28, 29, 30, 31, and 32 cents (we would actually say how each of these is made). Now assume that it is possible to make k cents of postage for all k < n as long as k 28 . As long as n > 32 , this means in particular we can make k = n 5 cents. Now add a 5-cent stamp to get make n cents.

On the way to the market, you exchange your cow for some magic dark chocolate espresso beans. These beans have the property that every night at midnight, each bean splits into two, effectively doubling your collection. You decide to take advantage of this and each morning (around 8am) you eat 5 beans.

  1. Explain why it is true that if at noon on day n you have a number of beans ending in a 5, then at noon on day n + 1 you will still have a number of beans ending in a 5.
  2. Why is the previous fact not enough to conclude that you will always have a number of beans ending in a 5? What additional fact would you need?
  3. Assuming you have the additional fact in part (b), and have successfully proved the fact in part (a), how do you know that you will always have a number of beans ending in a 5? Illustrate what is going on by carefully explaining how the two facts above prove that you will have a number of beans ending in a 5 on day 4 specifically. In other words, explain why induction works in this context.
  1. If we have a number of beans ending in a 5 and we double it, we will get a number of beans ending in a 0 (since 5 2 = 10 ). Then if we subtract 5, we will once again get a number of beans ending in a 5. Thus if on any day we have a number ending in a 5, the next day will also have a number ending in a 5.
  2. If you don't start with a number of beans ending in a 5 (on day 1), the above reasoning is still correct but not helpful. For example, if you start with a number ending in a 3, the next day you will have a number ending in a 1.
  3. Part (b) is the base case and part (a) is the inductive case. If on day 1 we have a number ending in a 5 (by part (b)), then on day 2 we will also have a number ending in a 5 (by part (a)). Then by part (a) again, we will have a number ending in a 5 on day 3. By part (a) again, this means we will have a number ending in a 5 on day 4
    The proof by induction would say that on every day we will have a number ending in a 5, and this works because we can start with the base case, then use the inductive case over and over until we get up to our desired n .

Use induction to prove for all n N that k = 0 n 2 k = 2 n + 1 1 .

Prove that 7 n 1 is a multiple of 6 for all n N .

Prove that 1 + 3 + 5 + + ( 2 n 1 ) = n 2 for all n 1 .

Prove that F 0 + F 2 + F 4 + + F 2 n = F 2 n + 1 1 where F n is the n th Fibonacci number.

Prove that 2 n < n ! for all n 4 . (Recall, n ! = 1 2 3 n .)

Prove, by mathematical induction, that F 0 + F 1 + F 2 + + F n = F n + 2 1 , where F n is the n th Fibonacci number ( F 0 = 0 , F 1 = 1 and F n = F n 1 + F n 2 ).

Zombie Euler and Zombie Cauchy, two famous zombie mathematicians, have just signed up for Twitter accounts. After one day, Zombie Cauchy has more followers than Zombie Euler. Each day after that, the number of new followers of Zombie Cauchy is exactly the same as the number of new followers of Zombie Euler (and neither lose any followers). Explain how a proof by mathematical induction can show that on every day after the first day, Zombie Cauchy will have more followers than Zombie Euler. That is, explain what the base case and inductive case are, and why they together prove that Zombie Cauchy will have more followers on the 4th day.

Find the largest number of points which a football team cannot get exactly using just 3-point field goals and 7-point touchdowns (ignore the possibilities of safeties, missed extra points, and two point conversions). Prove your answer is correct by mathematical induction.

It is not possible to score exactly 11 points. Can you prove that you can score n points for any n 12 ?

Prove that the sum of n squares can be found as follows

1 2 + 2 2 + 3 2 + . . . + n 2 = n ( n + 1 ) ( 2 n + 1 ) 6

.

Prove that the sum of the interior angles of a convex n -gon is ( n 2 ) 180 . (A convex n -gon is a polygon with n sides for which each interior angle is less than 180 .)

Start with ( k + 1 ) -gon and divide it up into a k -gon and a triangle.

What is wrong with the following “proof” of the “fact” that n + 3 = n + 7 for all values of n (besides of course that the thing it is claiming to prove is false)?

The only problem is that we never established the base case. Of course, when n = 0 , 0 + 3 0 + 7 .

The proof in the previous problem does not work. But if we modify the “fact,” we can get a working proof. Prove that n + 3 < n + 7 for all values of n N . You can do this proof with algebra (without induction), but the goal of this exercise is to write out a valid induction proof.

Find the flaw in the following “proof” of the “fact” that n < 100 for every n N .

The problem here is that while P ( 0 ) is true, and while P ( k ) P ( k + 1 ) for some values of k , there is at least one value of k (namely k = 99 ) when that implication fails. For a valid proof by induction, P ( k ) P ( k + 1 ) must be true for all values of k greater than or equal to the base case.

While the above proof does not work (it better not since the statement it is trying to prove is false!) we can prove something similar. Prove that there is a strictly increasing sequence a 1 , a 2 , a 3 , of numbers (not necessarily integers) such that a n < 100 for all n N . (By strictly increasing we mean a n < a n + 1 for all n . So each term must be larger than the last.)

For the inductive step, you can assume you have a strictly increasing sequence up to a k where a k < 100 . Now you just need to find the next term a k + 1 so that a k < a k + 1 < 100 . What should a k + 1 be?

What is wrong with the following “proof” of the “fact” that for all n N , the number n 2 + n is odd?

We once again failed to establish the base case: when n = 0 , n 2 + n = 0 which is even, not odd.

Now give a valid proof (by induction, even though you might be able to do so without using induction) of the statement, “for all n N , the number n 2 + n is even.”

For the inductive case, you will need to show that ( k + 1 ) 2 + ( k + 1 ) is even. Factor this out and locate the part of it that is k 2 + k . What have you assumed about that quantity?

Prove that there is a sequence of positive real numbers a 0 , a 1 , a 2 , such that the partial sum a 0 + a 1 + a 2 + + a n is strictly less than 2 for all n N . Hint: think about how you could define what a k + 1 is to make the induction argument work.

This is similar to Exercise, although there you were showing that a sequence had all its terms less than some value, and here you are showing that the sum is less than some value. But the partial sums forms a sequence, so this is actually very similar.

Prove that every positive integer is either a power of 2, or can be written as the sum of distinct powers of 2.

The proof will be by strong induction.

Prove, using strong induction, that every natural number is either a Fibonacci number or can be written as the sum of distinct Fibonacci numbers.

As with the previous question, we will want to subtract something from n in the inductive step. There we subtracted the largest power of 2 less than n . So what should you subtract here?

Note, you will still need to take care here that the sum you get from the inductive hypothesis, together with the number you subtracted will be a sum of distinct Fibonacci numbers. In fact, you could prove that the Fibonacci numbers in the sum are non-consecutive!

Use induction to prove that if n people all shake hands with each other, that the total number of handshakes is n ( n 1 ) 2 .

We have already proved this without using induction, but looking at it inductively sheds light onto the problem (and is fun).

The question you need to answer to complete the inductive step is, how many new handshakes take place when a person k + 1 enters the room. Why does adding this give you the correct formula?

Suppose that a particular real number x has the property that x + 1 x is an integer. Prove that x n + 1 x n is an integer for all natural numbers n .

You will need to use strong induction. For the inductive case, try multiplying ( x k + 1 x k ) ( x + 1 x ) and collect which terms together are integers.

Use induction to prove that k = 0 n ( n k ) = 2 n . That is, the sum of the n th row of Pascal's Triangle is 2 n .

Here's the idea: since every entry in Pascal's Triangle is the sum of the two entries above it, we can get the k + 1 st row by adding up all the pairs of entry from the k th row. But doing this uses each entry on the k th row twice. Thus each time we drop to the next row, we double the total. Of course, row 0 has sum 1 = 2 0 (the base case). Now try to make this precise with a formal induction proof. You will use the fact that ( n k ) = ( n 1 k 1 ) + ( n 1 k ) for the inductive case.

Use induction to prove ( 4 0 ) + ( 5 1 ) + ( 6 2 ) + + ( 4 + n n ) = ( 5 + n n ) . (This is an example of the hockey stick theorem.)

To see why this works, try it on a copy of Pascal's triangle. We are adding up the entries along a diagonal, starting with the 1 on the left-hand side of the 4th row. Suppose we add up the first 5 entries on this diagonal. The claim is that the sum is the entry below and to the left of the last of these 5 entries. Note that if this is true, and we instead add up the first 6 entries, we will need to add the entry one spot to the right of the previous sum. But these two together give the entry below them, which is below and left of the last of the 6 entries on the diagonal. If you follow that, you can see what is going on. But it is not a great proof. A formal induction proof is needed.

Use the product rule for logarithms ( log ( a b ) = log ( a ) + log ( b ) ) to prove, by induction on n , that log ( a n ) = n log ( a ) , for all natural numbers n 2 .

The idea here is that if we take the logarithm of a n , we can increase n by 1 if we multiply by another a (inside the logarithm). This results in adding 1 more log ( a ) to the total.

Let f 1 , f 2 , , f n be differentiable functions. Prove, using induction, that

( f 1 + f 2 + + f n ) = f 1 + f 2 + + f n

.

You may assume ( f + g ) = f + g for any differentiable functions f and g .

You are allowed to assume the base case. For the inductive case, group all but the last function together as one sum of functions, then apply the usual sum of derivatives rule, and then the inductive hypothesis.

Suppose f 1 , f 2 , , f n are differentiable functions. Use mathematical induction to prove the generalized product rule:

( f 1 f 2 f 3 f n ) = f 1 f 2 f 3 f n + f 1 f 2 f 3 f n + f 1 f 2 f 3 f n + + f 1 f 2 f 3 f n

.

You may assume the product rule for two functions is true.

For the inductive step, we know by the product rule for two functions that

( f 1 f 2 f 3 f k f k + 1 ) = ( f 1 f 2 f 3 f k ) f k + 1 + ( f 1 f 2 f 3 f k ) f k + 1

.

Then use the inductive hypothesis on the first summand, and distribute.

Here is an example of a more complicated induction technique called double induction.

You will prove that the Fibonacci numbers satisfy the identity F n 2 + F n + 1 2 = F 2 n + 1 . One way to do this is to prove the more general identity,

F m F n + F m + 1 F n + 1 = F m + n + 1

, and realize that when m = n we get our desired result.

Note that we now have two variables, so we want to prove this for all m 0 and all n 0 at the same time. For each such pair ( m , n ) , let P ( m , n ) be the statement F m F n + F m + 1 F n + 1 = F m + n + 1

  1. First fix m = 0 and give a proof by mathematical induction that P ( 0 , n ) holds for all n 0 . Note this proof will be very easy.
  2. Now fix an arbitrary n and give a proof by strong mathematical induction that P ( m , n ) holds for all m 0 .
  3. You can now conclude that P ( m , n ) holds for all m , n 0 . Do you believe that? Explain why this sort of induction is valid. For example, why do your proofs above guarantee that P ( 2 , 3 ) is true?

Given a square, you can cut the square into smaller squares by cutting along lines parallel to the sides of the original square (these lines do not need to travel the entire side length of the original square). For example, by cutting along the lines below, you will divide a square into 6 smaller squares:

One large square with five squares of half the side length wrapping around the top and right side, forming an even larger square.

Prove, using strong induction, that it is possible to cut a square into n smaller squares for any n 6 .

You will need three base cases. This is a very good hint actually, as it suggests that to prove P ( n ) is true, you would want to use the fact that P ( n 3 ) is true. So somehow you need to increase the number of squares by 3.

Discrete Mathematics: An Open Introduction, 3rd edition, by Oscar Levin (discrete.openmathbooks.org), licensed under CC BY-SA 4.0; this adaptation is distributed under the same license. License: CC-BY-SA-4.0.