📚 Applied Finite Mathematics
⇩ Download ▾

7.1 Probability

Chapter Overview

In this chapter, you will learn to:

  1. Write sample spaces.
  2. Determine whether two events are mutually exclusive.
  3. Use the Addition Rule.
  4. Calculate probabilities using both tree diagrams and combinations.
  5. Do problems involving conditional probability.
  6. Determine whether two events are independent.

Sample Spaces and Probability

If two coins are tossed, what is the probability that both coins will fall heads? The problem seems simple enough, but it is not uncommon to hear the incorrect answer 1/3 size 12{1/3} {}. A student may incorrectly reason that if two coins are tossed there are three possibilities, one head, two heads, or no heads. Therefore, the probability of two heads is one out of three. The answer is wrong because if we toss two coins there are four possibilities and not three. For clarity, assume that one coin is a penny and the other a nickel. Then we have the following four possibilities.

HH HT TH TT

The possibility HT, for example, indicates a head on the penny and a tail on the nickel, while TH represents a tail on the penny and a head on the nickel.

It is for this reason, we emphasize the need for understanding sample spaces.

An act of flipping coins, rolling dice, drawing cards, or surveying people are referred to as an experiment.

Now that we understand the concept of a sample space, we will define probability.

Probability For a sample space S size 12{S} {}, and an outcome A size 12{A} {} of S size 12{S} {}, the following two properties are satisfied.

  1. If A size 12{A} {} is an outcome of a sample space, then the probability of A size 12{A} {}, denoted by P(A) size 12{P left (A right )} {}, is between 0 and 1, inclusive.

    0 P (A ) 1 size 12{0 <= P left (A right ) <= 1} {}

  2. The sum of the probabilities of all the outcomes in S size 12{S} {} equals 1.

The example we just considered consisted of only one outcome of the sample space. We are often interested in finding probabilities of several outcomes represented by an event.

An event is a subset of a sample space. If an event consists of only one outcome, it is called a simple event.

Mutually Exclusive Events and the Addition Rule

In the the related section, we learned to find the union, intersection, and complement of a set. We will now use these set operations to describe events.

The union of two events E size 12{E} {} and F size 12{F} {}, EF size 12{E union F} {}, is the set of outcomes that are in E size 12{E} {} or in F size 12{F} {} or in both.

The intersection of two events E size 12{E} {} and F size 12{F} {}, EF size 12{E intersection F} {}, is the set of outcomes that are in both E size 12{E} {} and F size 12{F} {}.

The complement of an event E size 12{E} {}, denoted by Ec size 12{E rSup { size 8{c} } } {}, is the set of outcomes in the sample space S size 12{S} {} that are not in E size 12{E} {}. It is worth noting that P(EC)=1P(E) size 12{P left (E rSup { size 8{C} } right )=1 - P left (E right )} {}. This follows from the fact that if the sample space has n size 12{n} {} elements and E size 12{E} {} has k size 12{k} {} elements, then Ec size 12{E rSup { size 8{c} } } {} has nk size 12{n - k} {} elements. Therefore,

P(EC)=nkn=1kn=1P(E) size 12{P left (E rSup { size 8{C} } right )= { {n - k} over {n} } =1 - { {k} over {n} } =1 - P left (E right )} {}.

Of particular interest to us are the events whose outcomes do not overlap. We call these events mutually exclusive.

Two events E size 12{E} {} and F size 12{F} {} are said to be mutually exclusive if they do not intersect. That is, EF= size 12{E intersection F=" 00000"} {}.

Next we'll determine whether a given pair of events are mutually exclusive.

We will now consider problems that involve the union of two events.

We summarize this section by listing the important rules.

Probability Using Tree Diagrams and Combinations

In this section, we will apply previously learnt counting techniques in calculating probabilities, and use tree diagrams to help us gain a better understanding of what is involved.

We begin with an example.

We now demonstrate the above results with a tree diagram.

We end the section by solving a problem called the Birthday Problem.

Conditional Probability

Suppose you and a friend wish to play a game that involves choosing a single card from a well-shuffled deck. Your friend deals you one card, face down, from the deck and offers you the following deal: If the card is a king, he will pay you $5, otherwise, you pay him $1. Should you play the game?

You reason in the following manner. Since there are four kings in the deck, the probability of obtaining a king is 4/52 size 12{4/"52"} {} or 1/13 size 12{1/"13"} {}. And, probability of not obtaining a king is 12/13 size 12{"12"/"13"} {}. This implies that the ratio of your winning to losing is 1 to 12, while the payoff ratio is only $1 to $5. Therefore, you determine that you should not play.

Now consider the following scenario. While your friend was dealing the card, you happened to get a glance of it and noticed that the card was a face card. Should you, now, play the game?

Since there are 12 face cards in the deck, the total elements in the sample space are no longer 52, but just 12. This means the chance of obtaining a king is 4/12 size 12{4/"12"} {} or 1/3 size 12{1/3} {}. So your chance of winning is 1/3 size 12{1/3} {} and of losing 2/3 size 12{2/3} {}. This makes your winning to losing ratio 1 to 2 which fares much better with the payoff ratio of $1 to $5. This time, you determine that you should play.

In the second part of the above example, we were finding the probability of obtaining a king knowing that a face card had shown. This is an example of conditional probability. Whenever we are finding the probability of an event E under the condition that another event F has happened, we are finding conditional probability.

The symbol P(EF) size 12{P left (E \lline F right )} {} denotes the problem of finding the probability of E size 12{E} {} given that F size 12{F} {} has occurred. We read P(EF) size 12{P left (E \lline F right )} {} as "the probability of E size 12{E} {}, given F size 12{F} {}."

Let us now develop a formula for the conditional probability P(EF) size 12{P left (E \lline F right )} {}.

Suppose an experiment consists of n size 12{n} {} equally likely events. Further suppose that there are m size 12{m} {} elements in F size 12{F} {}, and c size 12{c} {} elements in EF size 12{E intersection F} {}, as shown in the following Venn diagram.

The figure shows that everything within the square is equal to S. In the Venn diagram m-c is equal to F where c is equal to both E and F.
Figure 7.4

If the event F size 12{F} {} has occurred, the set of all possible outcomes is no longer the entire sample space, but instead, the subset F size 12{F} {}. Therefore, we only look at the set F size 12{F} {} and at nothing outside of F size 12{F} {}. Since F size 12{F} {} has m size 12{m} {} elements, the denominator in the calculation of P(EF) size 12{P left (E \lline F right )} {} is m. We may think that the numerator for our conditional probability is the number of elements in E size 12{E} {}. But clearly we cannot consider the elements of E size 12{E} {} that are not in F size 12{F} {}. We can only count the elements of E size 12{E} {} that are in F size 12{F} {}, that is, the elements in EF size 12{E intersection F} {}. Therefore,

P ( E F ) = c m size 12{P left (E \lline F right )= { {c} over {m} } } {}

Dividing both the numerator and the denominator by n size 12{n} {}, we get

P ( E F ) = c / n m / n size 12{P left (E \lline F right )= { {c/n} over {m/n} } } {}

But c/n=P(EF) size 12{c/n=P left (E intersection F right )} {}, and m/n=P(F) size 12{m/n=P left (F right )} {}.

Substituting, we derive the following formula for P(EF) size 12{P left (E \lline F right )} {}.

Independent Events

In, we considered conditional probabilities. In some examples, the probability of an event changed when additional information was provided. For instance, the probability of obtaining a king from a deck of cards, changed from 4/52 size 12{4/"52"} {} to 4/12 size 12{4/"12"} {}, when we were given the condition that a face card had already shown. This is not always the case. The additional information may or may not alter the probability of the event. For example consider the following example.

The reader should observe that in the above example,

P ( The card is a king A red card has shown ) = P (The card is a king ) size 12{P left ("The card is a king" \lline " A red card has shown" right )=P left ("The card is a king" right )} {}

In other words, the additional information, a red card has shown, did not affect the probability of obtaining a king. Whenever the probability of an event E size 12{E} {} is not affected by the occurrence of another event F size 12{F} {}, and vice versa, we say that the two events E size 12{E} {} and F size 12{F} {} are independent. This leads to the following definition.

Two Events E size 12{E} {} and F size 12{F} {} are independent if and only if at least one of the following two conditions is true.

  1. P(EF)=P(E) size 12{P left (E \lline F right )=P left (E right )} {} or
  2. P ( F E ) = P (F ) size 12{P left (F \lline E right )=P left (F right )} {}

If the events are not independent, then they are dependent.

Next, we need to develop a test to determine whether two events are independent.

We recall the conditional probability formula.

P(EF)=P(EF)P(F) size 12{P left (E \lline F right )= { {P left (E intersection F right )} over {P left (F right )} } } {}

Multiplying both sides by P(F) size 12{P left (F right )} {}, we get

P(EF)=P(EF)P(F) size 12{P left (E intersection F right )=P left (E \lline F right )P left (F right )} {}

Now if the two events are independent, then by definition

P(EF)=P(E) size 12{P left (E \lline F right )=P left (E right )} {}

Substituting, P(EF)=P(E)P(F) size 12{P left (E intersection F right )=P left (E right )P left (F right )} {}

We state it formally as follows.

Test for Independence Two Events E size 12{E} {} and F size 12{F} {} are independent if and only if

P(EF)=P(E)P(F) size 12{P left (E intersection F right )=P left (E right )P left (F right )} {}

Adapted from Applied Finite Mathematics by Rupinder Sekhon (De Anza College), originally published by OpenStax CNX (cnx.org, collection col10613), licensed under CC BY 3.0. Changes were made. License: CC-BY-3.0.

These eBooks are a prerelease and are not yet certified conformant with WCAG 2.1 AA or ADA Title II. Every page is built against an automated accessibility gate, and the published editions will meet ADA Title II requirements when they release in late September 2026. If something is unusable, please tell us.