Statistics · Unit 2 · Week 4 · Lesson 14 · 12 minute reading

When Knowing One Thing Changes Another

Conditional probability, tree diagrams, independence, and law of total probability.

By the end of this lesson, you should be able to

  • Compute conditional probabilities from joint counts.
  • Apply the law of total probability across a partition.
  • Check independence instead of confusing it with mutually exclusive events.

A survey finds that 60% of residents use public transit. Of transit users, 30% commute before 7 a.m.; of nonusers, only 10% do. What fraction of all residents commute that early?

The answer is not 30% and not 10%. We must weight both subgroups.

Conditional probabilities live inside denominators

If TT denotes transit use and EE denotes early commuting, then

P(E∣T)=P(E∩T)P(T).P(E\mid T)=\frac{P(E\cap T)}{P(T)}.

It means among transit users, what fraction commute early? Changing what we condition on changes the denominator and therefore the question.

Weighted branches

Partition the population by transit use:

P(E)=P(E∣T)P(T)+P(E∣Tc)P(Tc).P(E)=P(E\mid T)P(T)+P(E\mid T^c)P(T^c).

Using the fictional percentages gives

P(E)=.30(.60)+.10(.40)=.22.P(E)=.30(.60)+.10(.40)=.22.

So 22% commute early. A probability tree makes the same calculation visible: multiply along branches, then add disjoint branches ending in the event we care about.

This is called the law of total probability.

Check independence

Two events AA and BB are independent when

P(A∣B)=P(A)P(A\mid B)=P(A)

when conditioning is defined. Equivalently, P(A∩B)=P(A)P(B)P(A\cap B)=P(A)P(B).

In our example, P(E∣T)=.30P(E\mid T)=.30 but P(E)=.22P(E)=.22. The events are not independent. Knowing transit use changes the probability of early commuting.

Compare this with mutually exclusive events, which cannot happen together. A person cannot be simultaneously classified in two nonoverlapping transit categories, but the category and an early commute can certainly co-occur.

Why this matters for Bayesian reasoning

Bayes’ theorem reverses a conditional question by using the probability of the evidence across possible explanations. The base-rate laboratory is a probability tree in disguise: disease/no disease branches, followed by positive/negative test branches.

Always label which conditional probability each percentage represents. Sensitivity is not positive predictive value.

Check yourself

  1. Find the probability that a resident both uses transit and commutes early.
  2. If everyone commuted early at the same rate regardless of transit, what equality would hold?
  3. Why can you add P(E∩T)P(E\cap T) and P(E∩Tc)P(E\cap T^c) without subtracting an overlap?
Worked responses
  1. .60(.30)=.18.60(.30)=.18.

  2. P(E∣T)=P(E∣Tc)=P(E)P(E\mid T)=P(E\mid T^c)=P(E), assuming both groups have positive probability.

  3. Transit use and nonuse are disjoint events that partition the population.

Build the entire joint table

For 1,000 hypothetical residents, the stated percentages correspond to the following expected counts:

Early Not early Total
Transit 180 420 600
No transit 40 360 400
Total 220 780 1000

Thus P(T∣E)=180/220=9/11≈0.81818P(T\mid E)=180/220=9/11\approx0.81818, whereas P(E∣T)=180/600=0.30P(E\mid T)=180/600=0.30. Conditioning in the other direction changes the denominator. The joint probability 0.180.18 is the same intersection whichever event is named first, but the conditional probabilities are not interchangeable.

For a partition B1,…,BkB_1,\ldots,B_k with positive probabilities, P(A)=∑iP(A∣Bi)P(Bi)P(A)=\sum_iP(A\mid B_i)P(B_i). This follows by splitting AA into disjoint intersections A∩BiA\cap B_i and applying the multiplication rule. Bayes then divides one of those intersections by their total: P(Bj∣A)=P(A∣Bj)P(Bj)/P(A)P(B_j\mid A)=P(A\mid B_j)P(B_j)/P(A) when P(A)>0P(A)>0.

Pairwise independence is weaker than mutual independence for three or more events. Toss two fair independent coins. Let A mean the first is heads, B the second is heads, and C mean the two agree. Each pair is independent, yet P(A∩B∩C)=1/4P(A\cap B\cap C)=1/4, not (1/2)3(1/2)^3. Conditioning on two events can reveal a dependence invisible in pairwise checks.

Further problems

  1. From the table, compute P(T∣Ec)P(T\mid E^c).
  2. If P(A)=0.4P(A)=0.4, P(B)=0.5P(B)=0.5, and P(A∩B)=0.2P(A\cap B)=0.2, are A and B independent? Mutually exclusive?
  3. Why is conditioning on an event of probability zero not defined by the elementary ratio formula?
Worked further solutions
  1. 420/780=7/13≈0.53846420/780=7/13\approx0.53846.
  2. They are independent because the intersection equals the product. They are not mutually exclusive because the intersection probability is positive.
  3. The denominator would be zero. Conditional distributions at particular values of continuous variables require more advanced definitions than this elementary event formula.
Your study progress · Optional

Keep your place

Mark this lesson complete after you've read it, attempted its exercises, and explained its central idea in your own words.

Progress is not saved unless you choose to mark the lesson complete.

Saved only in this browser's local storage. No required account, server transmission, or analytics. You can reset your saved progress on the course page. Clearing browser data also clears the record.