Podit
📚 Probability and Statistics: Conditional Probability and Related Concepts
Course: ISE 205 Probability and Statistics (2025-2026 Fall) Instructor: Dr. Burcu ÇARKLI YAVUZ (bcarkli@sakarya.edu.tr) Sources: Lecture Audio Transcript, PDF/PowerPoint Text
🎯 Introduction
This study material covers fundamental concepts in probability and statistics, focusing on Conditional Probability, Independent Events, the Total Probability Rule, and Bayes' Theorem. These topics are crucial for understanding how the occurrence of one event influences the probability of another, and how to update probabilities based on new information. We will explore definitions, formulas, and practical examples to solidify your understanding.
1. 🤝 Conditional Probability
Conditional probability quantifies the likelihood of an event occurring, given that another event has already happened. It's a cornerstone of statistical analysis, allowing us to refine our probability assessments with new information.
📚 Definition
The probability of event A occurring given that event B has occurred is denoted as P(A|B).
📝 Formula
The formula for calculating conditional probability is: $$P(A|B) = \frac{P(A \cap B)}{P(B)}$$ Where:
- P(A|B): The conditional probability of A given B.
- P(A ∩ B): The probability of both events A and B occurring (their intersection).
- P(B): The probability of event B occurring.
- Condition: P(B) must not be equal to 0.
✅ Key Points
- Events A and B are typically related (dependent) when discussing conditional probability.
- P(A|B) signifies the probability of A happening when B is known to have happened.
💡 Example 1: Car Dealer Service Quality
A consumer research organization surveyed 50 car dealers regarding their maintenance and repair services during the warranty period.
| Experience Level | Good Service | Poor Service | Total | | :------------------------------- | :----------- | :----------- | :---- | | 10 years or more | 16 | 4 | 20 | | Less than 10 years | 10 | 20 | 30 | | Total | 26 | 24 | 50 |
Let:
- A: Event of a dealer providing good service.
- B: Event of a dealer having 10 years or more experience.
a) Probability of selecting a dealer with good service (P(A)): Total good service dealers = 16 + 10 = 26 Total dealers = 50 $$P(A) = \frac{26}{50} = 0.52$$
b) Probability of good service, given the dealer has 10+ years experience (P(A|B)): We are given that the dealer has 10+ years experience (event B has occurred). Number of dealers with 10+ years experience AND good service (A ∩ B) = 16 Total dealers with 10+ years experience (B) = 16 + 4 = 20 Using the formula: $$P(A|B) = \frac{P(A \cap B)}{P(B)} = \frac{16/50}{20/50} = \frac{16}{20} = 0.80$$ This shows that if we know the dealer has more experience, the probability of receiving good service increases significantly.
💡 Example 2: Children's Genders
In a family with two children, if it is known that the children have different genders, what is the probability that the elder child is a boy?
1️⃣ Define Sample Space (S): The possible gender combinations for two children are: S = {Boy-Boy (BB), Boy-Girl (BG), Girl-Boy (GB), Girl-Girl (GG)}
2️⃣ Define Events:
- B: Children have different genders = {BG, GB}
- A: Elder child is a boy = {BB, BG}
- A ∩ B: Elder child is a boy AND children have different genders = {BG}
3️⃣ Calculate Probabilities:
- P(A ∩ B) = 1/4 (since there's 1 outcome out of 4 in S)
- P(B) = 2/4 = 1/2 (since there are 2 outcomes out of 4 in S)
4️⃣ Apply Conditional Probability Formula: $$P(A|B) = \frac{P(A \cap B)}{P(B)} = \frac{1/4}{1/2} = \frac{1}{2}$$ So, if the children have different genders, there's a 50% chance the elder child is a boy.
2. ✖️ Product Rule (Multiplication Rule)
The product rule is derived directly from the conditional probability formula and is used to find the probability of two events both occurring.
📚 Definition
For any two events A and B in a sample space S, if P(A) ≠ 0, then the probability of both A and B occurring is: $$P(A \cap B) = P(A)P(B|A)$$ Similarly, if P(B) ≠ 0, then: $$P(A \cap B) = P(B)P(A|B)$$
💡 Example: Defective Graphics Cards
Suppose there are 240 graphics cards, 15 of which are defective. If two graphics cards are randomly selected consecutively without replacement, what is the probability that both are defective?
Let:
- A1: The first card selected is defective.
- A2: The second card selected is defective.
1️⃣ Probability of the first card being defective (P(A1)): $$P(A1) = \frac{15}{240}$$
2️⃣ Probability of the second card being defective, given the first was defective (P(A2|A1)): After selecting one defective card, there are 14 defective cards left and 239 total cards. $$P(A2|A1) = \frac{14}{239}$$
3️⃣ Apply the Product Rule: $$P(A1 \cap A2) = P(A1)P(A2|A1) = \frac{15}{240} \times \frac{14}{239} = \frac{7}{1912} \approx 0.00366$$ This demonstrates how the probability of the second event is conditional on the outcome of the first, as the selection is without replacement.
3. ↔️ Independent Events
Two events are independent if the occurrence of one does not affect the probability of the other.
📚 Definition
Events A and B are independent if:
- $$P(A|B) = P(A)$$
- $$P(B|A) = P(B)$$
📝 Formula for Independent Events
If A and B are independent, the probability of both A and B occurring is simply the product of their individual probabilities: $$P(A \cap B) = P(A)P(B)$$
✅ Key Points
- For three or more events (e.g., A, B, C), they are mutually independent if P(A ∩ B ∩ C) = P(A)P(B)P(C) and all pairwise combinations are also independent.
- Events can be pairwise independent without being mutually independent, or vice versa.
💡 Example: Three Coin Tosses
A fair coin is tossed three times. Let:
- A: The first two tosses are tails (Yazı-Yazı, YY).
- B: The third toss is heads (Tura, T).
- C: There are exactly two heads in three tosses.
1️⃣ Define Sample Space (S): S = {TTT, TTH, THT, THH, HTT, HTH, HHT, HHH} (where T=Tails, H=Heads) Total outcomes = 8
2️⃣ Define Events and their Probabilities:
- A = {TTT, TTH} => P(A) = 2/8 = 1/4
- B = {TTH, THH, HTH, HHH} => P(B) = 4/8 = 1/2
- C = {THH, HTH, HHT} => P(C) = 3/8
3️⃣ Check for Independence between A and B:
- A ∩ B = {TTH} => P(A ∩ B) = 1/8
- P(A)P(B) = (1/4) * (1/2) = 1/8 Since P(A ∩ B) = P(A)P(B), events A and B are independent. ✅
4️⃣ Check for Independence between B and C:
- B ∩ C = {THH, HTH} => P(B ∩ C) = 2/8 = 1/4
- P(B)P(C) = (1/2) * (3/8) = 3/16 Since P(B ∩ C) ≠ P(B)P(C), events B and C are dependent. ⚠️
4. ➕ Total Probability Rule
The Total Probability Rule is used to find the overall probability of an event that can occur through several mutually exclusive and exhaustive scenarios.
📚 Definition
If events B₁, B₂, ..., Bₖ form a partition of the sample space S (meaning they are mutually exclusive and their union is S), and P(Bᵢ) ≠ 0 for all i, then the probability of any event A in S is given by: $$P(A) = \sum_{i=1}^{k} P(B_i)P(A|B_i)$$
💡 Example: Car Rental Maintenance
A consulting firm rents cars from three companies:
- Company 1 (B₁): 60% of cars (P(B₁) = 0.60)
- Company 2 (B₂): 30% of cars (P(B₂) = 0.30)
- Company 3 (B₃): 10% of cars (P(B₃) = 0.10)
Maintenance rates for cars from each company:
- Company 1: 9% require maintenance (P(A|B₁) = 0.09)
- Company 2: 20% require maintenance (P(A|B₂) = 0.20)
- Company 3: 6% require maintenance (P(A|B₃) = 0.06)
What is the probability that a randomly rented car requires maintenance (P(A))?
1️⃣ Apply the Total Probability Rule: $$P(A) = P(B_1)P(A|B_1) + P(B_2)P(A|B_2) + P(B_3)P(A|B_3)$$ $$P(A) = (0.60)(0.09) + (0.30)(0.20) + (0.10)(0.06)$$ $$P(A) = 0.054 + 0.060 + 0.006$$ $$P(A) = 0.12$$ There is a 12% chance that a randomly rented car will require maintenance.
5. 🔄 Bayes' Theorem
Bayes' Theorem is a powerful tool for updating the probability of a hypothesis based on new evidence. It allows us to reverse the conditioning, calculating P(B|A) when we know P(A|B).
📚 Definition
If events B₁, B₂, ..., Bₖ form a partition of the sample space S, and P(Bᵢ) ≠ 0 for all i, then for any event A with P(A) ≠ 0, the posterior probability of Bᵣ given A is: $$P(B_r|A) = \frac{P(B_r)P(A|B_r)}{\sum_{i=1}^{k} P(B_i)P(A|B_i)}$$ The denominator is simply P(A) from the Total Probability Rule.
💡 Example 1: Car Rental Maintenance (Revisited)
Using the previous car rental example: If a car rented by the consulting firm requires maintenance, what is the probability that it came from Company 2 (P(B₂|A))?
1️⃣ Identify Known Probabilities:
- P(B₂) = 0.30
- P(A|B₂) = 0.20
- P(A) = 0.12 (calculated using Total Probability Rule)
2️⃣ Apply Bayes' Theorem: $$P(B_2|A) = \frac{P(B_2)P(A|B_2)}{P(A)}$$ $$P(B_2|A) = \frac{(0.30)(0.20)}{0.12}$$ $$P(B_2|A) = \frac{0.060}{0.120} = \frac{1}{2} = 0.50$$ This means that even though only 30% of the firm's cars come from Company 2, half of the cars that require maintenance come from Company 2. This highlights how Bayes' Theorem updates our beliefs based on new evidence.
💡 Example 2: Polluting Cars and Emission Tests
In a city, 25% of cars excessively pollute the environment.
- B₁: Car is excessively polluting (P(B₁) = 0.25)
- B₂: Car is not excessively polluting (P(B₂) = 1 - 0.25 = 0.75)
Emission test results:
- Polluting car fails test (P(A|B₁)) = 0.99
- Non-polluting car fails test (P(A|B₂)) = 0.17
If a car fails the test (event A), what is the probability that it is excessively polluting (P(B₁|A))?
1️⃣ Apply Bayes' Theorem: $$P(B_1|A) = \frac{P(B_1)P(A|B_1)}{P(B_1)P(A|B_1) + P(B_2)P(A|B_2)}$$ $$P(B_1|A) = \frac{(0.25)(0.99)}{(0.25)(0.99) + (0.75)(0.17)}$$ $$P(B_1|A) = \frac{0.2475}{0.2475 + 0.1275}$$ $$P(B_1|A) = \frac{0.2475}{0.3750} = 0.66$$ Therefore, if a car fails the emission test, there is a 66% probability that it is an excessively polluting vehicle.
📈 Conclusion
Conditional probability, independent events, the Total Probability Rule, and Bayes' Theorem are fundamental concepts that allow us to analyze and understand the relationships between events. Mastering these tools is essential for making informed decisions and predictions in various fields, from engineering to finance and everyday life.
📚 References
- Akın, M. (n.d.). Matematiksel İstatistik Ders Notu. İstanbul Üniversitesi.
- Walpole, R. E. (2016). Mühendisler ve Fen Bilimciler için Olasılık ve İstatistik (9th ed.). Palme Yayıncılık. (Translated by M. Akif BAKIR).
