Definitions
- Sample space Ω is the set of all possible outcomes of an experiment
- Event is a set of outcomes
- Events are mutually exclusive if any pair of them are disjoint
- Events are exhaustive if the union of them is Ω
For disjoint events, A∩B=∅
Identities
Operations
A−B=A∩Bc
AΔB=(A−B)∪(B−A)=A∪B−(A∩B)
AΔB=(A−B)∪(B−A)=(A∩Bc)∪(B∩Ac)=(A∪(B∩Ac))∩(Bc∪(B∩Ac))=((A∪B)∩(A∪Ac))∩((Bc∪B)∩(Bc∪Ac))=(A∪B)∩(Bc∪Ac)=(A∪B)∩(A∩B)c=A∪B−(A∩B)
Laws
A∩B=B∩AA∪B=B∪A
(A∩B)∩C=A∩(B∩C)(A∪B)∪C=A∪(B∪C)
(A∪B)∩C=(A∩C)∪(B∩C)(A∩B)∪C=(A∪C)∩(B∪C)
(A∪B)c=Ac∩Bc(A∩B)c=Ac∪Bc
Axioms of Probability
- 0≤P(E)≤1
- P(Ω)=1
- If E1,E2,… are mutually exclusive events, then P(⋃i=1nEi)=∑i=1nP(Ei)
Properties
- P(Ac)=1−P(A)
- P(∅)=0
- If A⊂B, then P(A)≤P(B)
- P(A∪B)=P(A)+P(B)−P(A∩B)
- If P(A∪B)≥0, P(A∪B)≤P(A)+P(B)
- P(A∩B)≥1−P(Ac)−P(Bc)
Conditional Probability
COMP 2711 Conditional Probability
P(A∣B)=P(B)P(A∩B)P(A∩B)=P(A∣B)P(B)=P(B∣A)P(A)
P(A∩B∩C)=P(A)P(B∣A)P(C∣(A∩B))
P(A∣B)+P(Ac∣B)=P(B)P(A∩B)+P(B)P(Ac∩B)=P(B)P(B)=1
Independence
- Independent if P(A∩B)=P(A)P(B) or P(A∣B)=P(A)
- If A, B are independent, then A and Bc are also independent
P(A∩Bc)=P(A)−P(A∩B)=P(A)−P(A)P(B)=P(A)(1−P(B))=P(A)P(Bc)
Bayes’ Theorem
P(B∣A)=P(A)P(A∣B)P(B)=P(A∣B)P(B)+P(A∣Bc)P(Bc)P(A∣B)P(B)
P(A∩B)=P(A∣B)P(B)=P(B∣A)(P(A))