Discussion 7B

Probability

  • sample space: Ω\Omega, set of all possible outcomes, or sample points ω\omega
  • event: a subset of the sample space
  • Probability is an assignment of a number to each sample point such that
  • 0Pr[ω]10 \leq \Pr[\omega] \leq 1
  • ωΩPr[ω]=1\sum_{\omega \in \Omega} \Pr[\omega] = 1
  • Since sample points are disjoint, the probability of an event AA occurring is the sum of the probabilities of AA’s sample points
  • If all sample points have equal probability of occurring, then Pr[ω]=1Ω\Pr[\omega] = \frac{1}{|\Omega|}
  • Then the probability of an event AA occurring is Pr[A]=ωAPr[ω]=AΩ\Pr[A] = \sum_{\omega \in A} \Pr[\omega] = \frac{|A|}{|\Omega|}
  • This is just a counting problem: find A|A| and Ω|\Omega|
  • The probability of a sequence of independent events (independence next time) A1,A2,,AnA_1, A_2, \cdots, A_n is the product of the probabilities of the individual events

  • Sometimes it is easier consider the complement of a certain event
  • A¯+A=Ω|\bar{A}| + |A| = |\Omega|
  • Pr[A¯]+Pr[A]=1\Pr[\bar{A}] + \Pr[A] = 1
  • This generalizes to any partitioning of Ω\Omega: a list of subsets that are disjoint and for which their union is Ω\Omega