Discussion 11A

Continuous Distributions

PDF

We describe the distribution of a continuous random variable with a probability density function f(x)f(x) such that Pr[X[a,b]]=abf(x)dx\Pr[X \in [a, b]] = \int_a^b f(x) dx.
f(x)f(x) satisfies f(x)dx=1\int_{-\infty}^\infty f(x) dx = 1.
f(x)f(x) can be thought of as roughly Pr[X[x,x+dx]]=f(x)dx\Pr[X \in [x, x+dx]] = f(x) dx.
The word “density” fits our physical interpretation of distributions from before.

CDF

It can be useful to describe a continuous random variable with a cumulative distribution function: F(x)=xf(x)dx=Pr[Xx]F(x) = \int_{-\infty}^x f(x) dx = \Pr[X \leq x].
Using the CDF it is easy to compute Pr[X[a,b]]=F(b)F(a)\Pr[X \in [a, b]] = F(b) - F(a).

Analogies

Definitions for discrete random variables have analogous definitions for continuous random variables: Bayes’, Total Probability, etc.
E[X]=xf(x)dxE[X] = \int_{-\infty}^\infty x f(x) dx 
E[g(X)]=g(x)f(x)dxE[g(X)] = \int_{-\infty}^\infty g(x) f(x) dx
Pr[q(X,Y)]=Pr[q(X,y)Y=y]fY(y)dy\Pr[q(X,Y)] = \int \Pr[q(X,y) \mid Y=y] f_Y(y) dy

Exponential Distribution

XX denotes the amount of time in order for an event to occur, where the event occurs at a rate of λ\lambda
time1\text{time}^{-1}. fX(x)=λeλxf_X (x) = \lambda e^{-\lambda x} for x0x \geq 0.
E[X]=1λE[X] = \frac{1}{\lambda}
Var(X)=1λ2\mathrm{Var}(X) =\frac{1}{\lambda^2}
F(X)=1eλxF(X) = 1 - e^{-\lambda x}
The exponential distribution is memoryless, so Pr[X>t]=Pr[X>t+sX>s]\Pr[X > t] = \Pr[X > t + s \mid X > s].
It can be thought of as geometric distribution, where λ\lambda triggers occur every small time interval.