Probability Mass Function (pmf)
- p(x)=P(X=x)
- P(X=x)≥0
- ∑x∈Rxp(x)=1
Comuluative Distribution Function (cdf)
- F(x)=P(X≤x)
- P(a<X≤b)=F(b)−F(a)
- Non-decreasing, F(−∞)=0,F(+∞)=1
- Right-continuous, limx→a+=F(a)
Expectation
E(X)=x∈RX∑xp(x)
E(g(X))=x∈RX∑g(x)p(x)
E(aX+b)=aE(X)+E(b)
If X and Y are independent, then
E(f(X)g(Y))=E(f(X))E(g(Y))
and if f and g are continuous, then
E(XY)=E(X)E(Y)
Variance
Var(X)=x∈RX∑(x−μ)2p(x)
Var(aX+b)=a2Var(X)
Var(X)=E(X2)−E(X)2
If X and Y are independent, then
Var(X+Y)=Var(X)+Var(Y)
Sharpe Ratio
σXE(X)−R0
Probability Density Function (pdf)
- ∫−∞+∞f(x)dx=1
- F(a)=∫−∞af(x)dx, dxdF(x)∣x=a=f(a)
- P(X=a)=∫aaf(x)dx=0

Independence of Random Variable
For two independent random variables X and Y
Var(X+Y)=Var(X)+Var(Y)
Var(X+Y)=E(X+Y−(μx+μy))2=E((X−μx)+(Y−μy))2=E((X−μx)2+2(X−μx)(Y−μy)+(Y−μy)2)=E(X−μx)2+2E()()
Joint Distribution
Discrete
- 0≤pX,Y(x,y)≤1
- ∑x∈RX,y∈RYpX,Y(x,y)=1
- ∑y∈RYpX(x)
Continuous
Binomial Distribution
X∼B(n,p)
p(x)=P(X=x)=(xn)px(1−p)n−x
E(X)=npVar(X)=np(1−p)
Poison Distribution
n→∞,p→0,np→λ,B(n,p)→Pois(λ)
p(x)=P(X=k)=e−λk!λk
E(X)=λVar(X)=λ
Let X1∼P(λ1) and X2∼P(λ2), if X1 and X2 are independent, then X1+X2∼P(λ1+λ2)
Normal Distribution
N(μ,σ2)
f(x)=2πσ21e−(x−μ)2/2σ2
Z=σX−μ∼N(0,1)
cdf of a standard normal rv is Φ(x), f(x)=Φ′(x)
P(a<x≤b)=P(σa−μ<Z≤σb−μ)=Φ(σb−μ)−Φ(σa−μ)
E(X)=μV(X)=σ2
Student’s t-distribution
f(t)=vπΓ(2v)Γ(2v+1)(1+vt2)−(v+1)/2
- When v=1, we get the Cauchy distribution
- when v→+∞, we get the standard normal distribution
Chi-squared distribution
f(x;k)=⎩⎨⎧22kΓ(2k)x2k−1e−2x,0,x>0otherwise
X=Z12+Z22+⋯+Zk2
- Zi∼N(0,1)
- E(Zi)=0
- Var(Zi)=1=E(Zi2)−(E(Zi)0)2=E(Zi2), so E(Zi2)=1
E(X)=k