The law of large numbers says the average settles near μ. The central limit theorem says what the leftover error looks like: for independent observations with mean μ and finite variance σ2, the standardised average σ/nXˉn−μ is approximately a standard normal for large n, whatever the shape of the original distribution. Sums and averages of many small independent effects are normal even when the pieces are not.
Xˉn≈N(μ,nσ2),μ∈Xˉn±1.96nσ(95%)(1)
This is why a 95% confidence interval for a mean is the sample average plus or minus 1.96 standard errors, and why the probability that an average is far from its mean can be read from the normal table. A sum of n independent terms each with standard deviation σ has standard deviation σn: daily volatility scales to annual by multiplying by 252, which is the same theorem seen from the sum side.
A confidence interval and a probabilityDaily returns have σ=3%. The average of n=36 days has standard error 3%/6=0.5%, so a 95% interval for the true mean is the sample average ±0.98%. If instead the standard error is 0.25%, the chance that the sample mean exceeds the true mean by 0.5% is P(Z>2)≈0.0228. And 25 independent days of 1% volatility add up to a standard deviation of 1%⋅25=5%.
CLT: averages and sums of many independent finite-variance terms are approximately normal.
Confidence interval: average ±1.96σ/n for about 95%.
Square-root-of-time: independent daily volatility scales to T days by T.
When the theorem helps lessThe normal approximation is about the middle of the distribution, and it needs independence and finite variance. With heavy-tailed returns it sets in slowly and says little about extremes; with volatility clustering the observations are not independent, so the effective sample is smaller than n. Check these assumptions before trusting a 1.96 standard-error interval.
Lab · what's graded
A standard error10 pts
A tail probability15 pts
A confidence interval15 pts
What the theorem needs15 pts
A sum over days10 pts
When the approximation is poor15 pts
Fat tails slow the theorem20 pts
0/ 7 answered
1Numeric answer10 ptsNot answered
Daily returns have σ=3%. What is the standard error of the average of n=36 days, in percent?
SE=accepted: ± 0.005
2Numeric answer15 ptsNot answered
The standard error of a sample mean is 0.25%. By the CLT, what is the probability that the sample mean exceeds the true mean by more than 0.5%? Use P(Z>2) and give four decimals.
P=accepted: ± 0.0005
3Numeric answer15 ptsNot answered
With a standard error of 0.5%, what is the half-width of the 95% confidence interval for the mean, in percent? Use 1.96.
h=accepted: ± 0.005
4Choice15 ptsNot answered
Which pair of conditions does the classical CLT need?
5Numeric answer10 ptsNot answered
25 independent daily returns each have standard deviation 1%. What is the standard deviation of their sum, in percent?
σsum=accepted: ± 0.005
6Choice15 ptsNot answered
Select every situation in which the normal approximation to the sample mean is poor.
7Explain in words20 ptsNot answered
In two sentences, explain why averages of heavy-tailed returns need more observations before they look normal.
Math modeKeyboard or LaTeX inputTask 1 of 7 · Ctrl ⏎ to check