Directions a matrix leaves alone
A square matrix A moves most vectors both in length and in direction. A few special directions are only stretched: Av=λv with v=0. Then v is an eigenvector and the stretch factor λ is its eigenvalue. If λ=2 the vector doubles, if λ=−1 it flips, if λ=0 it collapses to zero. Everything a matrix does to its eigenvectors is therefore one number.
Av=λv⟺det(A−λI)=0,i∑λi=trA,i∏λi=detA(1) To find the eigenvalues, note that (A−λI)v=0 has a non-zero solution only when A−λI is singular, so det(A−λI)=0. For a 2×2 matrix this is λ2−(trA)λ+detA=0. Then for each root solve (A−λI)v=0 for the direction. Two facts give quick checks: the eigenvalues add up to the trace and multiply to the determinant. A matrix is singular exactly when one eigenvalue is zero, and Ak has eigenvalues λk with the same eigenvectors.
A worked 2 by 2 exampleTake
A=(4213). Its trace is 7 and its determinant is
12−2=10, so
λ2−7λ+10=0 and
(λ−5)(λ−2)=0: the eigenvalues are 5 and 2. For
λ=5 solve
(−121−2)v=0, giving
v=(1,1). For
λ=2 solve
(2211)v=0, giving
v=(1,−2). Check:
A(1,1)=(5,5)=5(1,1). The eigenvalues of
A2 are
25 and
4.
- Eigenpair: Av=λv with v=0; an eigenvector's direction is unchanged, its length is scaled by λ.
- Characteristic equation: det(A−λI)=0; for 2×2, λ2−trAλ+detA=0.
- Checks: eigenvalues sum to the trace and multiply to the determinant; Ak has eigenvalues λk.
Why a quant caresThe eigenvectors of a covariance matrix are the independent directions of risk in a portfolio of assets, and the eigenvalues are the variances along them. A large eigenvalue is a bet that many assets move together, a tiny one is a combination of assets that is almost riskless on paper. The rest of this skill builds on that picture: how to find the eigenpairs of a big matrix, why they are real for covariance matrices, and what goes wrong when they are estimated from too little data.
Lab · what's graded
- What an eigenpair is15 pts
- The larger eigenvalue20 pts
- Determinant from eigenvalues10 pts
- The characteristic equation15 pts
- Squaring a matrix15 pts
- The method in order10 pts
- Why finance cares15 pts