第 22 章
对角化与矩阵的幂:把演化拆成互不干扰的方向
A = SΛS⁻¹ 让矩阵的幂变成特征值的幂;由此判断稳定性,并用差分方程与 Fibonacci 数列演示增长率的来源。
Diagonalization and Powers of A: Splitting Evolution into Independent Directions
A = SΛS⁻¹ turns powers of a matrix into powers of eigenvalues; this gives stability tests, solves difference equations, and explains the growth rate of Fibonacci numbers.
篇内目录
- What diagonalization does
- Timeline
- Why it matters: powers
- From the definition
- From the decomposition
- The stability theorem
- Which matrices diagonalize
- Two fates for a repeated eigenvalue
- Difference equations: multiply by each step
- Fibonacci: where the growth rate comes from
- Turning a second-order recurrence into a first-order system
- Eigenvalues
- What controls growth
- Eigenvectors
- Core review
- Common misconceptions
- Check your understanding
- How this connects
对角化在做什么
上一讲得到 。这一讲把它组织成矩阵形式。把 个线性无关的特征向量放进矩阵 的列:
逐列计算 :
其中 是以 为对角元的对角矩阵。左乘 :
这就是对角化。它是与 、 并列的第三种分解,也是整个特征值章节的核心。
前提很清楚: 必须可逆,也就是需要 个线性无关的特征向量。
时间轴
| 时间 | 内容 |
|---|---|
| 0:10 | 第二讲:对角化与矩阵的幂 |
| 3:16 | 把 写成 |
| 6:23 | 对角化的条件: 个无关特征向量 |
| 9:28 | 的特征值与特征向量 |
| 12:44 | |
| 15:50 | 稳定性:所有 |
| 19:08 | 特征值互异时一定可对角化 |
| 22:14 | 不可对角化的情形 |
| 25:36 | 重根导致的失败 |
| 28:40 | 差分方程 |
| 31:41 | |
| 34:54 | Fibonacci 递推 |
| 37:59 | 把递推化成二维系统 |
| 41:02 | 特征值满足 |
| 44:16 | 主导增长 |
| 50:25 | 一阶演化系统的一般配方 |
为什么对角化有用:幂
从定义直接看
若 ,两边再乘 :
所以 的特征值平方,特征向量不变。一般地:
从分解看
中间的 消掉。对 次幂:
而 只是对角元各自取 次方。
这正是对角化的价值。若用 计算 ,会得到一百个 相乘,无从下手;用特征分解,只是一个对角矩阵取幂。
稳定性定理
当且仅当所有特征值的绝对值小于 1:
原因在于 与 固定不动,只有 在变化。绝对值小于 1 的数越乘越小;等于 1 不衰减;大于 1 会发散。特征值可以是负数或复数,所以必须取绝对值。
哪些矩阵可以对角化
| 情形 | 是否可对角化 | 说明 |
|---|---|---|
| 特征值互不相同 | 一定可以 | 随机矩阵几乎总属于这一类 |
| 特征值重复,但特征空间足够大 | 可以 | 例如单位矩阵,每个向量都是特征向量 |
| 特征值重复且特征向量不足 | 不可以 | 例如 |
重复特征值的两种命运
单位矩阵:特征值全是 1,重复 次,但每个向量都是特征向量,可以选出 个线性无关的。它本来就是对角的。
反例:
特征多项式是 ,所以 重复两次。但
零空间只有一维,基是 。找不到第二个线性无关的特征向量,因此不可对角化。
这里引入两个概念:
- 代数重数:特征值作为特征多项式根的重数,这里是 2。
- 几何重数:对应特征空间的维数,这里是 1。
可对角化要求每个特征值的几何重数等于代数重数。
差分方程:每一步乘以 A
考虑一阶系统
给定初值 ,解是
这是最紧凑的写法,但并不能直接算出数值。真正的解法是把 展开成特征向量的组合:
每乘一次 ,每个分量独立地乘上自己的特征值:
写成矩阵形式就是 ,与 完全一致。
一句话总结: 特征向量把耦合的系统拆成 个互不干扰的一维问题。
Fibonacci 数列:增长率的来源
把二阶递推变成一阶系统
这是二阶标量递推。引入向量
并补一个恒等式 ,得到
记这个矩阵为 。
特征值
特征多项式:
用求根公式:
所以
验证:和为 1(迹),积为 (行列式)。
注意 正是原递推的特征方程,这说明两种做法本质相同。
增长由谁决定
初始向量
把它写成两个特征向量的组合。此后
由于 、,第二项随 增大迅速消失,第一项主导:
这就是黄金比例出现在 Fibonacci 数列中的原因。增长率不是猜出来的,而是最大特征值的模。
特征向量
对 情形,可以直接看出 是特征向量:
最后一步用了 。
核心回顾
- ,前提是 个线性无关的特征向量。
- ,特征值取 次方,特征向量不变。
- 当且仅当所有 。
- 特征值互异一定可对角化;重复时看几何重数是否等于代数重数。
- 差分方程的解:把初值展开到特征向量上,让每个分量按自己的特征值演化。
- Fibonacci 的增长率等于最大特征值 。
常见误区
- 以为特征值互异是可对角化的必要条件。它只是充分条件。
- 只比较代数重数,不看几何重数。重复特征值未必短缺。
- 在稳定性判据里忘记取绝对值。负特征值的幂会交替变号,但同样需要 。
- 把 写成 。记住「 乘 」,即 。
- 认为 Fibonacci 增长是线性的。它是指数增长,底数为黄金比例。
理解检验
1. 由 推导 ,指出哪一步需要 可逆。
参考答案:从 出发,在右边乘以 :
这一步需要 存在,也就是 的列( 个特征向量)线性无关。若特征向量不足, 奇异,只能写成 ,无法解出 的对角化形式。注意顺序:是 ,不是 。
2. 若 的特征值是 , 会趋于零吗?
参考答案:不会。稳定性判据要求所有特征值满足 。这里 ,对应方向上的分量按 增长,所以 在上该方向发散。 只说明另一个方向衰减,不能决定整体。只有当全部特征值的模都小于 1 时才有 。
3. 构造一个特征值重复但可对角化的矩阵,再构造一个不可对角化的。
参考答案:可对角化:。特征值 的代数重数是 2,但每个非零向量都是特征向量,几何重数也是 2, 即可。不可对角化:。特征值仍是二重的 ,但
的零空间只有 ,几何重数 1 代数重数 2,找不到两个线性无关的特征向量。
4. Fibonacci 矩阵的第二个特征值为什么最终不重要?
参考答案:,。因为 ,;虽然 使符号交替,但幅度指数衰减。把 除以 ,第二项是 ,而 ,所以相对贡献趋于零,增长由 主导。
5. 一个 矩阵的特征值是 ,能否断言它可对角化?
参考答案:不能。代数重数是 3,但可对角化要求几何重数也等于 3,即 的维数为 3(等价于 )。例如 可对角化;而
的 只有一列非零,零空间维数为 2,几何重数 ,不可对角化。必须逐个特征值比较两个重数才能下结论。
与前后课程的关系
这一讲处理离散时间(差分方程)。下一讲把同样的思路搬到连续时间:把 换成 ,把 换成矩阵指数 。稳定性判据也从单位圆内变成左半平面。
What diagonalization does
The previous lecture produced . This one assembles those equations into a matrix identity. Put independent eigenvectors in the columns of :
Multiply column by column:
where is diagonal with entries . Left-multiply by :
This is diagonalization, the third decomposition in the course alongside and , and the centerpiece of the eigenvalue chapter.
The condition is explicit: must be invertible, which means linearly independent eigenvectors.
Timeline
| Time | Topic |
|---|---|
| 0:10 | Second lecture: diagonalization and powers |
| 3:16 | Writing as |
| 6:23 | The condition: independent eigenvectors |
| 9:28 | Eigenvalues and eigenvectors of |
| 12:44 | |
| 15:50 | Stability: all |
| 19:08 | Distinct eigenvalues guarantee diagonalization |
| 22:14 | When diagonalization fails |
| 25:36 | Failure caused by repeated eigenvalues |
| 28:40 | Difference equations |
| 31:41 | |
| 34:54 | The Fibonacci recurrence |
| 37:59 | Turning the recurrence into a 2D system |
| 41:02 | The eigenvalues satisfy |
| 44:16 | dominates |
| 50:25 | The general recipe for first-order systems |
Why it matters: powers
From the definition
If , multiply by again:
So has the squared eigenvalues and the same eigenvectors. In general,
From the decomposition
The inner cancels. For the -th power,
and is just the diagonal matrix of -th powers.
This is the payoff. Computing from would mean multiplying a hundred factors; eigen-decomposition reduces it to taking powers of scalars.
The stability theorem
exactly when every eigenvalue has absolute value below 1:
The reason is that and are fixed while only changes. Numbers below 1 shrink, numbers equal to 1 persist, numbers above 1 blow up. Eigenvalues may be negative or complex, so the absolute value is essential.
Which matrices diagonalize
| Case | Diagonalizable? | Explanation |
|---|---|---|
| Distinct eigenvalues | Always | A random matrix almost surely falls here |
| Repeated eigenvalues with enough eigenvectors | Yes | The identity: every vector is an eigenvector |
| Repeated eigenvalues with too few eigenvectors | No | Example: |
Two fates for a repeated eigenvalue
The identity has eigenvalue 1 repeated times, but every vector is an eigenvector, so independent ones can be chosen. It is already diagonal.
The counterexample:
The characteristic polynomial is , so has multiplicity two. But
has a one-dimensional null space spanned by . There is no second independent eigenvector, so the matrix cannot be diagonalized.
Two notions appear:
- Algebraic multiplicity: the multiplicity as a root of the characteristic polynomial, here 2.
- Geometric multiplicity: the dimension of the eigenspace, here 1.
Diagonalizability requires that for every eigenvalue, geometric multiplicity equals algebraic multiplicity.
Difference equations: multiply by each step
Consider the first-order system
With initial vector , the solution is
Compact, but not directly computable. The real method is to expand in eigenvectors:
Each application of multiplies each component by its own eigenvalue:
In matrix form this is , identical to .
One-sentence summary: Eigenvectors split a coupled system into independent one-dimensional problems.
Fibonacci: where the growth rate comes from
Turning a second-order recurrence into a first-order system
Introduce the vector
and add the trivial equation :
Call this matrix .
Eigenvalues
The characteristic polynomial:
By the quadratic formula,
so
Check: the sum is 1 (the trace) and the product is (the determinant).
Notice that is exactly the original recurrence in disguise; the two approaches agree.
What controls growth
The initial vector is
Write it as a combination of the two eigenvectors. Then
Since and , the second term decays quickly and the first dominates:
This is why the golden ratio appears. The growth rate is the modulus of the largest eigenvalue, not a guess.
Eigenvectors
In the case one can spot that works:
The last step uses .
Core review
- , provided there are independent eigenvectors.
- : eigenvalues are powered, eigenvectors are unchanged.
- exactly when every .
- Distinct eigenvalues guarantee diagonalizability; repeats require checking multiplicities.
- Difference equations: expand the initial vector in eigenvectors and let each component evolve independently.
- Fibonacci growth equals the largest eigenvalue, .
Common misconceptions
- Thinking distinct eigenvalues are necessary. They are sufficient, not necessary.
- Checking only algebraic multiplicity. Repeats are fine if the eigenspace is large enough.
- Dropping the absolute value in the stability test. Negative eigenvalues alternate in sign, but still need .
- Writing . The mnemonic is " multiplies ": .
- Calling Fibonacci growth linear. It is exponential, with base the golden ratio.
Check your understanding
1. Derive from and identify where invertibility of is used.
Reference answer: Start from and multiply on the right by :
This uses the existence of , i.e. the eigenvectors (columns of ) are linearly independent. With too few eigenvectors, is singular and one can only write , not a diagonalization of . Mind the order: it is , not .
2. If the eigenvalues are and , does tend to zero?
Reference answer: No. The stability criterion requires for every eigenvalue. Here , so the component along that eigenvector grows like and diverges in that direction. The decay of in the other direction cannot save it. Only when all eigenvalues have modulus below 1 does .
3. Construct one matrix with a repeated eigenvalue that diagonalizes and one that does not.
Reference answer: Diagonalizable: . The eigenvalue has algebraic multiplicity 2, but every nonzero vector is an eigenvector, so the geometric multiplicity is also 2 and works. Not diagonalizable: . The eigenvalue is still double, but
has nullspace of dimension 1, so the geometric multiplicity 1 is below the algebraic multiplicity 2 and no two independent eigenvectors exist.
4. Why does the second Fibonacci eigenvalue ultimately stop mattering?
Reference answer: and . Since , ; the negative sign makes the term alternate, but its magnitude decays exponentially. Dividing by leaves , and , so the relative contribution vanishes and growth is governed by .
5. A matrix has eigenvalues . Can you conclude it is diagonalizable?
Reference answer: No. The algebraic multiplicity is 3, but diagonalizability requires the geometric multiplicity to be 3 as well, i.e. (equivalently ). For instance diagonalizes; but
has of rank 1, so and it is not diagonalizable. One must compare the two multiplicities for each eigenvalue before concluding.
How this connects
This lecture treats discrete time. The next moves the same machinery to continuous time: replace with and with the matrix exponential . The stability region changes from the unit disk to the left half-plane.