How close can similarity transformations take a matrix towards diagonal form? The answer is given by the Jordan canonical form, which achieves the largest possible number of off-diagonal zero entries (Brualdi, Pei, and Zhan, 2008).
Theorem (Jordan canonical form). Any matrix can be expressed as
where is nonsingular and . The matrix is unique up to the ordering of the blocks .
The matrix is (up to reordering of the diagonal blocks) the Jordan canonical form of (or the Jordan form, for short).
The bidiagonal matrices are called Jordan blocks. Clearly, the eigenvalues of are repeated times and has a single eigenvector, . Two different Jordan blocks can have the same eigenvalues.
In total, has linearly independent eigenvectors, and the same is true of .
The Jordan canonical form is an invaluable tool in matrix analysis, as it provides a concrete way to prove and understand many results. However, the Jordan form can not be reliably computed in finite precision arithmetic, so it is of little use computationally, except in special cases such as when is Hermitian or normal.
For a Jordan block we have
The superdiagonal of ones moves up to the right with each increase in the index of the power, until it disappears off the top corner of the matrix.
It is easy to see that , and so
For , these quantities provide information about the size of the Jordan blocks associated with . To be specific, let
By considering the equations above, it can be shown that is the number of Jordan blocks of size at least in which appears. Moreover, the number of Jordan blocks of size is . Therefore if we know the eigenvalues and the ranks of for each eigenvalue and appropriate then we can determine the Jordan structure. As an important special case, if then we know that appears in a single Jordan block. The sequence of is known as the Weyr characteristic, and it satisfies .
As an example of a matrix for which we can easily deduce the Jordan form consider the nilpotent matrix , for which and all the eigenvalues are zero. Since , we have , , and . Hence and , so there are Jordan blocks. (In fact, can be permuted into Jordan form by a similarity transformation.)
Here is an example with the matrix
We have and , so and are simple eigenvalues. All the other eigenvalues are and they have the following and values:
We conclude that the eigenvalue occurs in one block of order , one block of order , and two blocks of order .
A matrix and its transpose have the same Jordan form. One way to see this is to note that implies
where is the identity matrix with the its columns reversed. A consequence is that and are similar.
Real Jordan Form
A version of the Jordan form with and real exists for . The main change is how complex eigenvalues are represented. Since the eigenvalues now occur in complex conjugate pairs and , and each of the pair has the same Jordan structure (which follows from the fact that a matrix and its complex conjugate have the same rank), pairs of Jordan blocks corresponding to and are combined into a real block of twice the size. For example, Jordan blocks
in the real Jordan form, where . Note that the eigenvalues of are .
Proofs of the Jordan canonical form and its real variant can be found in many textbooks. See also Brualdi (1987) and Fletcher and Sorensen (1983), who give proofs that go via the Schur decomposition.
- Richard A. Brualdi. The Jordan Canonical Form: An Old Proof. Amer. Math. Monthly, 94(3):257–267,1987.
- Richard A. Brualdi, Pei Pei, and Xingzhi Zhan. An Extremal Sparsity Property of the Jordan Canonical Form. Linear Algebra Appl., 429(10):2367–2372, 2008.
- R. Fletcher and D. C. Sorensen. An Algorithmic Derivation of the Jordan Canonical Form. Amer. Math. Monthly, 90(1):12–16, 1983.
This article is part of the “What Is” series, available from https://nhigham.com/index-of-what-is-articles/ and in PDF form from the GitHub repository https://github.com/higham/what-is.