Monday, April 22, 2019

Why do ATA and AAT have the same eigenvalues?

Why is it that $A^TA$ and $AA^T$ have the same non-zero eigenvalues? A symbolic proof is not hard to find, but as usual, I prefer to find a way to visualize it in order to gain a better mathematical intuition.

Let $\vec{x}$ be an eigenvector of $A^TA$.


We start with vector $\vec{x}$. $A$ transforms $\vec{x}$ into some arbitrary vector $A\vec{x}$. This is multiplied by $A^T$ resulting in $A^TA\vec{x}$. But remember, we defined $\vec{x}$ as an eigenvector of $A^TA$, so by definition $A^TA\vec{x} = \lambda \vec{x}$.

Now we're almost back to where we started, except $\vec{x}$ is being multiplied by a scalar! So if $\lambda \vec{x}$ undergoes another linear transformation, the result will be $\lambda$ times the transformation of $\vec{x}$.

So what if we choose to multiply $\lambda \vec{x}$ by $A$? We get $\lambda A \vec{x}$. But to get to this point, we multiplied $A \vec{x}$ by $AA^T$.

This means that $A \vec{x}$ is an eigenvector of $A^TA$ with eigenvalue $\lambda$! This is the same eigenvalue that we found by multiplying $\vec{x}$ by $A^TA$!

Update: This is actually true for any matrices $AB$ and $BA$, not only a matrix and its transpose. Thanks reddit user etzpcm for pointing this out!

3 comments:

  1. hey david! i love the way you visualize all of these concepts-- it makes them so much easier to understand and is a really cool technique which really helps me to understand better!

    ReplyDelete
  2. Coin Casino Review 2021 | Bonuses, Free Spins, Games
    Best Coin Casino Review 2021 | Exclusive Bonuses, Free Spins & Games 온카지노 ➤ Read the 메리트 카지노 고객센터 Casino Review before you play. 인카지노

    ReplyDelete
  3. Hello David,great effort but as far as I know these horizontal and vertical axes will also change/rotate when it is transformed/pre/post-multiplied by some matrix as it transforms the basis in between the process.

    ReplyDelete