Introduction
The same vector can be described with different coordinates depending on the basis — like the same location given in kilometres north/east or along two diagonal streets. Choosing a clever basis can turn a messy matrix into a simple diagonal one. That idea is the heart of eigendecomposition, SVD and PCA.