Low-Rank Approximation

First heard about this idea through LoRA. Surprised I didn’t learn this in Linear Algebra.

Low-rank approximation refers to the process of approximating a given matrix by a matrix of lower rank.