Johnson–Lindenstrauss lemma

The lemma may help explain how large language models (LLMs) are able to represent highly nuanced word meanings and context in relatively low-dimension embeddings.

maximum # of vectors is proportional to