Tensor Core §

This is a term that I hear a lot in the GPU world. Developed by NVIDIA.

Resources

• https://blog.paperspace.com/understanding-tensor-cores/
• https://developer.nvidia.com/blog/programming-tensor-cores-cuda-9/
  • Tensor Cores in a Nutshell video

To understand what a tensor core is, you must first understand what a CUDA Core is (got the inspo to say this from the first article).

Tensor Cores are basically matrix multiply and accumulate.

Related §

• WMMA (how you actually program these)