Tensor Core

This is a term that I hear a lot in the GPU world. Developed by NVIDIA.

Resources

• https://www.digitalocean.com/community/tutorials/understanding-tensor-cores
• https://developer.nvidia.com/blog/programming-tensor-cores-cuda-9/
  • Tensor Cores in a Nutshell video
• https://datacrunch.io/blog/what-are-cuda-cores-example-and-differences-with-tensor-cores

To understand what a tensor core is, you must first understand what a CUDA Core is (got the inspo to say this from the first article).

Tensor Cores are basically matrix multiply and accumulate.

Related

• WMMA (how you actually program these)
• CUDA Core