🛠️ Steven Gong

Search

SearchSearch
  • Tensor Core
  • Related

Nov 08, 2023, 1 min read

Tensor Core §

This is a term that I hear a lot in the GPU world. Developed by NVIDIA.

Resources

  • https://blog.paperspace.com/understanding-tensor-cores/
  • https://developer.nvidia.com/blog/programming-tensor-cores-cuda-9/
    • Tensor Cores in a Nutshell video

To understand what a tensor core is, you must first understand what a CUDA Core is (got the inspo to say this from the first article).

Tensor Cores are basically matrix multiply and accumulate.

Related §

  • WMMA (how you actually program these)

Graph View

Backlinks

  • Warp Matrix Multiply Accmulate (WMMA)

Created with Quartz, © 2023

  • Blog
  • LinkedIn
  • Twitter
  • GitHub