🛠️ Steven Gong

Search

SearchSearch
Oct 21, 2026 · 1 min read · 448 views · 63 in the last 30 days

Where readers are reading from

FijiTanzaniaWestern SaharaCanada · 5 readersUnited States of America · 9 readersKazakhstan · 2 readersUzbekistanPapua New GuineaIndonesia · 0 readersArgentinaChileDemocratic Republic of the CongoSomaliaKenyaSudanChadHaitiDominican RepublicRussia · 0 readersThe BahamasFalkland IslandsNorwayGreenlandFrench Southern and Antarctic LandsEast TimorSouth AfricaLesothoMexicoUruguayBrazil · 0 readersBoliviaPeru · 0 readersColombiaPanamaCosta RicaNicaraguaHondurasEl SalvadorGuatemalaBelizeVenezuelaGuyanaSurinameFrance · 0 readersEcuadorPuerto RicoJamaicaCubaZimbabweBotswanaNamibiaSenegalMaliMauritaniaBeninNigerNigeriaCameroonTogoGhanaIvory CoastGuineaGuinea-BissauLiberiaSierra LeoneBurkina FasoCentral African RepublicRepublic of the CongoGabonEquatorial GuineaZambiaMalawiMozambiqueEswatiniAngolaBurundiIsrael · 2 readersLebanonMadagascarPalestineThe GambiaTunisiaAlgeria · 0 readersJordanUnited Arab EmiratesQatarKuwaitIraqOmanVanuatuCambodiaThailandLaosMyanmarVietnam · 0 readersNorth KoreaSouth Korea · 0 readersMongoliaIndia · 1 readersBangladeshBhutanNepalPakistan · 0 readersAfghanistanTajikistanKyrgyzstanTurkmenistanIranSyriaArmeniaSwedenBelarusUkraine · 1 readersPoland · 0 readersAustria · 0 readersHungaryMoldovaRomania · 0 readersLithuaniaLatviaEstoniaGermany · 3 readersBulgariaGreeceTurkey · 0 readersAlbaniaCroatiaSwitzerland · 0 readersLuxembourgBelgiumNetherlandsPortugalSpainIreland · 0 readersNew CaledoniaSolomon IslandsNew ZealandAustralia · 1 readersSri LankaPeople's Republic of China · 1 readersTaiwan · 0 readersItaly · 0 readersDenmarkUnited Kingdom · 0 readersIcelandAzerbaijanGeorgiaPhilippinesMalaysia · 0 readersBruneiSloveniaFinland · 1 readersSlovakiaCzech RepublicEritreaJapan · 0 readersParaguayYemenSaudi ArabiaTurkish Republic of Northern CyprusCyprusMoroccoEgyptLibyaEthiopiaDjiboutiSomalilandUgandaRwandaBosnia and HerzegovinaNorth MacedoniaSerbiaMontenegroKosovoTrinidad and TobagoSouth SudanSelect a country to explore · Last 30 days
United States9
Singapore5
Canada5
Germany3
Israel2
Kazakhstan2
Traffic · last 30 days4914Oct 5Oct 15Oct 25Nov 3

GPU (Nvidia)

GPU Architecture

MY NOTES

Explore

00 / INFINIBAND FABRIC

GPU cluster

INFINIBAND SWITCH FABRICTRAY 01GPU 1HBMGPU 2HBMGPU 3HBMGPU 4HBMTRAY 02GPU 5HBMGPU 6HBMGPU 7HBMGPU 8HBMTRAY 03GPU 9HBMGPU 10HBMGPU 11HBMGPU 12HBMTRAY 04GPU 13HBMGPU 14HBMGPU 15HBMGPU 16HBM
InfiniBand ↗DDP ↗FSDP ↗

How is GPU architecture different from CPU architecture?

This is a good article for the different sms, like sm_87: https://arnon.dk/matching-sm-architectures-arch-and-gencode-for-various-nvidia-cards/

  • Need to understand what the sm means

From NVIDIA:

A lot of these papers are the main source of truth.

https://www.nvidia.com/en-us/technologies/

Graph View

Backlinks