🛠️ Steven Gong

Search

SearchSearch

Mar 23, 2025, 1 min read

Model Parallel

Pipeline Parallelism

Use of Pipelining for GPUs to do training.

https://colossalai.org/docs/concepts/paradigms_of_parallelism/

GPipe paper:

  • https://arxiv.org/abs/1811.06965

Graph View

Backlinks

  • No backlinks found

Created with Quartz, © 2025

  • Blog
  • LinkedIn
  • Twitter
  • GitHub