PyTorch Internals
Some useful links to understand how pytorch internals work
Computation graphs https://pytorch.org/blog/overview-of-pytorch-autograd-engine/ https://pytorch.org/blog/computational-graphs-constructed-in-pytorch/ https://pytorch.org/blog/how-computational-graphs-are-executed-in-pytorch/
PyTorch dispatcher
-
https://github.com/pytorch/pytorch/wiki/PyTorch-dispatcher-walkthrough
-
https://github.com/pytorch/pytorch/blob/main/aten/src/ATen/core/dispatch/Dispatcher.h
c10
cpp_extensions https://docs.pytorch.org/docs/2.13/cpp_extension.html?utm_source=chatgpt.com
Derivatives.yaml file