CUDA Graph CUDA Graphs have been designed to allow work to be defined as graphs rather than single operation. Resources https://developer.nvidia.com/blog/cuda-graphs/ https://pytorch.org/blog/accelerating-pytorch-with-cuda-graphs/