Network Deployment

ONNX

ONNX stands for Open Neural Network Exchange. It is an open format built to represent machine learning models.

ONNX is to machine learning models what JPEG is to images or MPEG is to videos.

https://onnxruntime.ai/docs/performance/model-optimizations/graph-optimizations.html

So ONNX doesn’t actually make the model run faster. I’m used to just working with .pt formats.