Stereo Rectification
This was something that I was introduced to at NVIDIA, used to align the camera pairs on a Stereo Camera.
For a single image, if we say that it is rectified, we mean that it is an Undistorted image.
Camera rectification adjusts images from two cameras so that the corresponding points in the images align on the same horizontal or vertical lines (Epipolar Geometry).
Is undistortion part of rectification?
Rectification typically includes undistortion as part of the rectification pipeline.
Are both stereo images altered, or only one?
In a rectified image pair, both images are typically altered.
Resources
- https://www.cs.cmu.edu/~16385/s17/Slides/13.1_Stereo_Rectification.pdf
- VPI https://docs.nvidia.com/vpi/algo_ldc.html
- OpenCV https://amroamroamro.github.io/mexopencv/matlab/cv.stereoRectify.html
Which matrix is used as part of the rectification? In ROS, it’s the Projection Matrix.