Perspective-n-Point Algorithm (PnP)

PnP estimates the pose of a calibrated camera given 3D points in the world and their corresponding 2D projections on the camera’s image plane.

PnP (Perspective-n-Point) is a method to solve 3D to 2D motion estimation.

Several ways to solve this:

The SLAM textbook introduces an approach that is basically bundle adjustment, where we try to minimize the reprojection error.

We know that to relate from 3D to 2D, we have the equation To solve for , we can simply construct the least squares problem and minimize