Yu Huang, Jilin Tu, Thomas. S. Huang
Beckman Inst., UIUC, 2002
We propose a framework of factorization-based non-rigid shape modeling and tracking in stereo-motion. We construct a measurement matrix with the stereo-motion data captured from a stereo-rig. Organized in a particular way this matrix could be decomposed by Singular Value Decomposition (SVD) into the 3D basis shapes, their configuration weights, rigid motion and camera geometry. Accordingly, the stereo correspondences can be inferred from motion correspondences only requiring that a minimum of 3K point stereo correspondences (where K is the dimension of shape basis space) are created in advance. Basically this framework still keeps the property of rank constraints, meanwhile it owns other advantages such as simpler correspondence and accurate reconstruction even with short image sequences. Results with real data are given to demonstrate its performance.
Factorization
Non-rigid object in Stereo Motion
Rigid Motion only
Optic flow trajectories and point reconstruction
Non-rigid Motion as well
Optic flow trajectories and reconstruction with texture mapping