CVFX Lecture 16: Video matching, morphing, and view synthesis

ECSE-6969 Computer Vision for Visual Effects
Rich Radke, Rensselaer Polytechnic Institute
Lecture 16: Video matching, morphing, and view synthesis (3/24/14)

0:00:02 Video matching
0:06:24 Video matching cost function
0:11:03 Original video matching videos
0:17:58 Morphing
0:19:32 Cross-dissolving
0:23:00 Point correspondences for morphing
0:24:06 Line correspondences for morphing
0:24:35 Warping + cross-dissolving
0:33:09 Beier-Neely morphing (field morphing)
0:42:26 Morphing isn't physically consistent
0:45:23 View interpolation
0:49:29 View morphing
0:55:43 Virtual video synthesis
1:08:12 Bullet time

Key references:

P. Sand and S. Teller. Video matching. In ACM SIGGRAPH (ACM Transactions on Graphics), 2004.

T. Beier and S. Neely. Feature-based image metamorphosis. In ACM SIGGRAPH (ACM Transactions on Graphics), 1992.

S. E. Chen and L. Williams. View interpolation for image synthesis. In ACM SIGGRAPH (ACM Transactions on Graphics), 1993.

S. M. Seitz and C. R. Dyer. View morphing. In ACM SIGGRAPH (ACM Transactions on Graphics), 1996.

R. Radke, P. Ramadge, S. Kulkarni, and T. Echigo. Efficiently synthesizing virtual video. IEEE Transactions on Circuits and Systems for Video Technology, 13(4):325--37, Apr. 2003.