This work creates interactive dynamic videos by extracting image-space vibration modes from subtle vibrations in video of an object, and uses those vibration modes to create an image-space simulation of the object. This paper explains the method used to create the examples in our IDV video.

Several publications and projects by Bill Freeman, Fredo Durand, Miki Rubinstein, Neal Wadhwa, and many others.

This work focuses on visualizing and amplefying tiny motions in video and was also done (mostly) at MIT. It inspired much of our work on IDV, and developed some of the techniques we employ. Check out the project web page for more information and a complete list of publications/authors.