Incredible concept for the next step in augmented reality by Abe Davis via upload vr:

At first, IDV looks like a pretty simple concept. Using a traditional camera to record the object in question, Davis observes the tiny vibrations that item will make, causing them to occur himself if necessary. That information is then recorded and applied, and the result is video in which you can grab and pull parts of the object, and have it move in realistic ways. The video above shows the user bending the arms of a wire man, for example, or swaying the leaves on a bush.

Where IDV gets really interesting, however, is when virtual objects are introduced into that video to realistically interact with the environment around them. In the video above, researchers create a simple dinosaur within a paint app, and then bring him into a pre-recorded video of a child’s jungle gym in motion. The dinosaur bounces from wire to holds, making his way down the structure. With every leap, the anticipated vibration on the jungle gym is realistically displayed.

Read more here or on the project page and see more from Abe Davis’s Research on YouTube