Microsoft’s motion camera captures infrared motion oscillations and the result is this wonderfully impressionistic video.
The video in question is New Look’s “Nap on the Bow” directed by duo Tim & Joe working with effects studio Munky. It’s one of the many uses that enterprising artists and tech heads alike have been finding for Kinect since its release (mine bugs out when I don’t wave fast enough to activate it).
The directors explained their process for creating the video:
The way the Kinect captures in 3D meant we could add camera moves and changes in focus afterwards. We were also able to manipulate their footage, making it dissolve and dissipate particles. One other interesting thing we discovered, a product of the fact the camera only collects the 3D data from the angle it sees, this effectively means you get half a 3D image. When you rotate the image 90 degrees past the angle you’ve shot from you suddenly see the inverted version of the image. When looking at the band we found we really liked these inverted versions. They create a really interesting optical illusion as you move back and forth and it was this effect that we utilized to give us the circular tracking shot, which became the centre piece of the video. Watch Animation.
We wanted the rest of the world surrounding the performance to be in keeping with the glitchy lo-fi feel of the Kinect footage. Ryan Passmore at Munky created 3D water simulations which make up the opening shot of the video as well the bubble and the odd jellyfish/drip like creatures that appear in the first half of the video. To create the bottom of the ocean we once again returned to the Kinect, building crude coral like structures which became even more unusual and otherworldy when shot with the Kinect. All sorts of objects were used, for the sea floor we simply unrolled a few lengths of old bubble wrap and spread it over the floor, there’s also plants and even a desk lamp somewhere in there.
[Source: The Atlantic via Major Nelson]