Microsoft Research have lifted the veil on its latest concept named IllumiRoom, which uses a Kinect and a projector to expand video game graphics beyond the boundaries of the television, augmenting the room around it to amazing effect.
After being given a verbal command, the Kinect for Windows camera scans the wall onto which its projecting, and tailors and visuals to complement the on-screen action, whether that is expanding the field of view beyond the TV border or doing something more creative with the extra real estate.
"IllumiRoom uses a Kinect for Windows camera and a projector to blur the lines between on-screen content and the environment we live in allowing us to combine our virtual and physical worlds. For example, our system can change the appearance of the room, induce apparent motion, extend the field of view, and enable entirely new game experiences." Microsoft Research commented in a statement.
"Our system uses the appearance and the geometry of the room (captured by Kinect) to adapt the projected visuals in real-time without any need to custom pre-process the graphics."
Microsoft have also claimed that all effects shown on the Illumiroom demo video below are captured live and rendered in real time. Fair to say I'm rather excited to see this.
Source: Microsoft Research