This article is one in a series of Instructables articles about DIY technology. The full list can be seen here.
Step 1: All About Control
In 2006, Nintendo shook this up with its release of the Wii console. In addition to the buttons and joysticks, the controllers could also detect motion. So instead of button pushes for actions, gamers were mimicking what was happening on the screen. Swings of the controller became bowling, baseball, and even dancing. These intuitive controls enabled lots of non-gamers to play, even becoming popular with senior citizens, and pushed sales of the console past 70 million worldwide.
Two groups were paying close attention to the Wii: Microsoft and hackers. Microsoft saw the potential in freeing gamers from controllers and started the Kinect project, originally known as Project Natal. With the Kinect, a pair of cameras record video and depth and are able to combine the information to precisely see the player's body position. Now no controllers were needed at all and gamers could play just by moving around.
Meanwhile, hackers saw the Wii's controllers as wonderful tools that were dying to be put to use for things besides games, such as head-tracking, virtual whiteboards, and controlling a 15-ton robotic arm. One such hacker, Johnny Lee, made such cool use of the Wii that he was hired on by Microsoft for the Kinect.
Step 2: The Magic of the Kinect
With an infrared camera the Kinect can see the room it's in no matter what the lighting is like. This is important since many folks like to play games well into the night. To make sure that it has something to read there is also an infrared projector that shines an array of dots into the room. The infrared camera ses these dots and through a process called "structured light" the Kinect can create a depth map.
This video shows the infrared projection into a room.
With this depth information, the Kinect can create a skeleton of the player that has 20 joints. It's all done thanks to lots of R&D on Microsoft's part, analyzing terabytes of data to get a system that works without players even thinking about it. The jointed skeleton then allows for the Xbox 360 to have games that use players motions and gestures fo a more immersive experience.
Step 3: All About the Bounty
Microsoft didn't take kindly to the bounty offer and issued a statement saying, Microsoft does not condone the modification of its products. Upon hearing this, Adafruit Industries doubled the bounty to $2,000 and then $3,000 soon after. The race was on around the world, open to anyone with a Kinect and a computer and Microsoft wasn't happy about it.
Where the Wii hacks had helped to nurture a global network of hackers, the hunt for the Kinect drivers took it even further. Adafruit Industries helped out by buying a USB analyser to see all the information that was coming out of the Kinect and posting it online. Chat rooms lit up and updates were constantly being shared.
With so much attention it shouldn't have been surprising that open-source drivers were released on Nov. 10, just six days after the Kinect went on sale. Even more amazing, the winner was Hector Martin, a programmer who wasn't even in the United States, but northern Spain. Since the Kinect went on sale in the EU on Nov. 10, he had made the drivers on the same day that he bought it. Shortly afterwards, Adafruit Industries tested it out and declared him a winner: the search was over.
And now there are tons of Kinect hacks that people have created. New videos of cool uses are popping up almost daily. Invisibility cloaks, virtual puppetry, turning people into puffy 3D characters, and so much more. After putting up the $150 for the Kinect, the main limitation is how much creativity and time people can put into it. Do you have an idea that could use this? Then maybe you'll want to make a Kinect hack of your own.