People can do some amazing things with exotic hardware, and believe it or not, Skyrim now works with the Kinect. Yes, Skyrim works with the amazing motion sensor from Microsoft. We don’t know how this guy did it, and his explanation is out of our processing capabilities, but he did it and it looks awesome.
This is how he explains it:
Well, gesture control is handled by the Kinect using a program called FAAST. FAAST, a middleware that operates using the OpenNI framework, converts user movements into keystrokes. Unfortunately, the openNI framework does not support voice control for the Kinect.
As a way around this, voice control in the Skyrim Kinect video is handled by a program called VAC (Voice Activated Commands). VAC allows you to pair spoken words with keystrokes.
Trying to avoid any type of controller, wires, or anything that might impede movement, I have used a RazorFish bluetooth headset to send voice commands to VAC. This device was relatively inexpensive, and probably accounts for some of the gameplay moments where a command is unrecognized.
You can get more information from his Youtube channel.