Kinect Wings is a gesture controller for Tiny Wings. Check out this video: https://vimeo.com/38280453
We used Synapse to get the coordinates of hands. Synapse is an open source program which tracks human gestures with kinect and sends the position of joints or bones through OSC messages. We then need another program to receive, and handle these messages. For that task we used Processing with OSCP5. This sketch will convert the hand position to a servo direction, and sending that data over serial port. An Arduino will then receive the data on serial port and send the values to the servo motor connected directly to the Arduino board.
You will need:
- a Servo 5VDC
- iPhone 4S (only 4S version is enabled to be connected to a projector)
- any kind of stylus for iPad/iPhone (can be also DIY like here: http://blog.makezine.com/2010/05/05/collins-lab-diy-ipad-stylus/)
- a Mac with OSX
- vga–dock connector cable
- a projector
- cardboard, gluegun, duct tape, wires
- Processing (http://processing.org)
- oscP5 library for Processing http://www.sojamo.de/libraries/oscP5/ - Follow the instructions to put the unzipped files to the right folder
- Arduino software (http://arduino.cc)
- Synapse for Kinect (http://synapsekinect.tumblr.com/)
- Tiny Wings for iPhone (http://itunes.apple.com/us/app/tiny-wings/id417817520?mt=8)
1. Get a little 5V servo motor from a hobby electronic shop, for example this one: http://www.parallax.com/StoreSearchResults/tabid/768/txtSearch/servo/List/0/SortField/4/ProductID/488/Default.aspx
2. Create a little square layout pillar from cardboard with about 20 cm height which will hold the servo motor.
3. Attach servo on the cardboard with gluegun to the cardboard.
4. Attach stylus to the arm of the servo using some duct tape
5. Place iPhone under the stylus, connect iPhone to a projector and a music stand
6. Start Tiny Wings on iPhone
7. Connect Arduino to the computer via USB and connect the servo to the Arduino board. You can find instructions here: http://arduino.cc/en/Reference/Servo
8. Upload the supplied code to the Arduino board
9. Connect the Kinect to another USB port on your computer
10. Run Synapse for Kinect.
11. Start Processing, and run the supplied Processing code.
12. Make a psi pose in front of the kinect. You can check the control window of Synapse when your body is recognized.
13. Have fun!