Leap Art Project

plan

Goal: 

Control screen (projector) infront of user without keyboard and interact with room lights and sound. 

Actions: 


Frontend:


* user can press object to play video
* user can cancel playback of video 
* user can control density of the light/sound 
* user can change "themes" of room by pressing object/button
* user can navigate camera with one hand to "drive" to scene so he can pick "theme" or "video"
* api can add new video into 3D Scene
* api shoudl produce WebSocket back to socket.io with position of hand or event based (click on object) so i can then trigger sound and DMX light via OSC

Models: 

* video - captured video of user
* victim - mobile phone connected to Wifi
* themes - predefined scene of lights + sound


Backend API:

* can store/show video, retreive thumnaul + path to video 
* can store/show victim information 
* can trigger themes