Muse http://muse.com see hear think feel share Tue, 01 Nov 2011 01:40:26 +0000 en hourly 1 http://wordpress.org/?v=3.1.3 Be your own Stick Figure http://muse.com/2011/05/23/youtube-video/ http://muse.com/2011/05/23/youtube-video/#comments Mon, 23 May 2011 23:44:20 +0000 admin http://muse.com/?p=3597 What is unique about the Kinect is that converts your body into a cloud of points. From the point cloud, it is possible to create a body skeleton; sensing where your head, neck, arms, shoulders, hips, knees, and feet are in 3D space. Each body part can be controlling a separate control. Move your arms ...]]> Last Fall, Microsoft release a new controller for the XBox, called the Kinect. It has since become the most popular consumer device ever sold.

What is unique about the Kinect is that converts your body into a cloud of points. From the point cloud, it is possible to create a body skeleton; sensing where your head, neck, arms, shoulders, hips, knees, and feet are in 3D space. Each body part can be controlling a separate control. Move your arms to control music, move your hips to control sound, whatever you want. Complete freedom.

After the Kinect was released, developers started hacking their own drivers for Linux and Mac OS X. I started playing with the OpenNI and NITE drivers to get skeleton points. One way to use body parts as a controller is to convert the points into Open Sound Control (OSC) events sent over wireless. There are plenty of synthesizers that can accept OSC as a controller. Muse’s Sky platform, included.

Here is a simple skeleton that is used to seed the artificial life visuals in a forthcoming App from Muse:

]]> http://muse.com/2011/05/23/youtube-video/feed/ 0