Designed for an enclosed public space, the IC room allows visitors to manipulate and direct fragments of a complex electronic orchestra with natural expressions of hand and movement. A series of sensors placed through-out the room interpret gesture; each individual sensor controls a sound channel which contributes to the composition. Using two types of sensors - An X-Y grid for small hand movements, and a series of oversize theremin rods which can be controlled by the whole body, the system detects beat events and gestures related to rhythm patterns and dynamics, and uses this information to control the tempo, volume, timbre, pitch and effect of each sound channel in the mix.

 

 

 

 

 

 

 

 

research & related sites: T-garden | sensorband | visual conductor | kaoss-pad | theremin | audio park