Picture of Multimodal Music Stand
The Multimodal Music Stand (MMMS) is a new way to control audio synthesis and effects while playing a traditional instrument (sax, flute, violin, you name it), and offers quite a few extra possibilities for extended techniques that can be used while playing! There's already a webpage about our group project at UC Santa Barbara in which we developed the MMMS, so instead of repeating that here, I'll post the link - check it out!

Multimodal Music Stand Website

A short clip of the the MMMS in action is here, but there are better videos on the site above...

Multimodal refers to the capability of sensing input in more than one modality (audio input, video input, and sensor-based input). The audio and video input are pretty straightforward, involving a normal microphone and a webcam connected to your computer, but the sensor input is a bit more complex, hence this instructable...

We use the CREATE USB Interface, a simple circuit I developed for a class I teach at UCSB, along with the ThereminVision II kit for E-field (also known as capacitive sensing) as shown here:

CREATE USB Interface

ThereminVisionII kit

If you don't know what a Theremin is, do yourself a favor and search Youtube, you won't be dissapointed! The MMMS is basically equivalent to 2 Theremins, since it has 4 E-field sensing antennas, in addition to the audio/video input of course.

If you're interested in extending your performance techniques with your instrument by interacting with a computer, but don't want to use simple footpedals, build yourself a Multimodal Music Stand and start practicing with it!
JasoonS1 year ago

None of your links work anymore :(

This is beautiful...similar to theremin to CV to MIDI, but far more advanced.
robots1996 years ago
Amazing is all that I can say. I am a viola player and love this project.