After the addition of external effects, let’s have a look at how we can augment an instrument by adding sensors directly on the body of the instrument. Consequently, these sensors will require new gestures from the musician. It is without doubt a more complex solution for the performer, as in addition to their usual playing, they need to manage the new gestures.
Let’s begin with Matthew Burtner’s Matasax project which he started in 1997, with the first results in 1999. An onboard computer microprocessor tracks the gestures of the performer and sends the data to an external computer. The computer then converts the data into sound parameters. As we can see, the gestures are multiplied, and the position and the movements of the instrument become part of the sound creation process.
Another example is the MIGSI project (Minimally Invasive Gesture Sensing Interface) developed by Sarah Reid and Ryan Gaston at the California Institute of the Arts.
While most projects that imply adding sensors are invasive and permanent for the host-instruments, this project aims to simplify the procedure as much as possible and facilitate the attaching and removal of the sensors.
The trumpet makes things easier, as the musician only uses one hand for playing the notes and the other hand is therefore available for performing additional gestures.
The Sampo offers a complementary and accessible approach to increasing the expressive possibilities of acoustic instruments. Although it does not rely directly on the addition of physical sensors on the body of the instrument, the Sampo makes it possible to exploit the musician's gestures and nuances thanks to a microphone and real-time sound processing..
This non-invasive solution adapts to a wide range of instruments, transforming acoustic sound with interactive sound effects and transformations. In this way, while remaining faithful to their traditional playing, musicians can immerse themselves in an enriched experience, without requiring complex physical modifications to their instrument, as is often the case with projects based on on-board sensors.