Body Sounds

The Pure Data patch (named Cochlea) was done so that a user can select the type of oscillator they wish to use. The port has to be selected to initiate the reception. Some sound modifiers (mainly filters and a reverb patch) were included. Although work is still on process with the idea of improving it so that it can be integrated with VCV rack or another sound generator capable of receiving OSC messages, the piece is functional and was presented in the Jewelry Thesis Show of Spring 2018 at SCAD (Savannah College of Art and Design).

The data had to be transmitted over WiFi. At first TCP/IP was being used with mixed results. Connection wouldn't be successful, there was lag or data would be lost. On the same Arduino Forum it was suggested to pack the data from the accelerometer as OSC messages and use the mrpeach library in Pure Data to unpack them and then process them. 

A drawback was the connection of the WeMos to a Network. Eventually it was possible and the transmission started as OSC messages. 

In conversation with the Jewelry designer, it was agreed on working with two accelerometers. One for each hand. She liked the LED as it was an inspiration to her design. It was decided that two RGB LEDs will be used in the piece. The use of the serial port was discarded as the ideal was for the piece to be worn by a dancer. WiFi transmission was decided. 

It was also decided to include optical fiber to add more impact to the use of light. The piece, on her review, went through different changes, from including the cable communicating the accelerometers and LEDs on the hands, to the board, to conceal it from view so that only the piece, and the sound generated, caught the attention of the spectator.

These changes were a challenge. The board had to be changed from an Arduino UNO to a WeMos D1 R2 (suggestion from a help request on Arduino Forum). It includes two I2C addresses, needed to read the two accelerometers, and an integrated WiFi module, saving both time and money.

A PCB design was implemented as the accelerometer and LED (with their resistors and cable connections) had to fit in an small space. Communication went back and forth to properly design and 3D print the hand pieces.

The first tests began with reading information from an MMA8452Q accelerometer with an Arduino. An LED was used to confirm that data was being received and could be manipulated. The accelerometer's information was then transmitted over serial port to Pure Data, where a patch with a single oscillator object was placed.

At first, on the Arduino code, the data from the accelerometer was being mapped to MIDI notes. These numbers where then received in Pure Data. For whatever reason, the numbers were not corresponding, a 60 sent was received as a 0.3 or other related numbers. Adding an mtof object on the patch helped produce sounds, however, low frequency and random noises, but still sound.