Ultrasonic Audiovisual Synthesizer

•

Description

Ultrasonic Audiovisual Synthesizer is a system which allows the user to control music and visual graphics with gestures. In this project I integrate software and hardware to create an immersive audiovisual experience.

Principle of Operation

As the user moves their hands in front of the ultrasonic range sensors installed in the Arduino-based control device, the signal is transmitted to TouchDesigner. Depending on the distance between the hands and the sensors, the parameters of the generative graphics displayed on the screen change. TouchDesigner processes the incoming signal and sends it to the modular VCV Rack synthesizer, in which the parameters of the generative music are changed. A complex dependence is emerged - as the person controls the graphics and the music, the music also controls the graphics.

Demo testing

Thereminvox

Thereminvox is a musical device that allows the performer to change the tone and attack of the sound by moving their hands in the electromagnetic fields of the instrument. Inspired by Thereminvox this project aims to expand on the interactivity of the concept by the addition of the visual component.