HALOFORM
Haloform is an interactive audio-visual installation where users can manipulate a reactive particle visual using just the tips of their fingers.
Haloform is an interactive audio-visual installation where users can manipulate a reactive particle visual using just the tips of their fingers.
My main goal was to make an immersive experience where sound and visuals worked together, all controlled by user's hands. The biggest challenge was getting TouchDesigner and Ableton Live to work with each other smoothly, and also making the hand controls easy and natural for people to use without instructions.
My approach was to build the system piece by piece. First, I used tools (the TD-Ableton and MediaPipe plugins) to solve the main tech problems: linking the audio from Ableton to the visuals in TouchDesigner, and getting the computer to see hand movements. Then, I figured out how pinch should control the visuals and sound. I made sure every finger movement changed both the picture and the sound in a satisfying way. We tested it with users and simplified the controls until they were super easy to understand.
I learned how to connect audio and visual software to work as one. The project was a big success at my showcase. It proved I could turn an idea into a fun, working experience and really showed me the power of mixing art, technology, and interactivity.