Visual Music / Lesson 2 / Audio Visualizers and the Shape of Sounds

Lesson Overview

As discussed in Stills To Motion module, we are hardwired to find patterns in shapes that are similar and arranged closely together. In this module, we can explore pattern making as a synaesthetic device, influencing the frequency, amplitude and continuity of repetitive shapes and images to rhythmic effect.

Lecture Videos

1. The Shape of Sound: History and basic concepts

(The Shape of Sound Lecture Video)

2. The Shape of Sound: VDMX Demonstration

(The Shape of Sound Demonstration Video)

Lecture Notes

(The Shape of Sound Lecture Slides)

Reference Links

• Booba/Kiki
• Aphex Twin: Equation
• Rutt Etra synthesizer
• Rutt Etra walk through
• Vasulkas: Transformations
• The Wobbulator
• The Joshua Light Show: Fulldome
• LZX Video Synthesizers

Resources

• VU Meter + Booba/Kiki Example ISF
• ProjectMilkSyphon

Related Tutorials and Case Studies

• Creating and installing ISF generators
• ISF from Silvia Fabiani
• Eurorack & Live Coding with Sarah GHP!

Homework

Assignments

1. Create and record three Booba/Kiki shape-based sequences ~10 seconds each using different forms of music and sounds effects.

Notes:

• Recordings for these assignments can be in h.264.
• Use ProRes if you plan to use them for further editing in Final Cut Pro, Resolve, After Effects, etc.

Review Questions and Further Discussion

1. What is the shape of a sound?

• Booba/Kiki effect
• Waveform visualization
• FFT visualization
• Audio Spectrograms

2. What are some types of Audio Visualizers:

• VU Meters
• Waveform and FFT Visualizers
• Audio Spectrograms
• ProjectMilkSyphon
• Booba / Kiki ISFs
• Rutt Etra