Kinetic colour sound

Whitney Music Box – Coverpop (jbum)

It seems as if a revolution of sound-image based synaesthesia is now truly underway. From software based approaches using FFT (Fast Fourier Transform) analysis of music and sound to drive visuals (VVVV & Proce55ing) to the manual synchronisation of the musical beat and the video frame in Vj’ing and experimental film.

Early Pioneers of experimental film and animation where just as interested in the symbiosis of tone and hue. The widely appreciated work of Oskar Fischinger is known particularly for its synchronisation of sound and image. Around 1950 Fischinger devised his ‘colour organ’ named the Lumigraph a machine played both sounds and lights and serving as an instrument for one-man shows.

Another pioneer interested in the relationship between image and sound is John Whitney. In his is classic work, Digital Harmony – On The Complementarity of Music and Visual Art, Whitney explores what he calls ‘harmonic resonance’ in animation, where different parts of an animation are given different fixed parameters (of say speed and/or direction) to produce subtle patterns. He referenced this further to musical harmony and laid down the groundwork for some specific methods for producing what he called ‘visual music’.

Coverpop’s ‘Whitney Music Box’ is a successful attempt at realising Whitney’s ideas. Coloured dots revolve in circles a periodically, and like a music box, when each dot reaches a specific point it’s associated note is sounded resulting in a kaleidoscopic composition composed entirely by numbers.

Other related musical studies at Krazydad worth checking out include A φ Fractal and Organum-Mathematicum.

One Response to “Kinetic colour sound”

  1. información5 writes:

    A complete news article on the development of the “Second International Congress of Sinestesia, Science and Art” Granada 2007 and interviews to the main lecturers, between whom they are Sean A. Day, president of the American association for the investigation and diffusion of sinestesia: Ed. Hubbard, neurocientífico well-known by the works published next to V. Ramachandram; Maurer Daphne, Canada; Carol Steen, New York or Mª Jose of Cordova, chief of a main directorate of the congress and representative of the Foundation artecittà, made by Haynu Noriko journalist, will be protagonist in Japanese newspaper MAGAZINE ALC
    Website of the newspaper
    I number of Agosto 2007.
    complete program:

Leave a Reply