@raphael this is incredible!
trying to fight my urge to start playing with it immediately vs. watch the rest of the talks.

@ojack Thank you very much! Let me know your thougths if you play withit.

@ojack @raphael

A few years ago i looked at examples and the source code of IanniX.


Before that i had seen a visualization with sound at the ZKM in Karlsruhe that fascinated me. It was the approach how the geometry triggers the sound patterns. I think this had been created with IanniX.


@ojack @raphael

I considered several times if and how i could integrate IanniX into my Lisp / C++ world. Then i came to the conclusion that it would probably come down to a new implementation.

IanniX could be scripted at that time, but it wasn't like i could get into a flow while live coding.


@kandid @ojack Fascinating project kandid, thanks for sharing. I’ll drop a line in IanniX forum!

@kandid @raphael oooh I haven't tried IanniX, but love playing with ways that visuals trigger sound. I am very visual and it helps me understand sound better to be able to see it in different ways.

Some explorations in case they are interesting:
-- pixelsynth (additive synth based on drawing): ojack.xyz/PIXELSYNTH/
-- pixel colors to drum triggers: instagram.com/p/B1ccefNHO8Q/
-- pixel colors to arpeggiator sequence: instagram.com/p/B2BXywzHCxa/
-- spectral synth: instagram.com/p/B4VSiVTp5_D/
-- webcam "sequencer": youtube.com/watch?v=n6Vu7BnYdn

In all of these the sound is generated based on pixel colors, and I manipulate the visuals live in order to change the sound.

@ojack @raphael

I always work from the visuals. The sound usually comes too short in my animations. There are a few attempts from me in the direction of color to sound. This one for example:


There color areas are sampled in real time and the found color is sent to SuperCollider. Create an "ambient" sound from the image material.

But Iannix has a different approach. It's more geometry and movement to sound. It's closer to the approach that dancers trigger the sound.

Sign in to participate in the conversation

Welcome to post.lurk.org, an instance for discussions around cultural freedom, experimental, new media art, net and computational culture, and things like that.

<svg xmlns="http://www.w3.org/2000/svg" id="hometownlogo" x="0px" y="0px" viewBox="25 40 50 20" width="100%" height="100%"><g><path d="M55.9,53.9H35.3c-0.7,0-1.3,0.6-1.3,1.3s0.6,1.3,1.3,1.3h20.6c0.7,0,1.3-0.6,1.3-1.3S56.6,53.9,55.9,53.9z"/><path d="M55.9,58.2H35.3c-0.7,0-1.3,0.6-1.3,1.3s0.6,1.3,1.3,1.3h20.6c0.7,0,1.3-0.6,1.3-1.3S56.6,58.2,55.9,58.2z"/><path d="M55.9,62.6H35.3c-0.7,0-1.3,0.6-1.3,1.3s0.6,1.3,1.3,1.3h20.6c0.7,0,1.3-0.6,1.3-1.3S56.6,62.6,55.9,62.6z"/><path d="M64.8,53.9c-0.7,0-1.3,0.6-1.3,1.3v8.8c0,0.7,0.6,1.3,1.3,1.3s1.3-0.6,1.3-1.3v-8.8C66,54.4,65.4,53.9,64.8,53.9z"/><path d="M60.4,53.9c-0.7,0-1.3,0.6-1.3,1.3v8.8c0,0.7,0.6,1.3,1.3,1.3s1.3-0.6,1.3-1.3v-8.8C61.6,54.4,61.1,53.9,60.4,53.9z"/><path d="M63.7,48.3c1.3-0.7,2-2.5,2-5.6c0-3.6-0.9-7.8-3.3-7.8s-3.3,4.2-3.3,7.8c0,3.1,0.7,4.9,2,5.6v2.4c0,0.7,0.6,1.3,1.3,1.3 s1.3-0.6,1.3-1.3V48.3z M62.4,37.8c0.4,0.8,0.8,2.5,0.8,4.9c0,2.5-0.5,3.4-0.8,3.4s-0.8-0.9-0.8-3.4C61.7,40.3,62.1,38.6,62.4,37.8 z"/><path d="M57,42.7c0-0.1-0.1-0.1-0.1-0.2l-3.2-4.1c-0.2-0.3-0.6-0.5-1-0.5h-1.6v-1.9c0-0.7-0.6-1.3-1.3-1.3s-1.3,0.6-1.3,1.3V38 h-3.9h-1.1h-5.2c-0.4,0-0.7,0.2-1,0.5l-3.2,4.1c0,0.1-0.1,0.1-0.1,0.2c0,0-0.1,0.1-0.1,0.1C34,43,34,43.2,34,43.3v7.4 c0,0.7,0.6,1.3,1.3,1.3h5.2h7.4h8c0.7,0,1.3-0.6,1.3-1.3v-7.4c0-0.2,0-0.3-0.1-0.4C57,42.8,57,42.8,57,42.7z M41.7,49.5h-5.2v-4.9 h10.2v4.9H41.7z M48.5,42.1l-1.2-1.6h4.8l1.2,1.6H48.5z M44.1,40.5l1.2,1.6h-7.5l1.2-1.6H44.1z M49.2,44.6h5.5v4.9h-5.5V44.6z"/></g></svg>