@raphael this is incredible!
trying to fight my urge to start playing with it immediately vs. watch the rest of the talks.

@ojack Thank you very much! Let me know your thougths if you play withit.

@ojack @raphael

A few years ago i looked at examples and the source code of IanniX.


Before that i had seen a visualization with sound at the ZKM in Karlsruhe that fascinated me. It was the approach how the geometry triggers the sound patterns. I think this had been created with IanniX.


@ojack @raphael

I considered several times if and how i could integrate IanniX into my Lisp / C++ world. Then i came to the conclusion that it would probably come down to a new implementation.

IanniX could be scripted at that time, but it wasn't like i could get into a flow while live coding.


@kandid @ojack Fascinating project kandid, thanks for sharing. I’ll drop a line in IanniX forum!

@kandid @raphael oooh I haven't tried IanniX, but love playing with ways that visuals trigger sound. I am very visual and it helps me understand sound better to be able to see it in different ways.

Some explorations in case they are interesting:
-- pixelsynth (additive synth based on drawing): ojack.xyz/PIXELSYNTH/
-- pixel colors to drum triggers: instagram.com/p/B1ccefNHO8Q/
-- pixel colors to arpeggiator sequence: instagram.com/p/B2BXywzHCxa/
-- spectral synth: instagram.com/p/B4VSiVTp5_D/
-- webcam "sequencer": youtube.com/watch?v=n6Vu7BnYdn

In all of these the sound is generated based on pixel colors, and I manipulate the visuals live in order to change the sound.

@ojack @raphael

I always work from the visuals. The sound usually comes too short in my animations. There are a few attempts from me in the direction of color to sound. This one for example:


There color areas are sampled in real time and the found color is sent to SuperCollider. Create an "ambient" sound from the image material.

But Iannix has a different approach. It's more geometry and movement to sound. It's closer to the approach that dancers trigger the sound.

Sign in to participate in the conversation

A fediverse community for discussions around cultural freedom, experimental, new media art, net and computational culture, and things like that.

<svg xmlns="http://www.w3.org/2000/svg" id="hometownlogo" x="0px" y="0px" viewBox="25 40 50 20" width="100%" height="100%"><g><path d="M55.9,53.9H35.3c-0.7,0-1.3,0.6-1.3,1.3s0.6,1.3,1.3,1.3h20.6c0.7,0,1.3-0.6,1.3-1.3S56.6,53.9,55.9,53.9z"/><path d="M55.9,58.2H35.3c-0.7,0-1.3,0.6-1.3,1.3s0.6,1.3,1.3,1.3h20.6c0.7,0,1.3-0.6,1.3-1.3S56.6,58.2,55.9,58.2z"/><path d="M55.9,62.6H35.3c-0.7,0-1.3,0.6-1.3,1.3s0.6,1.3,1.3,1.3h20.6c0.7,0,1.3-0.6,1.3-1.3S56.6,62.6,55.9,62.6z"/><path d="M64.8,53.9c-0.7,0-1.3,0.6-1.3,1.3v8.8c0,0.7,0.6,1.3,1.3,1.3s1.3-0.6,1.3-1.3v-8.8C66,54.4,65.4,53.9,64.8,53.9z"/><path d="M60.4,53.9c-0.7,0-1.3,0.6-1.3,1.3v8.8c0,0.7,0.6,1.3,1.3,1.3s1.3-0.6,1.3-1.3v-8.8C61.6,54.4,61.1,53.9,60.4,53.9z"/><path d="M63.7,48.3c1.3-0.7,2-2.5,2-5.6c0-3.6-0.9-7.8-3.3-7.8s-3.3,4.2-3.3,7.8c0,3.1,0.7,4.9,2,5.6v2.4c0,0.7,0.6,1.3,1.3,1.3 s1.3-0.6,1.3-1.3V48.3z M62.4,37.8c0.4,0.8,0.8,2.5,0.8,4.9c0,2.5-0.5,3.4-0.8,3.4s-0.8-0.9-0.8-3.4C61.7,40.3,62.1,38.6,62.4,37.8 z"/><path d="M57,42.7c0-0.1-0.1-0.1-0.1-0.2l-3.2-4.1c-0.2-0.3-0.6-0.5-1-0.5h-1.6v-1.9c0-0.7-0.6-1.3-1.3-1.3s-1.3,0.6-1.3,1.3V38 h-3.9h-1.1h-5.2c-0.4,0-0.7,0.2-1,0.5l-3.2,4.1c0,0.1-0.1,0.1-0.1,0.2c0,0-0.1,0.1-0.1,0.1C34,43,34,43.2,34,43.3v7.4 c0,0.7,0.6,1.3,1.3,1.3h5.2h7.4h8c0.7,0,1.3-0.6,1.3-1.3v-7.4c0-0.2,0-0.3-0.1-0.4C57,42.8,57,42.8,57,42.7z M41.7,49.5h-5.2v-4.9 h10.2v4.9H41.7z M48.5,42.1l-1.2-1.6h4.8l1.2,1.6H48.5z M44.1,40.5l1.2,1.6h-7.5l1.2-1.6H44.1z M49.2,44.6h5.5v4.9h-5.5V44.6z"/></g></svg>