Version 1 of the Synesthesizer
[Cross-posted on FITC, RBlank.com, and Almer/Blank Labs]
I've just publicly released the first available output from the Synesthesizer -- a side-project, executed in Flash, that translates pictures into music. The Synesthesizer is a Flash 10 musical synthesizer that relies on synesthesia-inspired translation metaphors. It is the first tangible product of Project Ludi, an internal skunkworks project at Almer/Blank, the goal of which is to translate any type of media into any other type of media.
I'm only a few short months into what is a very long-term endeavor, and I've had precious few hours to spend on the project in that time, but I always set the benchmark definition of version 1.0 of the synesthesizer as 'a system that produces something approximating music', and even though I haven't invested nearly the amount of time as I'd like, I believe that the current Synesthesizer meets this definition. And thus, I feel I have Synesthesizer 1.0. The Synesthesizer is a Flash 10 application that translates pictures into music in real-time. What I've included with this post is a rendering of the output of the application -- not the Synesthesizer itself. I'll let you judge the quality for yourself -- and please feel free to let me know what you think. Also, please remember that this is just three instruments restricted to one octave -- the version I will show in Amsterdam will have 8 octaves of over a dozen instruments.
Now, of course, there is far more to do here, but what I found most amazing about this process was how easy it was to get to a point of generating 'music' instead of 'sound'. In effect, I apply something along the order of six rules to get to this point. The addition of each rule to the Synesthesizer brings us closer to the generation of music, instead of raw sound.
To get a bit more insight into the Synesthesizer, you should check out my talk, Hearing Pictures, which I'll be presenting at FITC Amsterdam in February and at FITC Toronto in April. In this talk, I describe the process I followed to get the Synesthesizer to this point. Using the 1943 Hermann Hesse novel, The Glass Bead Game (also published under the title Magister Ludi, the protagonist of the novel, from whom Project Ludi derives its name), as a starting point, and proceeding through a discussion of synesthesia, the aural illusions of Professor Diana Deutsch, the Experiments in Musical Intelligence by Professor David Cope, the music of Tamarin Monkeys, and many other stepping points, I walk through the thought process required to assume an odd endeavor such as the cross-modal translation of pictures into music.
Share and enjoy!
-r
FITC Hugs Bikes in Amsterdam!
We are excited to announce that not only do we have Byron of Textura Design speaking on 'Changing the world with bikes' at our upcoming FITC Amsterdam 2010 event in Feb, but Byron also has hooked up a Mobile Social event through bike hugger during FITC Amsterdam! What is a mobile social you ask? As they put it, " Mobile Socials are an intersection of bikes, technology, and culture. We ride, talk bikes, blog, party, and give away product. The event offers no douchebaggery or lameness, but is for like-minded cycling fans of all types to get together and talk about bikes."
The Amsterdam Mobile Social, or MoSo, will happen on Sunday Feb 21st, the night before FITC Amsterdam kicks off. For all the details, please visit the bikehugger website.
Review: Professional Adobe Flex 3
Local Toronto developer Joseph Balderson recently saw the release of a project he's been heading up for some time, the ultimate book on Flex, Professional Adobe Flex 3. This massive tome is composed of 75 chapters and over 1300 pages, written by eight authors and covers pretty much anything you could want to know about Flex 3. The table of contents alone is 31 pages.
I set out to try and go through as much of this book as possible before writing the review. But it's just too big! Now that I've waited so long I wanted to at least put the word out that if you are doing Flex 3 work it's probably worth adding this to your collection. It's a fantastic resource full of advanced information written by some of the best developers in the community. And at a price of $38 CDN on Amazon it's also a total steal.
You're probably wondering why bother spending money on a Flex 3 resource when Flex 4 is so near. Well based on what I've looked at in this book a large portion is based on higher level concepts than just mxml basics and components. You'll definitely still be able to refer to this book to improve your Flex 4 work as well.
This is easily the best book on Flex 3 I've seen.