This Scrambled Hackz guy is a mad genius — check out the video demonstration on YouTube. Basically, he’s created software that allows him to do real-time mash-up and remix performances of video clips. Here’s the breakdown of how it works, as described in Wired Magazine:
- Scrambled Hackz analyzes the audio portion of a video file to determine the tempo of the incoming audio, and then slices it up into discrete chunks of a quarter note, eighth note, sixteenth note and so on (a process also used by audio editing programs such as Ableton Live and Sony’s Acid software).
- Using a large number of vectors, those slices are classified into a database according to their sonic characteristics.
- When you send new audio information to the program (using, say, your voice and a microphone), it follows approximately the same process, becoming classified in the database. The software then outputs the pre-analyzed sample that is most similar to that newly cached sample.
- The result, as you can see in the video, is that König is able to reconfigure a Michael Jackson interview or any number of ’80s music videos on the fly, so that they produce a sound similar to whatever he inputs. On screen, the software plays the frames of video that accompany the selected audio.
Pretty amazing, isn’t it? Anyways, seriously, go check out the video. You’ll be amazed.
3 Comments
Yeah this system is genius – what I want to see him (or someone else do) is take the output from the system, and play it back in, perhaps some kind of filter to vary the input so as to trigger slightly changing sounds. Then you’d have music making music!
It is an impressive technology BUT listening to it for a while becomes quite enervating. I like cut-ups but in my opinion should they always be dancable and this is not the case with Scambled Hackz.
Playing the original song, mixing it with cut ups produced by Scrambled Hackz, combining this with smoother transistions between tracks, and then you have a killer Live Perfomance!
id love to try this beatmixing my turntables into scrambled hackz but the guy wont release it, even tho he said he would release it gpl and is using gpl source to acomplish this. in my oppinion this is a deriviative work of a gpl based product, a clear violation of the gpl. he is about to be turned in for gpl violations.
Post a Comment