Radiohead - Videotape (Mephistopheles Mix) [AI Generated Video]

My contribution to the conversation about this song, made using the tools I know best. That means a machine-learning model for stem separation and custom python scripts for prompting the image model and making animations.

[@GrahaminKorea]

Wow - just found this via your comment on the SM64 In Rainbows video - this is astonishing. Did you create that video as well as the remix? If so, unbelievable and this deserves many orders of magnitude more views! Only wish you incorporated the arpeggio sequence from the earliest versions of this song into your mix. But serious kudos, and thanks for a moving version of one of my favourite songs...

[@rajb245]

Yessir, I do AI for a living and used AI-based tools for both the audio track separation and the video. Having listened to remixes and live versions of this song over and over, there's more I'd like to have done with this track, but I just put it out into the world to get it off my mind. Otherwise I'd futz with it for months and forget about it, then no one would ever see it.

[@GrahaminKorea]

@@rajb245 I'd be fascinated to learn what tools and workflows you use to create imagery like this. I'm familiar with still AI imagery but this is a very compelling video and I'd love to see more works like this...

[@rajb245]

@@GrahaminKorea this *is* AI still imagery, but each frame's initial condition before the diffusion noise/denoise process is a slight zoom in of the previous frame. each chunk of frames has a prompt, then the prompt changes at various points in the song. the net result is that you continuously zoom into this fever dream. after all those frames are generated, its just standard tools that can encode a sequence of images into video and multiplex / encode in the audio source to make one video file for upload to youtube. check out here, deforum.github.io/ but let me caution you that this isn't really user friendly product

[@davidfernandezfernandez8368]

Amazing work man. Do you have a github repo or something for this? Would love to see how this was made.

[@rajb245]

thanks! the video was generated with a modified version of the deforum notebook: github.com/deforum-art/deforum-stable-diffusion/
the audio was split into stems using hybrid demucs:
github.com/facebookresearch/demucs

[@mmmmmmmmmmm10]

Youd get more views if you AI in the title. Like Radiohead Videotape remix with video made with AI.

[@rajb245]

Interesting point, wonder if I can update the title now...thanks for listening!