I write the lyrics, select the style, voice, instruments, and overall song structure. The AI then generates candidate renditions, and I select the best for the "main release" of a song (there can be up to a hundred outputs to sift through). I also usually generate several "covers" that are runners-up, or with different styles if the lyrics are good enough to support that. Lately, you can also go back into a generated score and re-generate sections that aren't right. For instance, in this song I had to surgically remove the bridges because it decided to use some horrible, atonal, grating sounds instead of the simple piano riffs I ended up with. There is a lot of flexibility to massage the AI outputs. For instance (though I didn't do it here), you can generate it stanza by stanza by repeatedly extending it. Each time gives you several choices on how to proceed. This is actually a pretty powerful method. Sometimes, though, it nails the right way the first time. I think about the process as though I were a prospector with a metal detector (my musical judgment) seeking gold nuggets in a vast desert (the dataspace of solutions to the math). Sometimes you fall across real gems! I'm incredibly grateful these guys were able to build this kind of AI tool, because I can't actually play any instrument worth spit...but I know what I like and now I can get these these out of my head and into the real world. The other place I can exercise control is in the generation of the visuals, though not with this particular song. The video stories have a lot of room for control and creativity. If you'll forgive me for making this long comment a bit longer, the song "We The Just" perfectly illustrates this process. These are all C&W takes on the lyrics. The first one gets the full video treatment and is the best take on it in my opinion: th-cam.com/video/kF7fIIRiM7U/w-d-xo.html This is followed by the runners-up (out of 47 renditions), by three more "artists": th-cam.com/video/7_XoYBXNQAQ/w-d-xo.html th-cam.com/video/WmOIYlEx0VE/w-d-xo.html th-cam.com/video/GtmmCulm2YA/w-d-xo.html Glad you liked "Only A Dream"!
Beautiful song and lyrics. What part was created by AI or did you use to create music you wrote? Just curious
I write the lyrics, select the style, voice, instruments, and overall song structure. The AI then generates candidate renditions, and I select the best for the "main release" of a song (there can be up to a hundred outputs to sift through). I also usually generate several "covers" that are runners-up, or with different styles if the lyrics are good enough to support that. Lately, you can also go back into a generated score and re-generate sections that aren't right. For instance, in this song I had to surgically remove the bridges because it decided to use some horrible, atonal, grating sounds instead of the simple piano riffs I ended up with.
There is a lot of flexibility to massage the AI outputs. For instance (though I didn't do it here), you can generate it stanza by stanza by repeatedly extending it. Each time gives you several choices on how to proceed. This is actually a pretty powerful method. Sometimes, though, it nails the right way the first time.
I think about the process as though I were a prospector with a metal detector (my musical judgment) seeking gold nuggets in a vast desert (the dataspace of solutions to the math). Sometimes you fall across real gems! I'm incredibly grateful these guys were able to build this kind of AI tool, because I can't actually play any instrument worth spit...but I know what I like and now I can get these these out of my head and into the real world.
The other place I can exercise control is in the generation of the visuals, though not with this particular song. The video stories have a lot of room for control and creativity.
If you'll forgive me for making this long comment a bit longer, the song "We The Just" perfectly illustrates this process. These are all C&W takes on the lyrics. The first one gets the full video treatment and is the best take on it in my opinion:
th-cam.com/video/kF7fIIRiM7U/w-d-xo.html
This is followed by the runners-up (out of 47 renditions), by three more "artists":
th-cam.com/video/7_XoYBXNQAQ/w-d-xo.html
th-cam.com/video/WmOIYlEx0VE/w-d-xo.html
th-cam.com/video/GtmmCulm2YA/w-d-xo.html
Glad you liked "Only A Dream"!