Parseq tutorial 2: prompt manipulation and basic beat sync
ฝัง
- เผยแพร่เมื่อ 2 ต.ค. 2024
- Parseq is a parameter sequencer for the Deforum extension to the Stable Diffusion Automatic1111 UI. You can use it to generate animations with tight control and flexible interpolation over many Stable Diffusion parameters (such as seed, scale, prompt weights, noise, image strength...), as well as input processing parameter (such as zoom, pan, 3D rotation...).
Previous tutorial: • Parseq tutorial 1: Fin...
Access Parseq here: sd-parseq.web....
Source and docs (including setup instructions): github.com/rew...
Parseq doc for the animal fading animation: sd-parseq.web....
Parseq doc for the beat sync'ed animation: sd-parseq.web....
how about some of those setups as presets - there are at least 4-5 good presets in that tutorial - every layer you added should be another preset - cuz thats so much data its way easier to start from a setup that works, same with any of those places you can add those equations that may seem easy obvious to some but def not the majority - or add a dropdown box bin of useful ones somewhere we can grab that would make it alot easier to do stuff in it - amazing work
You’re doing gods work out here, man! I watch this video 10 times already and I feel super confident in my abilities now
Robin, I must say this 3-part video tutorial is the best tutorial of any kind out there. Concise, straight to the point, and covered all the why's and how's. You have developed a great tool, and produced an even better tutorial!
Love your tutorials. The practical examples are really helping me get my head around what would otherwise be a complete mystery!
Keep up the good work man awesome video, I started messing with stable difusion 2 days ago and I am loving it.
Mushrooms and Snakes but... NO BADGERS?! lol!
Thanks for the tutorials and for Parseq!
JUST now learning it.
Only been using 1111 for a couple months, and slowly adding to what I do with it.
This part is what I've been working towards, so thank you again for the time and effort!!
Wow ! Powerful ! Very good job ! Thank you
another fantastic video ...Thank you
I am deep into 4min music video ....
There one feature not sure how it can be done but would be best feature yet ...
Ability to Generate from frame to frame .....so lets say i have 2min video of 5000 Images . ...I want generate from just 4328 Frame to 5000 Frame ...
This feature is almost a must when making long animations ....right now im having to generate entire thing up to 5000 mark to see my changes ...so if i added it 1000 frames new changes so total 6000 frames ...i have to generate all of them up to 6000 to see the changes
Clever person like you may be able to figure away to get around this
Some Kind SET START and SET END point ...so that when generate it does it just from those in between
this is incredible, thank you for making that tool!
Legend!!!
Just amazing! I have been having a lot of fun with both tools so far! Can't wait for the next tut
been waiting for this...thank you
Robin you are doing magic with Parseq! Really great work mate, love this tool
Thanks for this wonderul app, i would love to make creations from this...
Can't wait for Parseq Tuto 3! :D
It's out now: th-cam.com/video/M6Z-kD2HnDQ/w-d-xo.html :)
@@rewbs Thank you, very much! :D Amazing content, as always! ^^
Great job! love you! thanks a lot! 感谢你做的一切！👍👍👍🙏🙏🙏
Thank you Robin, both for the one-of-a-kind tool and the excellent way you package complex information into easy to follow tutorials. Parseq is simply next level, thank you for taking the time!
I'm glad I spent the last few months learning Adobe After Effects! Parseq doesn't really seem that difficult anymore, actually interface is really well made/intuitive. Deforum is a mess 😂
Oh goshhh ... what a recital! What a pleasure to watch and to learn. And what a tool!! Thanks a lot for your artistry!
Wow thanks!
After ending prompt manipulation part at 13:00, some sort of "entity" (maybe the mushrooms!) took control of Robin's brain and turned him to an evil developer, mathematician. Unfortunately, seeing "beat sync" section has damaged my brain, the sad part is the title says "basic stuff". I'm seeing nightmares now because of the screenshot of next tutorial he showed at the end. Hope world ends by then.
Is it possible to add a Darkmode? I'm flashbanged all nigth 😂
Haha, fair enough. Could you add a feature request on GitHub? Thanks!
COOL
Great work Robin，I use FILM, error："Sizes of tensors must match except in dimension 1. Expected size 12 but got size 8 for tensor number 1 in the list." why?
Hi! Hmm that doesn't sound related to Parseq, so you might want to take the question to the Deforum discord. Good luck!
@@rewbs It's settled. Thank you
oh yeah ...
I feel as if I have stumbled across the holy grail but need the rosetta stone to intruperat my find! It is clear to me that Parseq is the answer all my deforum prayers, but my mind is getting boggled listening to you explain the maths. As an entitled American, I want for someone to hand me exactly what I need without me having to do the work, I'm trying to not be that person, but I am seriously boggled. It would be helpful if there were some templates with which I could work until I get to the point where each setting wasn't a complete mystery that leaves me wishing I had paid attention in Trigonometry class. Regardless, you have come up with an amazing tool that will change Deforum forever, now i I could just figure out how to use it. . .
Thanks for the kind words! There are some examples here which might help get your mind around some of the formula: github.com/rewbs/sd-parseq/discussions/categories/parseq-example-library
Thanks so much for making this dude. You’re seriously so fucking cool. I can’t wait to see what kind of updates you make bro
你好我来自中国，你的教程做的太好了，但对于不了解英语的人群以及不了解数学的人群来说有很高的学习门槛，也许能让教程更简单点？有没有国人兄弟给我指条明路啊🥲
Hi, I come from China, your tutorial is very good, but for those who do not know English and do not know math, there is a high threshold of learning, maybe you can make the tutorial easier?
Hello, really appreaciate this tutorial video. i have a critical question that i want to use two specific images at the beginning and the end seperatively by using guided images function, but i found out just only the first image works but it won't change to second image.why, it really makes me confused and i have no idea how to figure it out. Looking forwarwd to getting reply, thanks again.
i have to admit that first time you open parseq, it looks very scary :D ....i guess i'll spend some time on your tutorials and hopefully I'll be able to pay tribute to your work ! great job anyway !
This is a game changer. How can I use it with the Colab Notebook? I've tried to install the SD WebUI without success
Can anyone link and recommend other deforum / stable Diffusion tutorials?
Thank you so much! So fun to learn, all tutorials are great and I'm learning at record speeds!
These tutorials are great - thanks very much for creating the tool and creating the tutorials. I followed them but it was only until I started playing around myself and trying different things (all the stuff you mentioned here :)) that it is starting to "click"
This is the best guide for deforum parseq!! your amazing!
this is so freaky!!! I love it ❤❤
Like si hablas español y usas Parseq, gracias Robin, eres el Steve Jobs del SD
Hi bro, getting this error Rerolling with +1 seed failed for 10 iterations! Try setting webui's precision to 'full' and if it fails, please report this to the devs! Interrupting...,, any idea? trhanks did exactly the same as this tutorial
Hi! This doesn't look related to Parseq to me. Seems like you're getting failures when invoking the Stable Diffusion generation. Have you tried running the webUI with "--precision full" as the error message suggests? If so I'd recommend asking for help on Discord.
This is wonderful. Just what I was looking for. Thanks, Robin, you're the king.
yes! just came lookin for this. thank you
one request i would like to give, pos and neg prompts that will generate each frame (common Prompts )
What kind of magic is this, how is this possible?
Thank you for this! Very well explained as well.
can't wait for more amazing tutorials
Great work Robin, You really know your math and the techniques behind every properties!! This is next level Deforum manipulation, thanks for sharing. Can't wait to test it out..
Also noticed if you have more than 6 prompts ...the others wont show on the pull around graphic, However they still will generate like normal
Thank you so much, this is gold!
Hello is there a way to use an image or a video to be transformed by parseq? i just studied parseq and found it amazing but i dont know or cant find this feature. i tried uploading an image in the init tab but it doesn't generate properly please help
Yes, you can use init images, guided images and controlnet to generate videos based on input images or videos. It works the same as when using the a1111 extension without Parseq.
Hello, is there a way to use hybrid video and parseq at the same time?
Yes, you can use hybrid video just as you normally would in the a1111 Deforum extension, alongside your Parseq input.
thank you for the tutorial! please make a tutorial parseq with video init
thank you so much your tutorials are really valuable. To master functions and expressions well should I study python?
No not necessarily. It might help a bit but Parseq uses its own syntax and functions. It's best just to experiment with Parseq itself and read the docs.
As a musician and an AI artist I really want to get in on this but its a step too far with the formulae. I just want to use my midi files and translate them into key frames....im sure it will come!
Midi / tracker file import is a good idea that has been suggested a few times. I can also imagine a VST plugin that allows you to generate Deforum settings directly using your DAW. Food for thought. :)
This is some top notch work :)
Keep up the excelent work !
I am very grateful for your video tutorial on Parsec. As I understood, I don't need to set anything in Deforum settings, I just need to insert a link and everything automatically goes to Deforum. Except for some of the features. I've read documentation about Parsec, but it's better to see it once than read something you have no idea about, especially if your English is not good. You made something like a video editor - moving "tips". This is very handy. For now, I will learn what you told me in two lessons. One more thing. If you suddenly know such lessons, understandable as you have about Deforum, could you advise? Not only about how to change angles, zoom, etc.-that, in principle, is understandable. But it seems to me that many people, including myself, still don't understand how all the inputs and outputs - video, images, masks, frame2video, controlled animation, and Parsec - are connected. Is it even possible to link all of this, and if so, how? I've already started to figure it out a bit. But I've come to this by turning various features on and off and inserting videos, images, etc. It wouldn't be a bad idea if someone who's knowledgeable created a video tutorial like this. And these are the basics, after which you can safely experiment. Thank you again.
Where should I send you my parseq animations because I want your feedback since you are the creator of parseq
Hi! You could drop by the Deforum discord server and share them there.
Great video explainer! I think I may be a convert to Parseq! Really appreciated the sub-seed and seed travel explanation. What are your thoughts on using Controlnet with Deforum? It seems like its early days and is not so useful right now. It occurs to me that Parseq would be really great for controlling Controlnet! What do you think?
To be honest I haven't had a chance to try ControlNet yet! The only downside of spending my time on Parseq is that I tend to end up being a few steps behind on trying other new tools. :) But the potential is huge. I'm looking forwards to trying ControlNet with a classic Milkdrop-style audio visualisation as input images.
@@rewbs When is the next tutorial?
Thank you so much for this tutorial! Can't believe you have so few subscribers. I hope that changes soon! Do you know if I can use my own music with Parseq? In Midi format, so it can recognize bpm (tempo).
Hi! Parseq doesn't read MIDI currently, but rather rendered audio (mp3, wav etc...).
@@rewbs Thank you for reply, Robin. Oh, so it actually recognizes audio waves 😮
youre the best, you should reach some ai youtube creators to make videos about your tool. ive been using it the past week and a half and its one of the more powerful tools ive seen with deforum.
great job keep it up, looking into more videos and updates
Thank you! Do you have any suggestions as to which AI youtube creators I should reach out to?
@@rewbs sure my favorites are that do deforum vids are Sebastian kamph, koi boi and olivio sarikas. most of them have a discord they answer in and are pretty easy to reach. reach for as much as possible i know for fact this tool is searched for cus i have seen vids and the other tools are pretty bad
what can I tell. WoW
hello, thank you very much for your tutorial, unfortunately I get after inserting the Copy output from Parseq to deforum, this error message: "UnboundLocalError: local variable 'parseqName' referenced before assignment" this is displayed after I pressed the Generate button, do you know what I can do? thank you very much. unfortunately it does not start to generate in deforum.
Hi, please make sure you're on the very latest version of the Deforum extension and then try again. Let me know how it goes!
@@rewbs
Thank you very much for the tip and your work!!!, it worked(partially).... (more about this below).
My steps were as follows:
1. I edited the file "webui-user.bat", opened it in the editor and added "git pull" to it
(to enable automatic update).
2.Then i checked the extensions tab for update for Deforum, it was up to date.
3.Then i downgraded my pyton version(from 3.10.10 to 3.10.6).
***Then I found out*** that I should have all options turned on in the Parseq option: "Managed fields" (so that all settings are done by Parseq).
Then the error ("UnboundLocalError: local variable 'parseqName' referenced before assignment") doesn't happen anymore.
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
I have more questions:
1.Do you know if it comes to problems if one would use quite many prompts? For example over 50 prompts?
2.would it be possible to add an option to the prompts to enter also times(seconds)?
so instead of:
From; Frame: "0" ... To; Frame: "120"
to
From; Sec: "0.00" ... To; Sec: "5.00" .
it's totally late, must go to sleep urgently ^^
I'm kinda lost! My generated video It doesn't look smooth like your first video generated at minute 5:00! Everything goes so fast! I used the same settings! I tested high values of Strength schedule in the SD and I don't arrive at this result in the animals' video. I even used your settings in the description and it's not the same in the result.
Hi, regarding the smoothness could it simply be that my videos are FILM interpolated to 60fps?
I have also uploaded the settings.txt files from my renders for a few vids. You could diff these against your settings.txt and find the differences.
- Here's the full settings file from the underwater video at cadence 1, Euler 20 steps, 512x512: gist.github.com/rewbs/1c766a44d7893fd4934bf29537224ab1 .
- Here's the snake/mushroom one: gist.github.com/rewbs/51313b9238a4385f730f975e96d02af8
- Here's the cat/koala/fox/bear one: gist.github.com/rewbs/2645616d86750768de35a651e933ae8f
@@rewbs Coming back to thank you! I understand now and it generated a video the way I needed it, Now I'm going to work my tests on the camera for better results. Thank you very much!
just a doubt......that music is added by you sperately ryt?
You can add audio as part of the generation - set it up in the Output tab of the a1111 Deforum extension (I think that's what I did for these videos). However it's also easy to add audio afterwards, e.g. with ffmpeg.
Hey man! Really great work, and thank you for the hard work! Are you willing to create a tutorial or cheat sheet for cool formula effects for X,Y,Z moves?
Yes, and I'm also working on a feature to preview movement: th-cam.com/video/O5CpaNODtwU/w-d-xo.html
@@rewbs The man! Amazing 👏
I love you
Hi Robin, Thanks for making this wonderful program. I admire the amount of work you put in to make it user-friendly and I really appreciate the tutorials. I just have one question... so far. I'm trying to figure out a way to save my favorite Parseq documents and I found the best way is to use the Upload button and copy the URL. Then I can use the URL to go back to the document and it will be just the way I left it. However, the warning says, "Once uploaded , your parseq doc will be publicly visible." Can you tell me where it's visible? Actually, I would rather not have my experiments be pubilcly visible at all. Is there another way to save a document? I have tried to save it by giving it a new doc name, but that doesn't seem to work. Thanks so much and keep up the good work!
I figured it out. All I have to do is click "try the browser" and there are my old documents.
Thank you for the kind words! That's right. Note that documents are saved in your browser local storage, so will not be available if you use another browser or browser profile (and can be lost if you cannot access the browser profile). However, you can export your whole parseq document database and import it into another system via browser -> manage database.
Thanks Robin, I'm working on your 2nd tutorial. I got through the first half Ok but I'm on my 4th try with the second half -- and my third try of writing it all down coherently so I don't forget it. I really want to be up for your 3rd tutorial because I love your sequences -- so smooth! Thanks again.
when I put keyframes in 3d mode and border mode in wrap mode I get this error message on the terminal ""User friendly error message:
Error: 'compute_indices_weights_cubic' not implemented for 'Half'. Please check the programming/initial values. Also make sure you don't have a backslash in any of your PATH - use / instead of \."" what does this mean and how can I fix it?
how did you get that sdVAE drop down box at the top of your UI? Thats def a must!
In the a1111 settings, there's an option called "quicksettings list". Add 'sd_vae' to that list.
@@rewbs thank you
Facing issue
Any changing on keyframe grid showing no impact on field graph
Hi, could you provide some more detail on how you got to that state, and/or share your parseq doc? We can also discuss on Discord (link at the top of the parseq UI).
@@rewbs ok, I will send screenshots and my settings on discord channel and thank you very much for your reply
Are we going to get the ability to do common prompt soon?
Hi, I have raised a feature request for this here: github.com/rewbs/sd-parseq/issues/107 . Not yet sure when I'll get to it though! :)
@@rewbs hey thank you so much !!!! i just saw that you added i dont understand what all it takes to do everything that you do to make parseq the awesome Parameter sequencer that it is but im Grateful .
Hello. I don't know if you read it or not. My question is, does "Parseq"work with "Guided Images" tab? I just haven't figured everything out yet, but in "Parseq" you can work well with the "seed". Thus, it will be possible to work from frame 0 to frame 100 with one image and set the "seed" (frame 0 to frame 100) with subseeding or whatever it is called, and the others as well. This will be much more stable than increasing each frame by 1.sorry for my English.
Yes, you can combine guided images with Parseq. Parseq doesn't have any built-in features yet for guided images, but you can set up guided images as usual in the Deforum extension UI, and also load up a Parseq manifest for controlling other params and it will combine just fine. The only caveat is that the guide images strength schedule seems to override the main strength schedule, so it might be hard to control strength with Parseq if you're also using guided images. (This is fixable, just let me know how high priority it is.)
@@rewbsThank you for your reply. I have started to study Parseq. I was trying to understand how all the tabs interact in general, what can be generated from what. And from what I understand, all the tabs can be interconnected. And they can all be used for better image generation.
Thanks for what you came up with.It's very interesting.Looking forward to your next lesson on Parseq.
太棒了！快更新啊！期待更多教程！
Un excelente complemento para deforum, ahora empieza a ser mucho más potente. GRacias por ello y los maravillosos y didácticos vídeos.
do you have a discord?
Yep, I'm often on the Deforum discord server in the parseq channels. There's a link in the parseq UI.