The NEW KING of Face Swappers! Reactor Tutorial. Roop is dead.
ฝัง
- เผยแพร่เมื่อ 15 ต.ค. 2023
- This content is educational for academic research purposes only.
Roop is dead. Long live Reactor. The new face swapper for changing faces. Works with CPU only!
For a1111/SDNext/Vlad github.com/Gourieff/sd-webui-...
For Comfy github.com/Gourieff/comfyui-r...
Prompt styles for Stable diffusion a1111 & Vlad/SD.Next: / sebs-hilis-79649068
FREE ComfyUI workflow for 1.5 models: / comfyui-1-5-86145057
FREE ComfyUI Workflow for SDXL: / comfyui-workflow-86104919
Get early access to videos and help me, support me on Patreon / sebastiankamph
Chat with me in our community discord: / discord
My Weekly AI Art Challenges • Let's AI Paint - Weekl...
My Stable diffusion workflow to Perfect Images • Revealing my Workflow ...
ControlNet tutorial and install guide • NEW ControlNet for Sta...
Famous Scenes Remade by ControlNet AI • Famous Scenes Remade b...
Get early access to videos and help me as a Patreon supporter www.patreon.com/sebastiankamph
I laughed more than I should have at your little joke at the beginning which i've heard a thousand times before. Must have been your delivery. :)
Hah, glad you enjoyed it 😁🌟
Amazing as usual Seb o/ ! Thank you and have great weekend everyone =)
Thank you very much, Marcelo! I hope your weekend will be excellent too 😊💫
Thanks a lot, loving it. My 2 cents: you need at least 1 model inside insightface folder for this to work!
Thanks Seb for sharing this! ❤
this was interesting, thanks, definitely upper hand on roop. 😀
I've used Face Swap Lab a lot these days, with good results. It allows training faces on multiple images (I get really great results when I have video of someone showing them at various angles) and has batch processing capability. Is there any way in which Reactor is superior to FSL?
The face swapping model is the same for both (and Roop as well), so the quality of the result should be similar. I haven't tried Face Swap Lab or ReActor, so I can't say anything about the usability of either.
@@phizcI can confirm that they use the same technology and the results are pretty much the same, but I find FSL to be more configurable and I love that you can train the faces and get a little better results
Yeah I'm confused about why he is saying the resolution is greater when it's the same tech?
@@phizc
FaceSwapLab has an added advantage, video output. No more weeks of training to watch something in order to get off. 😸
Faceswap is still better, you can train from multiple photos creating a normalized face, you can play with pre and post processing, you can include in animations, upscaling, and a long etc. Yes the all based in the same technology though.
hey do you need webUI 2.0 to do this? havent updated mine since 2022 coz all of my LORAs and models work for 1.5, but this reactor thing looks dope
Great content thanks Seb!!
I'm kinda suprised I'm just now seeing youtube videos about reactor, I've been using it for the last 3 or 4 months, great video as always though!
I'm getting a lot of trouble with it in ComfyUI. Have you had any luck installing it into comfy?
i did the steps but reactor does not show up. only in cmd is as in your vid (reactor status), in SD don't appear
You're just a cool dude. I have a subscription for this extension
Hey sebastian
tnx for video ❤
I do all the steps but after restarting the UI the extension is not added to the SD
Could it be because VS is not updated?
Because I have the same problem with roop
any ideas as to why when you swap faces with an illustrated face say, the image comes out blurry, you can still see that the face swapped perfectly but the output image on the face is very pixelated?
Face restoration isn't working would be my guess.
I can't say for sure as I haven't opened 1111 in months since discovering ComfyUI, but as far as I know all of these face swaps are at 128px, which are then processed with face restoration (gfpGAN, codeformers, etc...) to produce the result. If the face restoration fails you will end up with the unrestored raw face swap which is much lower resolution.
One work around would be to simply produce images where the face is smaller in the frame (face
why cant we simply raise the resolution ? @@ArielTavori
What sometimes works better for me is first generate an image. Then copy to im2img inpaint.
Then inpaint the face and select paint mask only.
Then below that enable faceswap, select the Gfgan and then generate.
This gives me often better results than when swapping during initial txt2img generation.
Hello, can you please tell me if it is possible to replace the face, before applying lora. For example, first replace the face, and then stylize the picture as a drawing?
Yes, I'd run the resulting face swap image through an img2img or ControlNet pass if you want it in another artstyle. The face will probably not stick as well as the initial face swap though
Thank you. I have to balance between portrait likeness and creative processing. Have a good day.@@sebastiankamph
Is it possible to face swap without changing the mouth and without using inpaint?
The goal is to face swap a whole video or gif using the Batch window. But If the mouth is open, then frames with the open mouth will be ruined and I don't want to go frame by frame and manually fix the mouth with inpaint.
Well that completly broke my Automatic 1111. Thanks alot.
Aas a non native English speaker, I really appreciate the addition of subtitles. Keep up the good work, Sebastian!
Please make a tutorial on this for ComfyUi !
Thanks a lot. I found your video much easier than other guys. Its more personal and not like others sounding way to professional. Today i succesfully installed Reactor. Previous day i struggle and confuse following others about how to install Roob and Reactor that i ended up installing stuffs in Visual studio, Python, C++ environment and API desktop Development = 12GB 😑 Should i uninstall if i don't require them?
FaceSwapLab is more versatile, you can 'train' faces and saving it with safetensor file for special person name , you dont have to reupload or change face any time when using it.
Hi Sebastian, thank you very much you explain very well, I wanted to ask you why the enable section disappeared from me? Thank you
Roop has been dead for months, I have heard of reactor once or twice but I use faceswaplab which by the looks of this, faceswaplab has more features, am I missing something?
Thanks for the vid though!
wow..it worked like a charm... now I wonder if you can combine controlnet with it
Question: If I'm using a Lora in conjunction with Reactor, let's say an Oil Paint lora. The lora will make everything with an oil paint texture, buy the face swap will not have the oil texture effect, how do you tell reactor to include the lora effect? I'm guessing Img to img or control Net? Any chance you can create a tutorial? It's a question I personally get asked alot but have no solution for it.
It's a beast of a tool,and scary how good it is,newest version bring precision face masking option,so you can just tick the box faces are super clear even at highest resolutions.
With best photorealistic models for stable diffusion and correct prompting is super hard to saw a difference.
Even at crazy angles faces stay correct so you can just create same person again and again,without need for embeedings or LORA-s,it is just amazing,
Use IP-Adapter alongside Reactor/FSL for consistent characters
Nice - it works - thank you
nice video. any clues and hints for using comic characters? i want to use same face on my generated comic chars but the resluts are awful
thanks for all your great efforts, sebastian. how about a tutorial on how to use SD extensions Nextview and Reactor for face swapping video?
Great suggestion!
Thankyou for the video! I was using roop before now Im trying to learn reactor, I have one question, It doesnt show up in the upscaler the ¨4x_NMKD-siax_200k¨ what do i have to do to get it?
It's a standalone upscaler separately downloaded. I don't have the link anymore, you'd have to google it and place it in your /models/ESRGAN folder
This is definitely better than roop. Reactor works with all image unlike roop. I used to only get 60% detected rate with roop i got 100 with reactor. Thanks sebastian this is why im a subscriber!
I'm getting an error, it just doesn't do anything... what might be wrong?
Error running postprocess_image
I did install the c+++ tools, but only the ones required...
Im having the same problem :(
hi, what is the difference between Reactor and reactor force?
Hello. Reactor is not showing up in my web-ui window. It says the extension is installed, but ... I just don't have the menu options. Any ideas? I'm running Windows 11 and the latest Automatic1111.
Question though. I've already installed Studio 2022 for ROOP requirements. I'm guessing I don't have to do that again for this extension? Thanx!
Then you're all good!
@@sebastiankamph Yes, I installed the extension and everything works. Thank you for this video notification :)
thanks. roop was frustrating, if it thought there was mature content, sometimes just a guy's nipple showing it wouldn't work so this is great. I've got it installed and running while watching the video. Nice and easy. Thanks.
Great work! But how to use Reactor face swap by code? Since I am a software developer, I want to use it in my product.
I've got ReActor running in the terminal, but I'll be darned if I can't see the UI for it. after updating. Any ideas?
Try updating your a1111. Could be the culprit. Let me know
Turns out that was it. Is there a quick way to import over everything I have installed in an earlier version of a1111? @@sebastiankamph
Work with videos like roop? And with colab? Thx.
i have reactor the fast and simple faceswap extension v0.6.0 and i dont see enable check after you upload the picture that you want to change
Very interesting video. I have a small problem: Now I noticed a square around the face. What can I do to make it less visible?
Change vae or model
I found the cause. It was from the "Restore faces" option - codeformer. I will change the VAE to see if there is any change.@@sebastiankamph
I tried to install ReActor but it broke my A1111 - does this video address that issue?
Could y ou make us a tutorial of how to make multiple faces? Because I've been trying following your general guidelines here, but it's not really working out properly, either some faces change or none do, not all as I would hope (using face 1, face2 , face3)
The first face is 0 not 1 (1 would be face 2)
why is reactor not showing in my stable difussion? when following install?
I have this problem too, did you find any solution?
This is great, It's a feature I use all the time. Now I only get one result even when I change the parameters and I'm on random seed. Is that normal?
Yes, because you have Denoise set to 0, if you use a higher value the sample image will change
absolutely incredible.
Thank you always. I succeeded in changing my face through reactor, is there a way to change my outfit and hairstyle naturally?
Hi, these tools only change the face. I would inpaint the outfit and hair. See my inpainting guide.
@@sebastiankamphI actually need please make a video.we used any civit ai model and use unpainting to change clothes only not changing faces.
I added the reactor but it does not appear in the interface, what should I do?
Had the same problem "*** Error loading script", solved it by installing Insightface (google "reactor extension won't appear reddit" for detailed steps).
What should I do if, when generating images, a long fringe covering the eyes results in the forehead appearing darkened?
Thanks for the tutorial. A quick question: Having installed the extension and seeing it appear in the list, the main txt2img page does not load a ReActor section below ControlNet v1 and Seed. I've tried restarting and reloading the programme, but its not appearing. Any advice? Thanks!
Have you tried updating a1111?
Thanks for the reply. I'm running an auto-update command in the webui. The current a1111 version is v1.6.0. ReActor is also STATUS active v0.4.2. (Python 3.10.6, in case that is relevant).@@sebastiankamph
i ended up having to install "Desktop Development with C++" and following the troubleshooting at the bottom to get it running, same issue as you.
Check your console to see what the error is, mine was with the imageswap model, and so they have a section on what to do to fix it. but mine wouldnt fix without adding in that part of VS.
@@savros321 @sebastiankamph
I'm no expert at reading script, but as far as I can tell the error is 'No module named 'Insightface''. Any idea how I can fix that? Thanks again
I'm also seeing: ‘Insightface==0.7.3’ distribution not found
top !!! thank you mate !
hi bro , how can i get the Ruler in your Video ? i don't see it in my SD
Best option for windows and amd gpu user?
Hi , thank you for this ! but im on debian , how can i install for debian ?
im having problem. It says that Reactor is running but when I check txt2img, reactor is not there. What should I do?
*** Error loading script: reactor_swapper.py
Traceback (most recent call last):
File "D:\STABLE DIFFUSION\stable-diffusion-webui\modules\scripts.py", line 382, in load_scripts
script_module = script_loading.load_module(scriptfile.path)
File "D:\STABLE DIFFUSION\stable-diffusion-webui\modules\script_loading.py", line 10, in load_module
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "D:\STABLE DIFFUSION\stable-diffusion-webui\extensions\sd-webui-reactor\scripts
eactor_swapper.py", line 10, in
import insightface
ModuleNotFoundError: No module named 'insightface'
---
08:20:12 - ReActor - STATUS - Running v0.5.0-b1
same here! looks like we have to download the model, but I don't see where to find one, did you had any luck?
What if there is an object in front of the face that I would like to keep? like a hand for example.
Does it have trouble if your source face is straight on, but your target face is at an angle?
Does it work with ComfyUI?
I tried reactor and it always gives me cuda outofmemory, while roop works fine. reactor seems to take up 3gb vram, or am I doing something wrong?
can you make a good tutorial for Lineart to Color? your channel seems like the best but I can't find anything. Just outdated stuff with old control net.
Does it also use text prompts?
Thanks!
Awesome 🙂
If I'm putting denoising strength to 0 I'm getting the following error "UnboundLocalError: local variable 'h' referenced before assignment"
I get that sometimes and unfortunately I have no idea what the hell that means.
roop still has better results when you tick both boxes so it applies face before and after in rendering.
hopefully reactor get better and that option
reactor has this option as well
roop is very buggy
I have 2 separate Roop modules installed. How would it know to apply a face before and then after?
Reactor-Force, for video cards with 8Gb or more VRAM works faster. However, working with profiles of faces, and or anything approaching profiles does not work too well. Also, it is unclear how/where you put multiple replacement faces in the current interface. Thanks for the tutorial !
it is in the video but the git page has a better explanation. The faces are read from left to right, then top to bottom. starting as 0 and progressing.
The same goes for where the face is swapped too. If you want to swap multiple faces you input multiple numbers separated by ,'s ex 1,0,3 4,0,2. In my example the 2nd face in the picture would swap to the 5th. then the first to the first, then the 4th to the 3rd.
Does this do video or is Roop still king for easy video swaps?
i have low memory issue while face swapping how to maximize it?
It's working exactly like roop uncensored, how is this better?
Hi i love your videos!, I am having a little trouble , I have installed ReActor but its not showing on my img to img tab?! please help.
I installed ReActor but the dropdown isn't appearing in the auto1111, anyone else have the same problem? Restarted etc a few times just in case.
Mona lisa was 44. Thats an awesome information to make a video dating people in old historic paints.
Yeah, pretty sweet feature if only for fun right now.
i get these errors...
ReActor preheating... Error: The 'onnxruntime-gpu' distribution was not found and is required by the application
Device: CUDA
Error: The 'insightface==0.7.3' distribution was not found and is required by the application
Error: The 'onnx>=1.14.0' distribution was not found and is required by the application
are you running pip 22.2.1 or 23.3.1
hi all, how do i install insightface through webui? i dont have the pip or python exe and i cant use reactor :0
i followed install instructions but Reactor is not appearing in SD ... any help ?
Great new content! Thanks, can't wait to try this. 👨↔️🧔
Hope you enjoy it! Let me know how it works out for you
y for me not sowing enable option please guide me
it look like as of 10/17/23 today A1111 now can install ReActor directly from the Extensions tab
Are there updates in your patreon? im coming across alot of missing modules that i have to download through cmd. Its not playing nice with reactorRT? maybe thats the issue disable that for now>?
Can u show us the comparison of reactor upscaler
the "enable" check box isn't show up, how to fix it ?
Unfortunately with all these face swappers, they are all still "bottlenecked" since they all are using inswapper128, which is 128x128 training data only. Any larger models are yet to be seen since the original project was stopped.
Inswapper128 is fine for the general facial look, but loras are still the way for very specific facial/skin features.
so how do we fix that?
@@iamxenobyteuse simswap
@@user-dn8td2cq1j simswap outputs higher quality but the result is shittier and barely looks like the input face. Experimented with that one a lot but didn't like it as inswapper_128
@@eyoo369 true, insight face inswapper is really the best. The team behind that model are some mathematics geniuses. Sadly they'll never open source their newer models, i wouldn't have either if i could make money using it, so i don't blame them.
Yup. I have been using Reactor for a while now and it worked perfectly fine with 1.0/1.5, but as soon as I try to use it with SDXL it's horrible. The faces are super ugly and no matter the settings I just can't get it right.
A bit of help please. I did the guide and installed it (a1111) and in cmd it shows status running but its not on the interface and can't find it to show up.
Make sure your a1111 is updated and also restart everything
@@sebastiankamph Will try, thank you
can you use this with inpainting as well?
Yes! I tried it and it works. Might need to paint a slightly larger area though for it to detect the face. Let me know how it works out for you.
just used it and it works pretty well, better than roop for sure@@sebastiankamph
this tool is frightening. Great tutorial
Thank you! Use responsibly 🌟
absolutely. It's just crazy how it gets everything right down to even the overall colour of the image and even the age detection is scary close @@sebastiankamph
my reactor Running v0.7.0-b7 on Device, but no "ENABLE BOX"?
Is it just for images? How to do the same with video?
Extract frames from your video, swap them as a batch and then combine them together
I did everything you did and it says ModuleNotFoundError: No module named 'insightface' Any tips?
Try opening cmd and type 'pip install insightface'
@@sebastiankamph Didn't work and at this point I wonder how to uninstall the attempt because it slows down start up times 10X.
Hello, Sebastian,
by any chance do you know how to solve this error, using SD with Reactor, when it is about to swap faces I get and error:
2024-03-03 20:53:09.0077300 [E:onnxruntime:, sequential_executor.cc:514 onnxruntime::ExecuteKernel] Non-zero status code returned while running Gemm node. Name:'Gemm_568' Status Message: CUDA error cudaErrorNoKernelImageForDevice:no kernel image is available for execution on the device
(My settings GPU Nvidia GeForce 960m, 4gb VRAM newest drivers, Cuda 11.8)
Hi, I ran into a bit of a hick-up that I hope you can help me with. The Reactor face swap downloaded correctly. I think. It shows up in the terminal as running. But it dose not appear on my SD UI. As it did in your tutorial. Is there a check box in settings that needs to be checked to make it show up on my UI. I hope you can help. I really have learnt a lot from your TH-cam cannel. Oh yes I did restart Stable Diffusion to see if that would help. Unfortunately it did no appear. Here's a couple of DAD jokes as a thank you. I hope you have not used them. 1. I used to play piano by ear, but now I use my hands. 2. How do you organize a space party? You "planet"!
I have the same issue after installing reactor. I think there is an installation bug right now. Does anyone know of a fix?
I'm glad you had the same unfortunate installation problem as I did. Being new to ai art I thought I had done something wrong. Lets hope someone can assist us. Its such a simple and effective face swap I can't wait to use it .@@MrPlasmo
@@59aml found the working fix until they fix the install- do this and it works (thx to mudman13):
Have you done this?
Close (stop) your SD WebUI Server if it's running
Download and put prebuilt Insightface package into the stable-diffusion-webui (or SD.Next) root folder (where you have "webui-user.bat" file)
From stable-diffusion-webui (or SD.Next) root folder run CMD and .\venv\Scripts\activate
Then update your PIP: python -m pip install -U pip
Then install Insightface: pip install insightface-0.7.3-cp310-cp310-win_amd64.whl
Enjoy!
Oh no the soda joke got me at work lol
At least it brightened your day at work, eh? 😁
@@sebastiankamph Definitely :)
top top as always seabass..
Thank you kindly! 😊🚀. Rate today's joke 1-10
it still use 128X128 model like roop. not all the time the upscaling keep the face right.
how does it work for video?
I'm trying to swap a face in image , but it gives me the same image why ?
Error loading script: reactor_version.py , ModuleNotFoundError: No module named 'insightface' same problem with roop... visual studio is running.
Reactor, Roop, Facefusion whatever you want to call it, it is exactly the same... they are all using inswapper128 which is for 128x128px images.