I'm so happy that vbridger supports webcams now! I've been wanting to use it for over a year but because I don't have an iPhone I never had the opportunity. I'm glad that those of us who just use a webcam can get a new major upgrade to our tracking and I can finally start rigging models with vbriger parameters (more work yes but I'm excited)
Definitely exciting!! Just bear in mind some of the parameters don't work with mediapipe (notably the jaw) so you may not be able to use the full scope of parameters! Have fun rigging! ^^
Thank you so much for this video. I chose to use a 3D model originally because the ONLY mocap that worked with my glasses is for vrm models. Its really nice to hear that there's improvements for people who need glasses.
That does look a lot better with the mouth shape and speaking, the webcam rtx I mean. I use a 3d model, because 2d never quite captured facial expressions, save for those who spent thousands of dollars on model rigging and tracking software. I'm happy to see 2d taking steps forward, I think facial expressiveness is a big make or break for making models that are relatable to the audience. Maybe in another couple years we'll have good enough tracking to trigger enhanced expressions (like the anger vein) without toggles... Thank you for covering this topic!
Actually there is a way to do an angry face (so for example an anger vein) without a toggle but it requires the iphone tracking ~ but perhaps someday for webcam!
This is so exciting, thank you for the video or else I wouldn't have known about it!! Would webcam also support cheek puff/tongue etc.? I will definitely look into all of this though, Vbridger is just such a nicer look
I have an iphone, a couple actually as I keep the old ones when I upgrade my main phone, so I'll just keep using that for now. This is a great update though.
I don't know what happens, but the model in vbridger never starts moving. Only once did I succeed and then all attempts failed and the capture only happens if I start the camera directly in the VTS ^^
@@CutieDragon mediapipe. after the last update, it's started to work but only for mouth parameters like funnel, shrug... maybe i'll wait some days to test again ^^
@@oromihasu What I did to solve it was click on Load, on the bridgit option (it's right above the model) and then select the VBridger_VTS_Compatible file. In my case, the model worked better because it was detecting movements, but for some reason was not detecting the mouth open/mouth form parameters. I hope this can help you.
Double check what camera vbridger is connected to in the settings! I've had it try connect to a virtual webcam by accident before which caused it to not work! (Settings > Camera settings) Also on the vtubestudio side, you'll need to make sure to turn on API support in the VTubeStudio settings! (it's not on my default so it's worth a check!)
How do I even use the iphone for face tracking? To me it feels like it will overheat the phone in longer streams? I mean, do you put the iphpne on a rig in front of your face? When researching, I only see the setup over the phone (software) but not in irl etc.
HUH I somehow thought vbridger was only for teeth implementations and since I don't need that, I didn't even consider this... So how does that work, do I make all the settings in vbridger instead and leave the vtube studio settings untouched? Like, it seems like some of the settings are in both programs, so would it lead to problems if you tweak around on both ends? I am kinda scared to change anything in my vtube studio settings, it took so long to get it right and I am afraid of messing it up if I install something extra 😅 Maybe it's possible to import the model a second time into vtube studio and try setting it up with vbridger freshly?
You're fine to not touch the settings in vbridger and/or vtubestudio - what really matters is to stay aware of where you've made changes! You can save a duplicate version of your model (with a different name, maybe add 'test version' or something along those lines) and import it into vtubestudio too if that makes you more comfortable!
@@CutieDragon Thank you! I am surprised there aren't really good tutorials of how to add vbridger to vts, or maybe I am searching wrong. but I'll try and figure it out!
Imagine how much money a webcam that is specifically made to track for avatars. Like a camera that cannot record video and just gives face data through some other sensors.
@@CutieDragonhmmm I wonder if I can use an Intel 515 real sense for this. Not sure I would buy one just for tracking given the $600 pricetag though. 😅
I decided to get the program but my vtube model isn't responding to my movements very well.. Her face is giving a sad expression and the eyebrows refuse to really move, the mouth also doesn't open or close at all... I am wondering, does the Vtube model need to be rigged for this program to work ? Is that maybe why?
So the one I'm using in the video is one of the cheapest webcams out there (it's 720p not even full HD!), I tend to find the tracking is better with any webcam that's full HD - 1080p quality so I'd look around for anything that is that quality or above if possible!
It really depends on the game ~ I haven't noticed any drops in most of the games I've tested, the only one I've noticed a little bit of struggle with is Apex Legends (which is already poorly optimized!) and I'm also running a 3060!
Has anyone even tried the NVIDIA tracker with a AMD graphics card? As there are AMD equivalents to RTX cards so the issue of quality should not really matter in those cases. But i don't know if it was just programmed to only work for NVIDIA cards or any card that is strong enough, there are a lot of things in life that people can will only work for one thing but if no one actually ever tries to limit test one would not know
For some reason, On Vbridger the models Eyes wont close which causes my Model on Vtuber studio to not close its eyes either. any idea on how to fix that?
I'm really at a loss how to connect everything... is there any way you could make a tutorial on it? I can't even find that... can I use vts app on the phone to capture the face or do I need to use a different one? T.T
I can make a video on doing the full setup soon! For iPhone you'll need either ifacialmocap or facemotion3D (both available on the app store), I personally use ifacialmocap. Next up you'll need to make sure the IP matches on both vbridger and the app you chose (it will show the local IP on both apps), click connect and it should work!
@@CutieDragon thank you so much for the reply. I got confused because there's also an option to select vtube studio as the capture method. You're an absolute gem! I'll give it a try
you can also use the vtubestudio app as a capture method through the ios app too BUT it's a lot more drain on the battery of the device so I generally don't recommend that option! Wishing you the very best with vtubing! @@CalleighSpencer
I can't figure out how to get Vbridger to work, or what I'm supposed to do to use it properly alongside VTS. I can't change ANY settings in Vbridger. Uncheck boxes, change smoothness bar, etc. Nothing works and I don't get how I'm supposed to work this and not destroy all my VTS settings. Plus, how do I even add these new Vbridger params into VTS? Or does my model have to have them already?
For the new params you'll need to have those rigged into the model in live2D! What tracking type are you using with vbridger (ifacialmocap, media pipe, Nvidia, etc), vbridger should let you tweak things once tracking has started
I have a problem 😭 with the cam (mediapipe) the mouth works great but not the eyes at all, it doesnt open/close as much as with the vtube studio tracking, same with my eyebrows. Is there anyone who could help me?
hello there! I was having the same problem. just try to play around with EyeOpen L and R Output Curves on Vbridger until you get a better tracking (that's the best help I can get you lol sorry) same with eyebrows, although I didn't have to configure them
it's really up to you whether it's worth it or not! But I've found the vbridger tracking is a tad more accurate than the base version ~ but a lot can be done through just rigging the model well!
I have an Iphone but it does not even work now with ifacialmocap or facemotion3d i dont know why, i have the right ip adress and i loaded the right thing but the model wont moove (and both my computer and phone are connected to wifi) can someone help me please ? ToT Ty
Is it the vbridger model not moving? I'd try manually setting the port in both vbridger and ifacialmocap settings (the number should also match!) And see if that works. I ran into an issue with the programs thinking a port was already being occupied before so it's a possibility
Hello, ty for video but i have som problems can u hellp me pls. He gives me this error when I try to turn on nvidia tracking (The GPU is not supported). Can you explain why. Maybe I need to reinstall the driver?
My problem is: my windows 11 and my iPhone don’t connect. I can’t download iTunes to make it work. It’s so annoying. I don’t know if I want to spend 70 euros for a webcam 🙄
I'm going insane trying to figure out why I can't check/uncheck on the output modifiers (Delay, Smoothing, Steps and the + plus button) They're greyed out and don't react to clicking on them. I've been searching for hours but no one else seems to have the same problem. Am I just really silly and missed a step? TIA
Just something to check there's the 'Outputs' menu on the top right, do the modifiers become available after you click on any of the options on there? (you might also need to tick the box next to the modifier after that)
make sure you click 'connect' on the bottom right and make sure that you have api plugins enabled in vtubestudio! it will popup to ask to allow vbridger if it's your first time using it
Don't know if you found the answer but I just did tonight. You cannot use your camera in VTS at the same time as Vbridger. Vbridger will take over as the main tracking camera instead of VTS. The issue that I'm having is that it's laggy and it transfers that on the model. But also be sure to adjust your settings in Vbridger (top left gear) and change your camera settings to either 30 or 60 FPS (it defaults to 5 FPS for some reason when starting off...)
![[VBridger] Live2D/VTubeStudio Complex Mouth Tutorial](http://i.ytimg.com/vi/h6p8wUtFWYY/mqdefault.jpg)
I'm so happy that vbridger supports webcams now! I've been wanting to use it for over a year but because I don't have an iPhone I never had the opportunity. I'm glad that those of us who just use a webcam can get a new major upgrade to our tracking and I can finally start rigging models with vbriger parameters (more work yes but I'm excited)
Definitely exciting!! Just bear in mind some of the parameters don't work with mediapipe (notably the jaw) so you may not be able to use the full scope of parameters! Have fun rigging! ^^
Wow ya that’s so great it works with webcams. I may have to get a decent camera because the built in one on my laptop isn’t that good
Thank you so much for this video. I chose to use a 3D model originally because the ONLY mocap that worked with my glasses is for vrm models. Its really nice to hear that there's improvements for people who need glasses.
That does look a lot better with the mouth shape and speaking, the webcam rtx I mean. I use a 3d model, because 2d never quite captured facial expressions, save for those who spent thousands of dollars on model rigging and tracking software. I'm happy to see 2d taking steps forward, I think facial expressiveness is a big make or break for making models that are relatable to the audience. Maybe in another couple years we'll have good enough tracking to trigger enhanced expressions (like the anger vein) without toggles... Thank you for covering this topic!
Actually there is a way to do an angry face (so for example an anger vein) without a toggle but it requires the iphone tracking ~ but perhaps someday for webcam!
Noting that I've seen disabling low light compensation in webcams can remove that Nvidia jitter without having to tinker around with the smoothness.
Really appreciate this, I'm still having a few issues but I'm getting the hang of it. Godspeed :D
Thanks for the efforts!
This is so exciting, thank you for the video or else I wouldn't have known about it!!
Would webcam also support cheek puff/tongue etc.? I will definitely look into all of this though, Vbridger is just such a nicer look
sadly the webcam trackers don't support cheek puff or tongue (yet)!
@@CutieDragon That's good to know, thank you for replying! There is hopee but even without it, vbridger seems like it could improve overall tracking
I have an iphone, a couple actually as I keep the old ones when I upgrade my main phone, so I'll just keep using that for now. This is a great update though.
I don't know what happens, but the model in vbridger never starts moving. Only once did I succeed and then all attempts failed and the capture only happens if I start the camera directly in the VTS ^^
Which tracking type are you using? It might be the tracker isn't starting properly through vbridger perhaps
@@CutieDragon mediapipe. after the last update, it's started to work but only for mouth parameters like funnel, shrug... maybe i'll wait some days to test again ^^
alrighty! At least it's getting there! I imagine the program might have some issues to work out after a big update!@@rachijuuni
I'm having the same issue ;; just downloaded it today, and I have no signs of movement
@@oromihasu What I did to solve it was click on Load, on the bridgit option (it's right above the model) and then select the VBridger_VTS_Compatible file. In my case, the model worked better because it was detecting movements, but for some reason was not detecting the mouth open/mouth form parameters. I hope this can help you.
my glasses are extremely reflective so i have to take them off when I use my model :( but this is really good info thank you for making content!
It's moments like these where I regret that I didn't take the "anti-reflection" option for $200 more when I got my glasses 🤣might be worth upgrading!
My vbridger face is moving like crazy..someone help me here lmao
Its twitching, the mouth does not even pout, everything is twitchinggggg🥲
Same
No matter what i do it won't move or connect to vtube studio (trying media pipe). My webcam works well so I don't know what the issue is.
Double check what camera vbridger is connected to in the settings! I've had it try connect to a virtual webcam by accident before which caused it to not work! (Settings > Camera settings)
Also on the vtubestudio side, you'll need to make sure to turn on API support in the VTubeStudio settings! (it's not on my default so it's worth a check!)
How do I even use the iphone for face tracking? To me it feels like it will overheat the phone in longer streams?
I mean, do you put the iphpne on a rig in front of your face?
When researching, I only see the setup over the phone (software) but not in irl etc.
HUH I somehow thought vbridger was only for teeth implementations and since I don't need that, I didn't even consider this...
So how does that work, do I make all the settings in vbridger instead and leave the vtube studio settings untouched? Like, it seems like some of the settings are in both programs, so would it lead to problems if you tweak around on both ends?
I am kinda scared to change anything in my vtube studio settings, it took so long to get it right and I am afraid of messing it up if I install something extra 😅
Maybe it's possible to import the model a second time into vtube studio and try setting it up with vbridger freshly?
You're fine to not touch the settings in vbridger and/or vtubestudio - what really matters is to stay aware of where you've made changes!
You can save a duplicate version of your model (with a different name, maybe add 'test version' or something along those lines) and import it into vtubestudio too if that makes you more comfortable!
@@CutieDragon Thank you!
I am surprised there aren't really good tutorials of how to add vbridger to vts, or maybe I am searching wrong. but I'll try and figure it out!
Imagine how much money a webcam that is specifically made to track for avatars. Like a camera that cannot record video and just gives face data through some other sensors.
we already have Tobii Eye Tracker and Leap Motion for hands, those already are really expensive
@@lepurplecl0ud did the Tobin track your face for vtube also?
I imagine it'd function much like the iphone camera - it'd be neat to have the LiDAR technology on a webcam but I don't think it's quite a thing yet
@@CutieDragonhmmm I wonder if I can use an Intel 515 real sense for this. Not sure I would buy one just for tracking given the $600 pricetag though. 😅
I decided to get the program but my vtube model isn't responding to my movements very well.. Her face is giving a sad expression and the eyebrows refuse to really move, the mouth also doesn't open or close at all... I am wondering, does the Vtube model need to be rigged for this program to work ? Is that maybe why?
Which Webcam do u recommend to buy? Like Which one do u use that's good I also wanna start vtubing and have glasses so I need a good webcam
So the one I'm using in the video is one of the cheapest webcams out there (it's 720p not even full HD!), I tend to find the tracking is better with any webcam that's full HD - 1080p quality so I'd look around for anything that is that quality or above if possible!
I'd like to ask, when you use the nvidia tracking, i have an rtx 3060, so would it cause frame drops in my games as well?
It really depends on the game ~ I haven't noticed any drops in most of the games I've tested, the only one I've noticed a little bit of struggle with is Apex Legends (which is already poorly optimized!) and I'm also running a 3060!
Which of these cams are better for this tho:
Razer Kiyo Pro
Logitech StreamCam
Elgato Facecam
Or others?
I use the logitech personally, but to be honest as long as the webcam is 1080p 30fps then the performance will be similar!
@@CutieDragon I see, thank you.
I might save a little bit and invest in a iphone honestly, it's too smooth.
So if i am using Vbridger to help lip sync via detecting my microphone, do I still keep 'Use Microphone' and advanced lip sync enabled on VTube Studio
Does this support tongues too? thro the rtx tracking?
I was wondering the same thing, would be nice if it did. Is a shame not being able to use the model fully cause no iphone
also any tips on monitors? I want a 2 monitor setup 1 horizontal and 1 vertical like should I go with two 27 inch monitors or maybe 24 inch Idk
Depends on your space and preference! I personally only use two 22inch monitors since my space is relatively small!
I've had good luck with Logitech hardware.
Has anyone even tried the NVIDIA tracker with a AMD graphics card? As there are AMD equivalents to RTX cards so the issue of quality should not really matter in those cases. But i don't know if it was just programmed to only work for NVIDIA cards or any card that is strong enough, there are a lot of things in life that people can will only work for one thing but if no one actually ever tries to limit test one would not know
would any webcam work with this? i kinda don't really want to upgrade mine.. (even though i should since i've had it for quite a while) 😅
any webcam!
So glad i buy it last time
For some reason, On Vbridger the models Eyes wont close which causes my Model on Vtuber studio to not close its eyes either. any idea on how to fix that?
I'm really at a loss how to connect everything... is there any way you could make a tutorial on it? I can't even find that... can I use vts app on the phone to capture the face or do I need to use a different one? T.T
I can make a video on doing the full setup soon! For iPhone you'll need either ifacialmocap or facemotion3D (both available on the app store), I personally use ifacialmocap. Next up you'll need to make sure the IP matches on both vbridger and the app you chose (it will show the local IP on both apps), click connect and it should work!
@@CutieDragon thank you so much for the reply. I got confused because there's also an option to select vtube studio as the capture method. You're an absolute gem! I'll give it a try
you can also use the vtubestudio app as a capture method through the ios app too BUT it's a lot more drain on the battery of the device so I generally don't recommend that option!
Wishing you the very best with vtubing! @@CalleighSpencer
thank you so much for helping. this is so valuable @@CutieDragon
I can't figure out how to get Vbridger to work, or what I'm supposed to do to use it properly alongside VTS.
I can't change ANY settings in Vbridger. Uncheck boxes, change smoothness bar, etc. Nothing works and I don't get how I'm supposed to work this and not destroy all my VTS settings. Plus, how do I even add these new Vbridger params into VTS? Or does my model have to have them already?
For the new params you'll need to have those rigged into the model in live2D!
What tracking type are you using with vbridger (ifacialmocap, media pipe, Nvidia, etc), vbridger should let you tweak things once tracking has started
Can anyone give me some advice about webcams? The price is very affordable.
What's your budget? I might be able to suggest a few!
i loaded the mic input thing to test it out but i dont like it and cant figure out how to now unload it T-T please help
You'll need to 'Load' the other settings file (the default one is just the arkit file)
YIPPE!!! HEck yeah!!!!!
I have a problem 😭 with the cam (mediapipe) the mouth works great but not the eyes at all, it doesnt open/close as much as with the vtube studio tracking, same with my eyebrows. Is there anyone who could help me?
hello there! I was having the same problem. just try to play around with EyeOpen L and R Output Curves on Vbridger until you get a better tracking (that's the best help I can get you lol sorry)
same with eyebrows, although I didn't have to configure them
exactly this! You can also mess around with the parameter inputs in VTubestudio too @@lepurplecl0ud
thank you!!!@@lepurplecl0ud
I have an RTX graphics card and a webcam. Would buying vbrigder add better movement to my vtuber? Or is the expense not worth it?
it's really up to you whether it's worth it or not! But I've found the vbridger tracking is a tad more accurate than the base version ~ but a lot can be done through just rigging the model well!
❤
This is Good 👍
Georgiana Manors
Thanks for video I do hope you were using a vpn as when you show type it shows your ip address in bar
Thank you for the concern but that's just my internal IP! (tldr; the internal IP is only useful to the router!)
@CutieDragon that's good news
Recently my Vtube studio stopped tracking properly. Like, it just freezes, and stopped tracking properly. How do I fix this? Does this fix it?
i bought vbridger but cannot get it to move on my PC >.< all the settings are correct as well
Are you using media pipe or nividia?
I have an Iphone but it does not even work now with ifacialmocap or facemotion3d i dont know why, i have the right ip adress and i loaded the right thing but the model wont moove (and both my computer and phone are connected to wifi) can someone help me please ? ToT Ty
Is it the vbridger model not moving? I'd try manually setting the port in both vbridger and ifacialmocap settings (the number should also match!) And see if that works. I ran into an issue with the programs thinking a port was already being occupied before so it's a possibility
@@CutieDragon i realised that it was because of my wifi, it's a campus wifi :c so it cant work (it's about the ip adress) sadly
Hello, ty for video but i have som problems can u hellp me pls. He gives me this error when I try to turn on nvidia tracking (The GPU is not supported). Can you explain why. Maybe I need to reinstall the driver?
Which GPU do you have in your PC Rig? To use the Nvidia Tracking you'll need to RTX graphics card!
@@CutieDragon oh okay i see now why its not working ty bb. i have 2 NVIDIA GeForce GTX 1650 Ti and Intel(R) UHD Graphics
Yeah sadly Nvidia won't work on that rig! mediapipe is still an option though!@@xamaihannax
My problem is: my windows 11 and my iPhone don’t connect. I can’t download iTunes to make it work. It’s so annoying. I don’t know if I want to spend 70 euros for a webcam 🙄
I had to download ITunes which helped sync the too and if you connect the to by USB that is better.
@@MGDHati but windows 11 doesn’t even want to download iTunes. It’s just not downloading. That’s the crazy part.
does vbridger work with animaze?
I tried to connect using mediapipe and nothing is happening! Nooooo!
I'm going insane trying to figure out why I can't check/uncheck on the output modifiers (Delay, Smoothing, Steps and the + plus button)
They're greyed out and don't react to clicking on them. I've been searching for hours but no one else seems to have the same problem. Am I just really silly and missed a step? TIA
Just something to check there's the 'Outputs' menu on the top right, do the modifiers become available after you click on any of the options on there? (you might also need to tick the box next to the modifier after that)
@@CutieDragon shdgdgsj that was it! I WAS silly!
Thank you so much!!!
No worries!! (I had the exact same issue when I started poking the new update xD) @@partypieart
How do I connect the VBridger to Vtube studio tho?? please??
wen I connect vbridger to vts it track my face with my web cam, but the model in VTS dose not move?
make sure you click 'connect' on the bottom right and make sure that you have api plugins enabled in vtubestudio! it will popup to ask to allow vbridger if it's your first time using it
I can’t frown?
Clark David Young Frank Williams Steven
does this work with laptop webcams?
Yep! Any webcam!
@@CutieDragon :OO thank you!! I might get my hands on Vbridger soon
can this make it so it can track tongues as well?
Sadly not with webcams (yet), tongue tracking is still iphone exclusive
I'm trying to get this to work but Vbridger comes out with an ErrorCode 10048 and I have no idea what that means
Oo not sure about that one, VBridger has a troubleshooting channel in the discord that might help! discord.gg/xEXvVbXWPa
@@CutieDragon Thank you CutieDragon! I have watched a few of your rigging tutorials in the past, and they greatly helped. Thank you
Don't know if you found the answer but I just did tonight. You cannot use your camera in VTS at the same time as Vbridger. Vbridger will take over as the main tracking camera instead of VTS.
The issue that I'm having is that it's laggy and it transfers that on the model. But also be sure to adjust your settings in Vbridger (top left gear) and change your camera settings to either 30 or 60 FPS (it defaults to 5 FPS for some reason when starting off...)
If I was a VTuber I wouldn’t be serene knowing that A webcam is connected to the pc I use for streaming.
steam is garbage...would never create account..
Absolutely brain damaged take
👌👍