This is the only video that is actually straight forward and easy to follow on blender to vtuber lol not even exaggerating (assuming you have basic blender knowledge already). Everyone elses video are either too long and/or have unnecessary info. 10/10
just call me goldilocks! half of the arkit tutorials ive seen have way TOO MUCH detail to the point that it becomes confusing... the other half of the arkit tutorials ive seen dont have nearly enough detail, they miss steps, or they assume that you know things you dont, brrrrr..... but this one? this arkit tutorial was juuuuust riiiiiiight... thumbs up!
Im rly late on this since this comment is a yr old but p sure webcams work as an alternative would just be diff from the setup shown here (for anybody whos watching this for the first time & also had this issue)
This is the fastest most comprehensive tutorial I've found on the subject and is exactly what I need. Thank you so much! Soon... Very soon. I'll be taking commission for characters. I'm going to start pumping out high quality models :3
I haven't seen such good face tracking in VeeSeeFace before. Even without ignoring the shaky eyelids it was very good. I also like the shaders you linked. They're much better than the ones that I had in Unity when I was looking into this stuff.
Poiyomi is very commonly used in VRChat for models, so it works great for any Unity based project! Very flexible with lots of options, and the shader locking system eliminates unused parts of the code base.
funny.. easy to understand.. fast passe (i can slow it down if needed).. very nice work.. and it answered questions i was looking the answer for, for hours before giving up and finding this.. 10/10
u totally know one will puase your video a thousand times, so u didn't wasted time, now i know how to blender to vroid, i enjoyed the humor 11 out 10 video
if you wanna speedrun it even more (assuming you have maya) advanced skeleton is a whole ass life saver, automatically does all the blendshape work for you! and if it doesn't end up looking exactly how you want it you can go in and edit the blendshapes ez
Him: repeat it for 52 times Me: OK i'll have to do it once it's not so hard Him: now another 24 repetition operation good luck Me: well... i'm strong i can do it Him: now buy an iphone ^^ Me: * breaks down, breaks my laptop in half *
I'm pretty sure you can just use a webcam. I haven't tried it yet because I'm only just getting into it, but the website for VSeeFace doesn't say anything about needing an iphone.
That was... surprisingly fun to watch, you should definitely make more Videos in the Future. But either talk a little bit less between steps or slow down some, I felt like I was watching this Video on 1.5 Speed ;D
You can also use NEB (not enough blendshapes) its a plugin for unity that does everything manually, you just have to transfer the blendshapes from a model that already has them (and its provided) using the plugin (its really easy) and then u just export your model and it will be ARKit ready, but remember to actually edit how the blendshapes deform the mesh (you can do that by adjusting some sliders)
0:41 Alright... I made it until this point. But, how do I save the expressions I just made? Do anyone know a good tutorial? Both for Blender and for the expression part.
I hate and love this quirky tutorial at the same time. I've never used blender and Unity, and this is the equivalent of a football player kicking a baby bird out of the mother's nest. What a challenge and opportunity for growth.
Hi Dani, I've just seen your portfolio and it's very beautiful. Would you mind sharing any tips for rendering a character? Do you render in Blender or Unity? And what about the lighting?
I've tried newer and older versions of the VRM and Unity packages and I successfully made a model with tracking and expressions a year ago, but with my latest export I'm not getting the Blendshapes script on the VRM. Anyone have a clue where to start troubleshooting?
A great tut, however i cant export to VSF Validation.cs(53,13): error CS0103: The name 'Extended' does not exist in the current context Error building Player because script had compiler errors
tho i'm a total newbie and downloaded blender for this video, getting stuck on 0.20 seconds was not something I expected xd how do i use multiple windows i did horizontal split but it only duplicated the model
It's G! You need to click/select the vertex and then use G to move whatever you clicked. You can scroll in and out to make the movement bigger or smaller so you don't end up warping the whole head
Thank you so much for the tutorial! I was wondering, how do you make your selections/moves in edit mode like that with the radius circle? It looks like pinch sculpting.
It’s proportional editing using the edit mode. Basically turn on proportional editing somewhere on the top of the screen, grab a vertex, and while you’ee dragging the vertex around, scroll on the scrollwheel until the circle is small enough to only affect what you need to affect
@@nilepereiraa ok cool, yea i figured it out, thanks! I was just wondering because in ur video it looks like u almost skip the part where u have to select a vertex first, mine always light up before the circle pops up
@ Select the object that you want to edit in object mode then go to edit mode select a vertex in an area you want to start from with the move tool enabled and proportional editing enabled with connected only checked or unchecked in your proportional editing options depending on what you want. Then when you go to drag around/move the vertex scroll up or down to change how much you want to influence on the model with the pull in real time.
Hey, Thanks so much for this tutorial! It was very well explained and simple to follow! I ended up exporting it as VRM at the end because VSF didn't work out for me xD
I noticed the update about being able to use a normal webcam, so I got excited.... then I realised this part... "A software that enables face tracking with a machine equipped with NVIDIA's RTX series GPU " GODDDAMNNN IT! 🤣🤣
this video is great except two things, i dont know unity and get and error for what wasnt shown (locking material for export) and you need unity 2019.4.31f1 so i hope someone reads this before they download a later version of unity else the will alot of work for nothing, then have to download the right unity....................... cuz i already had a version of unity for vrchat p.s i found out that that version of unity doesn't work with the latest unity hub, you have to download an older version before 3.0.0
I've been using this for nearly a year now, but one thing really bothers me that I don't see from pretty much everyone else. Every 30 seconds to 2 minutes, my tracking will freeze for a few seconds before returning to normal. My performance graph shows that received data while using these programs drops to zero when the freeze happens. So far, I haven't found any solution to this problem. Have any ideas why this happens? I am using 5Ghz wifi My reception is good My CPU usage is under 70% while using OBS, Discord, and gaming at the same time. This will happen even when no other software is open. It also happens when using a different iPhone and a different computer of similar performance. I don't get it.
Do you know if the Faceit blender addon for automatically generating ARKit expressions will work on MMD models like Lumine? Manually editing the mesh to create expressions is not very beginner friendly and is a subject that probably deserves its own video.
this is gonna sound dumb but does this work for models that have rigify rigs? i don't know if i want to convert my rigifiy model to a regular model lol...
Apologies Mr Dani but sadly my own vseeface isnt really capturing the tracking, ifacialmocap shows green that it connects to my pc and Ive done the Inbound rule for vseeface but the model on vseeface is still stiff but the ifacialmocap is capturing all my expressions
The cel shading can break when certain blendshapes are active (especially in the mouth area), and legacy blendshapes tends to smooth it out for my cel shaded workflow. It's one of those 'I don't know why it works but I'll just continue doing it' rituals.
is it possible to do custom additional blendshapes and add them to the kit? Also, is it possible to do the face tracking with something other than iphones
"No one gets into ventriloquism for the adrenaline." - I absolutely lost it here lol. subbed.
This is the only video that is actually straight forward and easy to follow on blender to vtuber lol not even exaggerating (assuming you have basic blender knowledge already). Everyone elses video are either too long and/or have unnecessary info. 10/10
just call me goldilocks!
half of the arkit tutorials ive seen have way TOO MUCH detail to the point that it becomes confusing...
the other half of the arkit tutorials ive seen dont have nearly enough detail, they miss steps, or they assume that you know things you dont, brrrrr.....
but this one? this arkit tutorial was juuuuust riiiiiiight...
thumbs up!
So, you did it and it works?
starts slowly making progress on her model, feels proud of the hard work
"now buy an iphone"
goes back to bed and cries to sleep
Im rly late on this since this comment is a yr old but p sure webcams work as an alternative would just be diff from the setup shown here (for anybody whos watching this for the first time & also had this issue)
This is the fastest most comprehensive tutorial I've found on the subject and is exactly what I need. Thank you so much! Soon... Very soon. I'll be taking commission for characters. I'm going to start pumping out high quality models :3
This is actually amazing! Great tutorial, loved it!! :D
Please make more videos if you have any ideas, I loved this tutorial, funny, fast and on point.
This is so fun to watch and goes straight to the point!
TY for the headers as i was lost about how to make the extra 52 Blendshapes!
Amazing tutorial. quick- to the point- informative- AND got a good sense of humor.
This by far has been so helpful Imma try to do my faceshapes today !
I haven't seen such good face tracking in VeeSeeFace before. Even without ignoring the shaky eyelids it was very good. I also like the shaders you linked. They're much better than the ones that I had in Unity when I was looking into this stuff.
Poiyomi is very commonly used in VRChat for models, so it works great for any Unity based project! Very flexible with lots of options, and the shader locking system eliminates unused parts of the code base.
Perfect tutorial! It wasn't bloated, it was entertaining and it clearly explained what needed to be done.
You’re absolutely hilarious, please upload more, you earned my subscription!
simple and fast tutorial, need more tutorials like this!!!!
This is the best tutorial. You're a riot! insta sub
This is by far the best tutorial I've come across
funny.. easy to understand.. fast passe (i can slow it down if needed).. very nice work.. and it answered questions i was looking the answer for, for hours before giving up and finding this.. 10/10
This video is incredible and you are the best!
u totally know one will puase your video a thousand times, so u didn't wasted time, now i know how to blender to vroid, i enjoyed the humor 11 out 10 video
its funny to me that this is the only video you have on your channel and its a 10/10 banger
you were so fast, I knew you reminded me of Ian Hubert 😂succinct, informative tutorial!
if you wanna speedrun it even more (assuming you have maya) advanced skeleton is a whole ass life saver, automatically does all the blendshape work for you! and if it doesn't end up looking exactly how you want it you can go in and edit the blendshapes ez
whats maya?
thank you!
What a legend, thank a lot for sharing this bro, this is exactly what i need!!! Thank you!!!!
This is pretty funny, awesome work man
This is such a nutty tutorial Very nice
Short, informative, fucking entertaining as balls.
Take my like button +1
this feels like a long lost early 2000s video i love it
thanks for sharing this tutorial ^_^
Him: repeat it for 52 times
Me: OK i'll have to do it once it's not so hard
Him: now another 24 repetition operation good luck
Me: well... i'm strong i can do it
Him: now buy an iphone ^^
Me: * breaks down, breaks my laptop in half *
on android you can use meowface, it's not as good but works the same X).
but i laughed, gg wp 👍!
if you actually did all that and found out about the fact that you can't continue because of the Iphone part then that really sucks lol
I'm pretty sure you can just use a webcam. I haven't tried it yet because I'm only just getting into it, but the website for VSeeFace doesn't say anything about needing an iphone.
@@getyogoofyahh222 no u can use webcam too i think, with vseeface , it has web cam tracking too
Hope this isn't too late, but androids can sorta do this with the Meowface app! Closest we got, and its free!
That was... surprisingly fun to watch, you should definitely make more Videos in the Future.
But either talk a little bit less between steps or slow down some, I felt like I was watching this Video on 1.5 Speed ;D
great concise video :)
You can also use NEB (not enough blendshapes) its a plugin for unity that does everything manually, you just have to transfer the blendshapes from a model that already has them (and its provided) using the plugin (its really easy) and then u just export your model and it will be ARKit ready, but remember to actually edit how the blendshapes deform the mesh (you can do that by adjusting some sliders)
This tutorial is amazing, but you can upload it in its entirety without cuts and step by step. It would be easier to follow for novice users! 🙏
I have now learned 2 things.
1. Arkit facetracking
2. My fear of Mr.baldy is *completely rational*
thank you for making this! super funny too XD
0:41
Alright... I made it until this point.
But, how do I save the expressions I just made?
Do anyone know a good tutorial? Both for Blender and for the expression part.
I hate and love this quirky tutorial at the same time. I've never used blender and Unity, and this is the equivalent of a football player kicking a baby bird out of the mother's nest. What a challenge and opportunity for growth.
Noooo not the cube!
I feel like there should be a blender addon to do some of this but it would be quite a bit of work.
I love the humor in this video XD
the hero we all need
So how does this work with the VRM 1.0? the script is differently laid out and has no blendshape menu
this is amazing
VRM from VROID somehow have no fascial bones and mouths, iyes and brows are all merged into 1 - SOS help me please I beg you
Same here...
@@mlgproplayer2915 there's a utility that helps to fix it, in another guys video, you may buy it or found for free
Hi Dani,
I've just seen your portfolio and it's very beautiful.
Would you mind sharing any tips for rendering a character?
Do you render in Blender or Unity?
And what about the lighting?
brilliant, very helpful
Not that I'm gonna use this knowledge but still its a really nice tutorial
I watched it for its entertaining value 👌
I've tried newer and older versions of the VRM and Unity packages and I successfully made a model with tracking and expressions a year ago, but with my latest export I'm not getting the Blendshapes script on the VRM.
Anyone have a clue where to start troubleshooting?
use Hana tool to create all the blendshapes in unity; saves time
YO WOT IS THAT?
holy moly
A great tut, however i cant export to VSF
Validation.cs(53,13): error CS0103: The name 'Extended' does not exist in the current context
Error building Player because script had compiler errors
开头有点可爱！萌到我了🙂
whatever happened to the later tutorials mentioned?
tho i'm a total newbie and downloaded blender for this video, getting stuck on 0.20 seconds was not something I expected xd how do i use multiple windows i did horizontal split but it only duplicated the model
excellent video
Thanks! You are the best!
Definitely understandable and definitely not too fast for my monke brain
ok but what is that tool you used to grab and modify the brows at 0:40. new to blender and I NEED to know what this is.
It's G! You need to click/select the vertex and then use G to move whatever you clicked. You can scroll in and out to make the movement bigger or smaller so you don't end up warping the whole head
ok, but who is mister bawdy? i can't find it
it wont let me move the eyebrows from my vrm model.... i might just be dumb but plz help !
Thank you so much for the tutorial! I was wondering, how do you make your selections/moves in edit mode like that with the radius circle? It looks like pinch sculpting.
maybe it's the tweak tool?
It’s proportional editing using the edit mode. Basically turn on proportional editing somewhere on the top of the screen, grab a vertex, and while you’ee dragging the vertex around, scroll on the scrollwheel until the circle is small enough to only affect what you need to affect
@@nilepereiraa ok cool, yea i figured it out, thanks! I was just wondering because in ur video it looks like u almost skip the part where u have to select a vertex first, mine always light up before the circle pops up
@@chinchillaturtle7121 what is the shortcut?
@ Select the object that you want to edit in object mode then go to edit mode select a vertex in an area you want to start from with the move tool enabled and proportional editing enabled with connected only checked or unchecked in your proportional editing options depending on what you want. Then when you go to drag around/move the vertex scroll up or down to change how much you want to influence on the model with the pull in real time.
Hey, Thanks so much for this tutorial!
It was very well explained and simple to follow!
I ended up exporting it as VRM at the end because VSF didn't work out for me xD
I noticed the update about being able to use a normal webcam, so I got excited.... then I realised this part... "A software that enables face tracking with a machine equipped with NVIDIA's RTX series GPU "
GODDDAMNNN IT! 🤣🤣
this video is great except two things, i dont know unity and get and error for what wasnt shown (locking material for export) and you need unity 2019.4.31f1 so i hope someone reads this before they download a later version of unity else the will alot of work for nothing, then have to download the right unity.......................
cuz i already had a version of unity for vrchat
p.s i found out that that version of unity doesn't work with the latest unity hub, you have to download an older version before 3.0.0
I love this video
I've been using this for nearly a year now, but one thing really bothers me that I don't see from pretty much everyone else. Every 30 seconds to 2 minutes, my tracking will freeze for a few seconds before returning to normal. My performance graph shows that received data while using these programs drops to zero when the freeze happens. So far, I haven't found any solution to this problem. Have any ideas why this happens?
I am using 5Ghz wifi
My reception is good
My CPU usage is under 70% while using OBS, Discord, and gaming at the same time.
This will happen even when no other software is open. It also happens when using a different iPhone and a different computer of similar performance. I don't get it.
For some reason after i export the VRM and trying to put it into the hierarchy it doesn't show the model. Any idea why?
Nice! Do you have a video on setting up a full body rig thats compatible with Unity VR realtime mocap?
Do you know if the Faceit blender addon for automatically generating ARKit expressions will work on MMD models like Lumine? Manually editing the mesh to create expressions is not very beginner friendly and is a subject that probably deserves its own video.
I dont know why but the head model form the description doesnt have shape keys saved for me
this is gonna sound dumb but does this work for models that have rigify rigs? i don't know if i want to convert my rigifiy model to a regular model lol...
I D O N ' T H A V E A N I P H O N E, how am i supposed to test it :(
Apologies Mr Dani but sadly my own vseeface isnt really capturing the tracking, ifacialmocap shows green that it connects to my pc and Ive done the Inbound rule for vseeface but the model on vseeface is still stiff but the ifacialmocap is capturing all my expressions
Never had tought of vtubers as ventriloquists...
And I'm a 3D animator...
My mind is blown xD
Thanks for sharing
I have my webcam and android, is there a setting?
Subscribed 👍
i dont see the blend shape proxy script T-T
can we have the animations tutorial?
If you're doing just a bust and face, do you need bones?
I usually just say not to import blendshape normals. What does legacy blendshapes do?
The cel shading can break when certain blendshapes are active (especially in the mouth area), and legacy blendshapes tends to smooth it out for my cel shaded workflow. It's one of those 'I don't know why it works but I'll just continue doing it' rituals.
thank u so much
thats so nice
I feel like I'm missing a lot of the blender knowledge. Also, I'd love to know where I can pic up the model you used.
Thank you for the tutorial! Can I also add extra morphs, that I then could use with a set up hotkey short cuts?
is it possible to do custom additional blendshapes and add them to the kit?
Also, is it possible to do the face tracking with something other than iphones
What other software beside unity can you use. Because unity.
So a direct VRM export from Blender would lack more than just custom shaders?
Thx a lot!
Would this work for android face tracking apps like Vnyan?
so did he do it all in shapekeys and no armature???
This is funny.😂
is there any problem export avatar to vrm? and import in unity?
hey does somebody knows if this work for animaze ?
Please don't delete this video until I buy my iphone X
Will this work for webcam users in vseeface?
Nope.
Does it work with meow face
😍