Hai, I already import the vrm mapping into my unity project but it seem not appear on the tabs like yours, and i can't export as vrm mapping file, can you help me?
Fantastic tutorial! I have one question, though: how do I get my hair & ear bones to move like you have here? The VRM model does this perfectly in other vtuber apps like VSeeFace, but in UE4 I'm stiff as a board :(
thank you! you can add a "spring bone" node at the end in the anim blueprint...but this also bugs out sometimes so I'm using another plugin called "kawaii physics" to add some physcis back on hair and stuff
My model in UE is stuck in Tpose, will not move head/eyes or blink. Most blendshapes do work in UE when capturing with Vceeface, also speaking works. I tried it with two different skeletons, both give same problem. In Vceeface movement is just fine. In anim bluprint it does have a note on bone saying component pose was visible but ignored, not sure if that has anything to do with it. With UE 5.4 it didnt work at all (either not seeing the plugin or failing to compile) so I am trying with 5.1 and newest plugins versions. I am kinda lost here as to what is going wrong where?
the t-pose sounds like a skeleton issue still yeah...component visible but ignored is fine, that referrs to the input on the first node in the animBP cause nothing is connected to it...I havent checked the plugins in a while so I'm not sure if there is even a stable version for 5.4...in my discord we have a version for 5.3 if you wanna try that!
Hi there! I have a problem with the Vroid avatar. When you finish all the steps and export the VrmMap. When I start the Animation Blueprint, all the joints shrink inwards. I appreciate any help. Thank you so much
Hi Rikku: this is an amazing tutorial! And is it possible you can make more tutorials on how to set up as vtubers in UE and make those tutorial a bit longer? thanks a lot! : )
@@RikkuVR i really enjoyed your twitch stream, considering your ue vtubing set up one of the topest among other vtubers i have seen and very creative as well. im just curious how to make your current set up works for those beginners who have just entered ue? May be a long Q&A seesion abt the vtubing in UE session might help? And also i really curious and want to know how to build a scene or virtual room set up like yours from ground up in ue? it looks amazing like lving in the future!: )
I can't export a VRM Map. I keep getting the error that my model "has no VRMHumanoidDescription" and yes I have check and re-checked in the VRM model setup that the rig is set to humanoid. No clue why this is not working
@@RikkuVR I did end up figuring that out, it ended up being a matter of finding the right version of unity to get it to work (weirdly had to be 2022.3.55f1 exactly, which I found out by downloading every version of Unity one at a time from 2019 onward until it worked). Now the issue is that I have everything set up exactly the way you have it in your tutorial, but the animation is just not working. I have the mocap displaying perfectly in VMC, but in UE5, nothing. Ports are all the same, checked a million times at this point. I have all the boxes checked. But just... Nothing. Either when I hit play or in the preview (with update animation in editor ticked, ofc). Not sure if there are any tips or tricks you would have for that? Things to check I might have overlooked?
Hello, I’d like to use LiveLink for facial tracking. My Live Link works for MetaHumans characters but I can’t get it to work for the Vrm models. Can you tell me how did you set up for your model ?
hmmm which part is not working for you? I added the live link node in the anim Graph and selected my iPhone then it got picked up...maybe your model doesnt have all blendshapes for arkit?
Yeah I figured. x) I tested some vrm models I found on Vroid to see if I had the right technology to pull off UE5 vtubing and basically they don’t the right blendshapes naming conventions for ARKit x). Maybe You should make an addendum or something like that in your future videos ! Anyway thanks for helping me, your tutorials really helped me.@@RikkuVR
@@zicerrokkae I see hmm you could technically get the values of the blendshape s in the animBP and apply them manually to some of the others, so you can kinda cheat it with "set morph target"...bit hacky but works :D Thank you, im glad the vids help!
I don't know if i've done something wrong (either in blender or unity) but when i import my VRM file to UE my avatar is invisible as if it had no mesh. Do you know how to fix it ?
uuuuh have you checked if the three plugins are working correctly and are enabled? Also the material could be the issue...I didnt encounter that one yet ^^
currently I'm using live link face for the face and SteamVR trackers with Manus Polygon software for the body, because VMC is a bit more prone to error, I skip it completely^^
@@RikkuVR Hi Rikku, I just purchased the pay for version of vmc and download it. Just realized that it requires trackers to do the tracking? Unlike vseeface can just use pc camera? Cuz my avatar is not moving face or body and I don’t see any option on menu to open the camera🤣🤣
sorry just saw your msg now, YT comments are kinda broken sometimes...so yeah for just upper body I would go vseeface for upperbody and iPhone for face
Does this work for custom UEFN background characters? I'm currently building my character in VRoid and I want to insert my character into Fortnite (or mod them into an old version)
@@RikkuVR maybe you'd be willing to help me with one more thing. the calibration is failing. it says, 'head tracker not found'. I've tried changing the tracker assignment from HMD to Tracker to controller and tried every calibration method but always fails with same error code. it says to check my devices and trackers assignments. my settings look just like yours in the video. any idea how to fix?
@@c7flat13 steamvr has a tracker assignment menu where you can assign roles to trackers so maybe try that...its in settings -> controllers -> manage trackers...in there you can give a tracker the role "head" so maybe that fixes the issue
I can't get my existing project to package so that LiveLink can work and control my models. If I use your method, 1. Can what you have done here, combined with the steps in the earlier video, be packaged a a standalone exe for windows? 2. If the project can be packaged, must the project use VRM avartars? My current project uses .fbx models. The models all have the 52 ARKit blend shapes.
they should be fine packaging but yeah it uses VRM to map out the skeleton so no fbx, only vrm...if you want to you can use unreal + manus polygon to drive fbx models with SteamVR hardware...unfortunately they only support up to UE5.0 without paying
@@RikkuVR Looks like the free version is no more. Every link to the "free" version redirects to the main paid version page. I'll convert a FBX to VRM and see how that goes. The big issue for me is to get LiveLink to work after I package a project to an .exe file.
@@appliedclinicalvr2359 theres still a free version here sh-akira.booth.pm/items/999760 ...but sending out VMC data requires the paid version anyway...you probably have to hook up some BP to set the name of your live link device to work properly
can I ask a question about facial tracking? I am trying to facial tracking with a VRM file, and I have tried various methods such as the VMC protocol and UE Live Link, but face is broken or shaken unstable every time... How can I stably facial tracking?
hmm that was a common issue and I thought it was fixed already...I havent looked into vrm things in ages so not sure whats going on there..maybe look in the github of the vmc4u stuff for answers
Amazing tutorial, tks a lot, quest if I dont hv iphone dont need to add live link face right ? UE will recognize my webcam ? there's some alternative for Android ?
yes if you dont have an iPhone you dont need to add live link face...UE wont recognize your webcam for that, since it uses the FaceID sensors of the iPhone and not just the camera on it. There is now an alternative on Android suvidriel.com/ but you have to use Vseeface with it and then get it into Unreal via the VMC protocoll (haven't dont that yet because I don't have an android but those are the general steps)
Is there any way to get finger tracking added onto this? Possibly with leap motion or another way? If you could figure that out, it would be the best vtubing solution ever
yes you can! If you use VSeeface instead of VMC, you can plug your leap motion in, feed that data into FSeeface and from there into UE...the setup on UE side is exactly the same as in this vid, you just have to match ports with vseeface and make sure VMC sender is activated in VSeeFace and it should work
error cs0246:the type or namespace name 'VRM' could not be found (are you missing a using directive or an assembly reference?) There's an error like this.
In the editor my avatar's hair looks perfect, but when i press play, the hair is clipping through the forehead, do you have any idea how to fix this? Great tutorial btw! :)
thank you! one way to fix this is using a plugin called kawaii physics...in there you can add physics to the hair and colliders so it doesnt go through your head...in my experience the physics coming from the vrm itself doesnt work that well so I went with kawaii physics instead
@@RikkuVR I'll give that a try, thanks for the help! I was all excited that everything was working at first, then I pressed play and the hair just teleported into the forehead LOL
When I import Unity, it pops up like this What should I do? the type or namespace name 'VRM'could not be found (are you missing a using directive or an assembly reference)
when you import into Unity or when you import the VRM into UE? Either way it looks like a version mismatch so looks like you either dont have the right unity version installed or the VRM plugin is the wrong version / broken
If Unreal Engine is installed on another computer Could you tell me how to create Anim Blueprint? Now, I can only enter the port but not the IP address in the Anim Blueprint. Thanks!
vmc is a separate program you have to download, just search for it on google and you should find it! there is also a lot of vids on VMC alone thats why I haven't covered it here
Hey Rikku :) Thank you for the tutorial! I am attempting to export the vrmmap file but I keep getting this error: ' "x" has no VRMHumanoidDescription '. Would you know what I am doing wrong and how to amend this please?
oh yeah the VRM hair is kinda bugged...I'll soon release a tutorial for a different way to setup hair in UE so it doesnt mess up...in the mean time you could go into the physics tab of your model and delete the physics bodies on the hair, except on the tips, that worked pretty well for me
Hey Rikku, i've watched a bunch of your videos already. You've definitely earned a sub! My biggest and only hurdle is that i don't own an iphone, only Android and a pc webcam. Is there an alternative to livelink? I've tried to search myself but so far nothing conclusive.
Hey Wolve! You could use VSeeface, it has webcam integration and then pipe that through the VMC pipeline into UE, the setup there is the same as the normal VMC one
Your neck sometimes looks as if it's not properly attached to your neck. I'm not trying to be disrespectful, just pointing out what I see. (could be just me)
@@RikkuVR I was playing with Vroid studio and found out there's an option to choose the color of the shadow. Face and body has their own shadow-color options, which is kind of weird🤔(and the defualt shadow color is a pinkish hue like yours)
I do live Q&A about UE5, every Monday and Wednesday on twitch.tv/rikku_vr/ come join!!!
HAHAHAHAH That Cat in the Background on the Vaccum. To Good
haha thanks :D
Based and epic now I won’t have to suffer unity’s shart interface LMFAO ty!
LMAO yw xD
Hai, I already import the vrm mapping into my unity project but it seem not appear on the tabs like yours, and i can't export as vrm mapping file, can you help me?
Can't wait to try and follow along with this
hehe I hope I explained it well enough lol
Hey how did you get the VRMapping asset to plug into the blueprint at 1:40? In my anim graph it shows nothing when i try to plug in those.
did you get the vrmmap into UE from Unity?
Fantastic tutorial! I have one question, though: how do I get my hair & ear bones to move like you have here? The VRM model does this perfectly in other vtuber apps like VSeeFace, but in UE4 I'm stiff as a board :(
thank you! you can add a "spring bone" node at the end in the anim blueprint...but this also bugs out sometimes so I'm using another plugin called "kawaii physics" to add some physcis back on hair and stuff
Will this work if you have added items to your character in unity before Mapping??
yes it should work if they are in the vrm file as well
My model in UE is stuck in Tpose, will not move head/eyes or blink. Most blendshapes do work in UE when capturing with Vceeface, also speaking works. I tried it with two different skeletons, both give same problem. In Vceeface movement is just fine. In anim bluprint it does have a note on bone saying component pose was visible but ignored, not sure if that has anything to do with it. With UE 5.4 it didnt work at all (either not seeing the plugin or failing to compile) so I am trying with 5.1 and newest plugins versions. I am kinda lost here as to what is going wrong where?
the t-pose sounds like a skeleton issue still yeah...component visible but ignored is fine, that referrs to the input on the first node in the animBP cause nothing is connected to it...I havent checked the plugins in a while so I'm not sure if there is even a stable version for 5.4...in my discord we have a version for 5.3 if you wanna try that!
@@RikkuVR Ok, joined your discord, gonna take a look around. I assume its somewhere in the unreal tab. Thank you
@@SasayakuYume yes its pinned in the Unreal Channel!
Hi there! I have a problem with the Vroid avatar. When you finish all the steps and export the VrmMap. When I start the Animation Blueprint, all the joints shrink inwards. I appreciate any help. Thank you so much
that might be a scaling issue from exporting your model, but I'm not sure
Hi Rikku: this is an amazing tutorial! And is it possible you can make more tutorials on how to set up as vtubers in UE and make those tutorial a bit longer? thanks a lot! : )
Thank you Michael! What kind of tutorials do you wanna see?
@@RikkuVR i really enjoyed your twitch stream, considering your ue vtubing set up one of the topest among other vtubers i have seen and very creative as well. im just curious how to make your current set up works for those beginners who have just entered ue? May be a long Q&A seesion abt the vtubing in UE session might help? And also i really curious and want to know how to build a scene or virtual room set up like yours from ground up in ue? it looks amazing like lving in the future!: )
by using this you project your avatar from unreal when you are streaming right?
I'm not sure what you mean with that question haha
Is it good to making 3d-based cartoon for posing and making face fast?
if you mean getting some good mocap recording fast, yeah
I can't export a VRM Map. I keep getting the error that my model "has no VRMHumanoidDescription" and yes I have check and re-checked in the VRM model setup that the rig is set to humanoid. No clue why this is not working
hmm that is really weird, I dont have an answer to that unfortunately
@@RikkuVR I did end up figuring that out, it ended up being a matter of finding the right version of unity to get it to work (weirdly had to be 2022.3.55f1 exactly, which I found out by downloading every version of Unity one at a time from 2019 onward until it worked). Now the issue is that I have everything set up exactly the way you have it in your tutorial, but the animation is just not working. I have the mocap displaying perfectly in VMC, but in UE5, nothing. Ports are all the same, checked a million times at this point. I have all the boxes checked. But just... Nothing. Either when I hit play or in the preview (with update animation in editor ticked, ofc). Not sure if there are any tips or tricks you would have for that? Things to check I might have overlooked?
Hello, I’d like to use LiveLink for facial tracking. My Live Link works for MetaHumans characters but I can’t get it to work for the Vrm models. Can you tell me how did you set up for your model ?
hmmm which part is not working for you? I added the live link node in the anim Graph and selected my iPhone then it got picked up...maybe your model doesnt have all blendshapes for arkit?
Yeah I figured. x) I tested some vrm models I found on Vroid to see if I had the right technology to pull off UE5 vtubing and basically they don’t the right blendshapes naming conventions for ARKit x). Maybe You should make an addendum or something like that in your future videos ! Anyway thanks for helping me, your tutorials really helped me.@@RikkuVR
@@zicerrokkae I see hmm you could technically get the values of the blendshape s in the animBP and apply them manually to some of the others, so you can kinda cheat it with "set morph target"...bit hacky but works :D Thank you, im glad the vids help!
I don't know if i've done something wrong (either in blender or unity) but when i import my VRM file to UE my avatar is invisible as if it had no mesh. Do you know how to fix it ?
uuuuh have you checked if the three plugins are working correctly and are enabled? Also the material could be the issue...I didnt encounter that one yet ^^
Plus are you sing the live link face for the facial tracking and vmc for the body tracking in your current twitch streaming set up? thank you
currently I'm using live link face for the face and SteamVR trackers with Manus Polygon software for the body, because VMC is a bit more prone to error, I skip it completely^^
@@RikkuVR So for those who dont currently have any trackers just webcams or iphone, what upper body tracking do you recommend? just vmc?
@@RikkuVR Hi Rikku, I just purchased the pay for version of vmc and download it. Just realized that it requires trackers to do the tracking? Unlike vseeface can just use pc camera? Cuz my avatar is not moving face or body and I don’t see any option on menu to open the camera🤣🤣
@Michael Li oh yeah VMC requires you to have trackers :D but you can use VSeeFace instead of VMC for upper body stuff to feed it directly into UE
sorry just saw your msg now, YT comments are kinda broken sometimes...so yeah for just upper body I would go vseeface for upperbody and iPhone for face
Does this work for custom UEFN background characters?
I'm currently building my character in VRoid and I want to insert my character into Fortnite (or mod them into an old version)
not sure if it would work but since UEFN is based on UE it should in theory
What template mode would you launch in?? Always Virtual production or can third person be done?
both can be done! I started with virtual production but then also changed soo much over the months and now it is its own thing :D
Great tutorial! Will you be releasing the complete project to download?
thank you! I won't release the project cause there are a lot of paid assets and plugins in there
@@RikkuVR Fair enough, im working through it now so shoule be all good. Thnaks for taking the time to reply :)
Hi, I'm sorry for the noob question but I have spent hours trying to figure out how to open the VMC 'control panel'. Any help is greatly appreciated.
hey! It should be a separate window which opens when you launch VMC
@@RikkuVR got it. had to translate the github page to English to see the software necessary to work. sorry for the hassle.
@@RikkuVR maybe you'd be willing to help me with one more thing. the calibration is failing. it says, 'head tracker not found'. I've tried changing the tracker assignment from HMD to Tracker to controller and tried every calibration method but always fails with same error code. it says to check my devices and trackers assignments. my settings look just like yours in the video. any idea how to fix?
@@c7flat13 steamvr has a tracker assignment menu where you can assign roles to trackers so maybe try that...its in settings -> controllers -> manage trackers...in there you can give a tracker the role "head" so maybe that fixes the issue
I can't get my existing project to package so that LiveLink can work and control my models. If I use your method, 1. Can what you have done here, combined with the steps in the earlier video, be packaged a a standalone exe for windows? 2. If the project can be packaged, must the project use VRM avartars? My current project uses .fbx models. The models all have the 52 ARKit blend shapes.
they should be fine packaging but yeah it uses VRM to map out the skeleton so no fbx, only vrm...if you want to you can use unreal + manus polygon to drive fbx models with SteamVR hardware...unfortunately they only support up to UE5.0 without paying
@@RikkuVR Looks like the free version is no more. Every link to the "free" version redirects to the main paid version page. I'll convert a FBX to VRM and see how that goes. The big issue for me is to get LiveLink to work after I package a project to an .exe file.
@@appliedclinicalvr2359 theres still a free version here sh-akira.booth.pm/items/999760 ...but sending out VMC data requires the paid version anyway...you probably have to hook up some BP to set the name of your live link device to work properly
can I ask a question about facial tracking?
I am trying to facial tracking with a VRM file, and I have tried various methods such as the VMC protocol and UE Live Link, but face is broken or shaken unstable every time...
How can I stably facial tracking?
hmm that is weird..what do you mean by shaken?
Hia I've been using this however after about 30 seconds-5 minutes my model randomly disconnects, do you know of a fix?
hmm that was a common issue and I thought it was fixed already...I havent looked into vrm things in ages so not sure whats going on there..maybe look in the github of the vmc4u stuff for answers
Amazing tutorial, tks a lot, quest if I dont hv iphone dont need to add live link face right ? UE will recognize my webcam ? there's some alternative for Android ?
yes if you dont have an iPhone you dont need to add live link face...UE wont recognize your webcam for that, since it uses the FaceID sensors of the iPhone and not just the camera on it. There is now an alternative on Android suvidriel.com/ but you have to use Vseeface with it and then get it into Unreal via the VMC protocoll (haven't dont that yet because I don't have an android but those are the general steps)
Is there any way to get finger tracking added onto this? Possibly with leap motion or another way? If you could figure that out, it would be the best vtubing solution ever
yes you can! If you use VSeeface instead of VMC, you can plug your leap motion in, feed that data into FSeeface and from there into UE...the setup on UE side is exactly the same as in this vid, you just have to match ports with vseeface and make sure VMC sender is activated in VSeeFace and it should work
Hi, my vrm model imported does not look like a toon model but look like real-world plastic or plaster statue. Why is that and how to fix it?
it is probably using a different material then...you could look up a tutorial how to change/modify unreal materials on objects
error cs0246:the type or namespace name 'VRM' could not be found (are you missing a using directive or an assembly reference?) There's an error like this.
unfortunately I didnt encounter that one so no idea how to fix that...only thing I can think of is a mismatch of unity versions
In the editor my avatar's hair looks perfect, but when i press play, the hair is clipping through the forehead, do you have any idea how to fix this? Great tutorial btw! :)
thank you! one way to fix this is using a plugin called kawaii physics...in there you can add physics to the hair and colliders so it doesnt go through your head...in my experience the physics coming from the vrm itself doesnt work that well so I went with kawaii physics instead
@@RikkuVR I'll give that a try, thanks for the help! I was all excited that everything was working at first, then I pressed play and the hair just teleported into the forehead LOL
@HexFable yeeeah thats a common issue :D
@@RikkuVR Im gonna be real, i have no idea how to fix it lol
When I import Unity, it pops up like this What should I do?
the type or namespace name 'VRM'could not be found (are you missing a using directive or an assembly reference)
when you import into Unity or when you import the VRM into UE? Either way it looks like a version mismatch so looks like you either dont have the right unity version installed or the VRM plugin is the wrong version / broken
If Unreal Engine is installed on another computer
Could you tell me how to create Anim Blueprint?
Now, I can only enter the port but not the IP address in the Anim Blueprint.
Thanks!
If you want to send it to another PC you can change the receiver IP in VMC and then use the same port iirc
@@RikkuVR It works，Thanks
Hey, nice and informative! There's only one issue I'm running into (UE5): How do you open the VMC menu? The video didn't show that.
vmc is a separate program you have to download, just search for it on google and you should find it! there is also a lot of vids on VMC alone thats why I haven't covered it here
Hey Rikku :) Thank you for the tutorial! I am attempting to export the vrmmap file but I keep getting this error: ' "x" has no VRMHumanoidDescription '. Would you know what I am doing wrong and how to amend this please?
heya! hmm looks like the bone structure is not humanoid in Unity? At least it sounds like that
@@RikkuVR I have selected humanoind under rig. Is there anything else I would need to do?
@@raidenjack1073 Hi, did u find how to fix it?
would this method work correctly if u created ur avatar from scratch in blender?
if you would convert it then into a VRM using unity, yes
Dark hair would go much better with that hoodie. Right now it’s just too much contrast
after setting up everything, my hair is just going everywhere if i play the scene is there any way i can stop it
oh yeah the VRM hair is kinda bugged...I'll soon release a tutorial for a different way to setup hair in UE so it doesnt mess up...in the mean time you could go into the physics tab of your model and delete the physics bodies on the hair, except on the tips, that worked pretty well for me
Hi Rikku: In VRMMapping Select Asset dropdown its empty for me... What did I do wrong?
did you export the vrmmap file?
@@RikkuVR Thx didnt add both files. But is it possible to link with Webcam Motion Capture app?
@@Mangucis if you use webcam with vseeface you can use this workflow yes!
Hey Rikku, i've watched a bunch of your videos already. You've definitely earned a sub!
My biggest and only hurdle is that i don't own an iphone, only Android and a pc webcam.
Is there an alternative to livelink? I've tried to search myself but so far nothing conclusive.
Hey Wolve!
You could use VSeeface, it has webcam integration and then pipe that through the VMC pipeline into UE, the setup there is the same as the normal VMC one
@@RikkuVR thanks for the reply, ill check it out!
Does this method allow you to use Unreal shaders on your VRM model?
yes!
Rikku big bren
big breen
your avatar has some "unnecessary details" on their textures, huh.
what's vrm?
( ͡° ͜ʖ ͡°)...vrm is a standard / container that is used for characters so they can work with different programs natively for example VMC or VSeeFace
it's 2022. Why it SO complicated...
welcome to the world of game development xD
yes we watch you suffer alot on twitch thats for sure. :)
Your neck sometimes looks as if it's not properly attached to your neck.
I'm not trying to be disrespectful, just pointing out what I see. (could be just me)
could be because I kitbashed the model with a new body, imma look into that!
@@RikkuVR Could be just the texture's color or shading doesn't match up
@@RexusKing @Rexus King yeah you're right the skin shades dont match up a 100%
@@RikkuVR I was playing with Vroid studio and found out there's an option to choose the color of the shadow. Face and body has their own shadow-color options, which is kind of weird🤔(and the defualt shadow color is a pinkish hue like yours)
Man
man