*ATTENTION FOR MODELS USING VROID STUDIO v1.27 OR HIGHER!!!* There has been a change to the base VRoid model which breaks all blendshapes. But I did make a quick fix with my own model. Simply download the file included in NEB called "Reference Model for v1.27.0.vrm" and use that as the Source, instead of the Hinzka model. That should fix your issue. Let me know if you need more help!
Wonderful Tool and Tutorial video. Heads up for anyone using VNyan like me, it works but EVERYTHING is so sensitive the second you load up the new exported model bc all your blendshapes are both inputs AND outputs now. I recommend renaming the blendshapes and/or clips for everything you don't want to overlap, such as the many different smile settings
Thanks for the endorsement! I am taking any feedback to make this plugin better and better with every update. Would you mind sharing this sensitivity issues in our discord server?
.I will when I know more. I might have overestimated the issue, as far less things overlap than I initially thought, and I dont think I have to rename anything. I'm gonna try to figure out how to make my expressions work first. So far it's just been little things, like squinting and blinking overlapping in VNyan so the eyelashes go into the cheeks a bit, or the smile being too big. Maybe I just need to turn some sliders down in Unity, maybe some adjustments in VNyan. Probably a bit of both, but I'm determined to figure something out
Even with the recent Unity drama, I will not stop supporting this plugin as long as people are using it. I haven't decided if my future tools are going to stay in Unity. These are trying times for all Unity devs, so any support you can give me is really appreciated. Get NEB plugin right here: NEB Lite: ko-fi.com/s/ad2b08fa67 NEB Pro: ko-fi.com/s/c47de71369
Yeah. I think for them, I will not leave Unity entirely. I will probably try moving the plugins to Godot though, since Godot is just more accessible. But I am also inclined to Unreal... Tough decisions...
@@ReForgeModeI feel like if you want to make the plugins more accessible, Godot is the answer. But unreal is probably more familiar for developets. Godot definitely needs as much exposure and contributing as possible, however, but it's not as fully featured as unity, for better and for worse. I say for better because some people don't want all the fancy features that Unity has. But it's also for worse as it's less of an all-in-one program. I'm not a developer, but I am an open source nerd, and I say anything that makes Gado more popular is only a good thing. Unity and Unreal sort of have a duopoly for amateur developers. And neither can be fully trusted because they are corporations. Because Tim Sweeney is an engineer, then he's less likely to screw over the Unreal Engine developer base, but it's not immune to corporate fuckery. Godot is, and I think that kind of thing matters a lot because Unity taught everyone you can never trust a corporation. Ultimately, going to unity is going to the lesser of two evils while Godot is going for actual true freedom, most importantly being the freedom to be royally screwed over by a corporation. You're the developer though, so ultimately you're more knowledgeable on the pros and cons of Unreal than I am. Ultimately, Godot might not be enough for what you need. But the more people like you join in making plugins and projects using it, then the closer it can get to being a proper Unity replacement. And that ultimately helps everyone in the entire industry not just the small minority of people who use Godot.
You are so wonderful for making this tool for us, thank you. Do you have any experience with VNyan? I applied the blendshapes and clips to my model but they aren't triggering in VNyan even though my camera monitor is reporting my facial expressions fine.
I have not used VNyan or ever heard of it before this comment. Could you link the download page and documentation for this vtubing application? I may check it out in the future.
Does this not have the a e i o u blendshapes? Also is there any way to adjust these? I know the pro version of neb (which I did buy) lets you adjust blend shapes, but it doesn't seem to let you adjust these blend shape clips. I'm trying to solve a problem where my eyes close TOO much.
I'm a complete Unity noob. 1:18 you said "finished copying and modifying your blendshapes using NED". I finished copying but I don't understand what I need to do next ( I guess that part is modifying blendshapes, but Idk how?) . Is that something I need to do after copying and before adding BlendshapeClipMaker? :v sorry I'm so stupid
No worries! We all gotta start somewhere. Modifying here means any functions you wanna do with NEBPro. Let's say you wanna create your own custom expression blendshapes, or rename some blendshape names, or reorder them. You are supposed to do it all, and then use BlendshapeClipMaker to prepare it for exporting. Well actually, you can use BlendshapeClipMaker at any time, really. It won't break your model or anything.
can you make a video on how to animate a Vroid model in a Blender? I can't animate the model's body and face together. It turns out that the body moves separately, and the face separately, it turns out 2 separate animations from each other. I don't understand how to combine them. Google didn't help me and I didn't find on the Internet how to fix it either. I think I'm doing everything wrong. How do I properly animate a Vroid model in a Blender? So far, no video tutorial on the Internet has helped me, but I have already watched quite a lot :(((
Oohh, yeah... I'm not familiar with Blender or animation in that matter. I probably will learn it eventually, but not in the near future. Though, Blender website does have a lot of tutorials and documentations on animation. Feel free to check it out.
Did some rigorous testing with this and if you DO use this it kinda works and not work (this is for models particularly used for streaming in programs like VNyan, Warudo, VSeeFace) NEB Pro works exactly as intended and makes workflow really fast. The blendshape clip creator breaks my Unity files and it doesn't seem repairable even putting it through Blender. Maybe an option to click on which Shapekeys to turn into Blendshape Clips would make it less funky in Unity (I reiterate it works but you won't be able to test or preview them cuz the Unity file breaks)
Hello! Can you elaborate on what it means to "break your Unity files"? I did some testing on any free VRoid models I can find and the workflow does work swimmingly for VSeeFace. Now, I am currently rewriting and recoding the entire NEB plugin to make it even more streamlined, so please do share your suggestions on improving this tool! ^_^
@@ReForgeMode you know in the bleshape and animation preview we can see samples of how each Blendshape clip looks like? It kinda stopped showing up altogether and I can't get it back. I tried importing different models and their previews and blendhapes show up and have no issues. I also can't edit or adjust the blendshapes themselves anymore because the whole panel won't load- If you want a screenshot or something do let me know how I can send it to you.
Sure thing. Hit me up on my Discord server. Links in the description. Though, have you checked if the display window itself is just closed? Hover your mouse on bottom right on the screen in the inspector, and drag it up. It should show up the preview window again.
Yes, it's because the tools don't generate the BlendshapeClips automatically. Give this method a try and see if it helps: th-cam.com/video/Q1_obTcE_uE/w-d-xo.htmlsi=P8Ujt-dM9_yDo_ir
Hi! I followed the tutorial and did everything but it still says for VNyan that my avatar doesn't seem to contain ARKit-blendshape clips. ): Any ideas? I see that they have been added to the model.
I think you can just use the BlendshapeClipMaker extension included in your NEB download. Do this before you export the model out of Unity. That should take care of the blendshape issues.
I'm a little confused. When I try to import blendshapes clip maker into unity, it says there's a script missing? I'm using VRM0 and using one of the templates in unity and I just can't use the clip maker at all
I have a problem when I install blendshape clips and put it to my model it says "update" instead of "create" new blendshapes even tho I had no other blendshapes before.
By default, all VRoid models come with premade blendshapes, like the usual 5 expressions: happy, sad, angry, laugh, and surprised. Simply update it and nothing wrong may happen.
I think you misunderstand this tool. This tool helps you make your existing VRoid models to be able to do motion tracking for vtubing purpose. It doesn't immediately do facial tracking on its own. After using this tool, you will need to export your model and then use it on vtubing software, like VSeeFace. I have tested VSeeFace and it indeed works with webcam. Though, it's not as accurate as buying actual motion capture device, but good enough for casual uses.
@@ReForgeMode Sorry for the confusion. I know it adds extra shape keys, I just wasn't sure if i could use those extra shape keys/track those extra shape key switch a webcam. I see "ARkit" is only for iPhone.
@@damidraws_vt Oh, I can only speak for VSeeFace, since I did tinker with it a bit. For facial muscles and ARKit, yes, it does work. But additional non-standard blendshapes will not. So for example, if you have an eye bulge blendshape, it won't be automatically tracked. VSeeFace do allow you to trigger the blendshape manually though, by pressing any keys on the keyboard once you set it up.
Physics is tricky because it depends on each engine. What works in Unity doesn't mean it will work in VSeeFace or any other vtubing software. But if you're talking about making games with it, I have some ideas cooking right now.
Hey! I think I might be doing something wrong despite following the tutorial. I succesfully copy the blendshapes from the given example model and they work well in other vtubing softwares. But when I use the blendshape clip creator, it seems to do nothing despite giving me a message that the process was succesfull. I can see the new blendshapes in the folder, but when I preview them there is nothing on the preview window. It doesn't even show the face of the model, just a grey screen. And of course they don't work in VseeFace either. I'm a complete Unity noob so I apologize if my explanation was poor :'D Thank you!
Hmmm... That's weird. Have you copy the blendshapes via NEB to your model? To clarify, the preview window is the window on the bottom of Inspector Window, right? Because to preview each expression, you need to open BlendshapeAvatar in the folder. It is usually just called "Blendshape"
@@ReForgeMode Yes, the inspector! I tried to re-do the whole process and now I am able to see the expressions in the inspector but they don't change, so clearly they have not been copied. The normal vroid expressions still change on the inspector as I click them. EDIT: I tried this in the newest Blender version just in case. I am now able to see all the different expressions in the BlendShape folder and they update in the inspector. However, they still do not work in VSeeFace itself. It must just be something I am missing, since I am not familiar with Unity :D
In that case, please join our discord server and let's talk about it in more detail. You can send the video on how you do it so I can spot if there's any mistake. Link is in the video description
*ATTENTION FOR MODELS USING VROID STUDIO v1.27 OR HIGHER!!!*
There has been a change to the base VRoid model which breaks all blendshapes. But I did make a quick fix with my own model. Simply download the file included in NEB called "Reference Model for v1.27.0.vrm" and use that as the Source, instead of the Hinzka model. That should fix your issue. Let me know if you need more help!
Wonderful Tool and Tutorial video. Heads up for anyone using VNyan like me, it works but EVERYTHING is so sensitive the second you load up the new exported model bc all your blendshapes are both inputs AND outputs now. I recommend renaming the blendshapes and/or clips for everything you don't want to overlap, such as the many different smile settings
Thanks for the endorsement! I am taking any feedback to make this plugin better and better with every update. Would you mind sharing this sensitivity issues in our discord server?
.I will when I know more. I might have overestimated the issue, as far less things overlap than I initially thought, and I dont think I have to rename anything. I'm gonna try to figure out how to make my expressions work first. So far it's just been little things, like squinting and blinking overlapping in VNyan so the eyelashes go into the cheeks a bit, or the smile being too big. Maybe I just need to turn some sliders down in Unity, maybe some adjustments in VNyan. Probably a bit of both, but I'm determined to figure something out
@@vi369 Got it. Let me know if you need any help!
This is exactly what I needed- now I just need to test and experiment with this before I start using it for commission work.
Good luck! Let me know if you found any bugs or any future features improvement!
Even with the recent Unity drama, I will not stop supporting this plugin as long as people are using it. I haven't decided if my future tools are going to stay in Unity. These are trying times for all Unity devs, so any support you can give me is really appreciated.
Get NEB plugin right here:
NEB Lite: ko-fi.com/s/ad2b08fa67
NEB Pro: ko-fi.com/s/c47de71369
We are in the same boat. Only reason I am finishing my project in Unity is for vtubers that only know Unity.
Yeah. I think for them, I will not leave Unity entirely. I will probably try moving the plugins to Godot though, since Godot is just more accessible.
But I am also inclined to Unreal... Tough decisions...
@@ReForgeModeI feel like if you want to make the plugins more accessible, Godot is the answer. But unreal is probably more familiar for developets. Godot definitely needs as much exposure and contributing as possible, however, but it's not as fully featured as unity, for better and for worse. I say for better because some people don't want all the fancy features that Unity has. But it's also for worse as it's less of an all-in-one program. I'm not a developer, but I am an open source nerd, and I say anything that makes Gado more popular is only a good thing. Unity and Unreal sort of have a duopoly for amateur developers. And neither can be fully trusted because they are corporations. Because Tim Sweeney is an engineer, then he's less likely to screw over the Unreal Engine developer base, but it's not immune to corporate fuckery. Godot is, and I think that kind of thing matters a lot because Unity taught everyone you can never trust a corporation. Ultimately, going to unity is going to the lesser of two evils while Godot is going for actual true freedom, most importantly being the freedom to be royally screwed over by a corporation.
You're the developer though, so ultimately you're more knowledgeable on the pros and cons of Unreal than I am. Ultimately, Godot might not be enough for what you need. But the more people like you join in making plugins and projects using it, then the closer it can get to being a proper Unity replacement. And that ultimately helps everyone in the entire industry not just the small minority of people who use Godot.
I just recently thought that the NEB tool is missing creating blendshape clips and then you release a solution!
Don't worry, I gotchu fam!
I'll be trying this today!
Hehe, go right ahead!
Finally here! Thank U sooo much < 3
Glad I could help! 😄😄
You are so wonderful for making this tool for us, thank you. Do you have any experience with VNyan? I applied the blendshapes and clips to my model but they aren't triggering in VNyan even though my camera monitor is reporting my facial expressions fine.
I have not used VNyan or ever heard of it before this comment. Could you link the download page and documentation for this vtubing application? I may check it out in the future.
@@ReForgeMode i keep replying to this trying to talk about VNyan but it keeps vanishing, i think youtube is filtering me
Does this not have the a e i o u blendshapes? Also is there any way to adjust these? I know the pro version of neb (which I did buy) lets you adjust blend shapes, but it doesn't seem to let you adjust these blend shape clips. I'm trying to solve a problem where my eyes close TOO much.
It's possible. I just haven't added it yet, since I don't want any overlap between NEB and this Expression Pack. I'll add it later on the next update.
Thank you very much. So sorry again for not seeing this. I am just terrible with computers 🙏🙏
I'm a complete Unity noob. 1:18 you said "finished copying and modifying your blendshapes using NED". I finished copying but I don't understand what I need to do next ( I guess that part is modifying blendshapes, but Idk how?) . Is that something I need to do after copying and before adding BlendshapeClipMaker? :v sorry I'm so stupid
No worries! We all gotta start somewhere.
Modifying here means any functions you wanna do with NEBPro. Let's say you wanna create your own custom expression blendshapes, or rename some blendshape names, or reorder them.
You are supposed to do it all, and then use BlendshapeClipMaker to prepare it for exporting.
Well actually, you can use BlendshapeClipMaker at any time, really. It won't break your model or anything.
@@ReForgeMode thank you so much
can you make a video on how to animate a Vroid model in a Blender? I can't animate the model's body and face together. It turns out that the body moves separately, and the face separately, it turns out 2 separate animations from each other. I don't understand how to combine them. Google didn't help me and I didn't find on the Internet how to fix it either. I think I'm doing everything wrong. How do I properly animate a Vroid model in a Blender? So far, no video tutorial on the Internet has helped me, but I have already watched quite a lot :(((
Oohh, yeah... I'm not familiar with Blender or animation in that matter. I probably will learn it eventually, but not in the near future. Though, Blender website does have a lot of tutorials and documentations on animation. Feel free to check it out.
Did some rigorous testing with this and if you DO use this it kinda works and not work (this is for models particularly used for streaming in programs like VNyan, Warudo, VSeeFace)
NEB Pro works exactly as intended and makes workflow really fast.
The blendshape clip creator breaks my Unity files and it doesn't seem repairable even putting it through Blender.
Maybe an option to click on which Shapekeys to turn into Blendshape Clips would make it less funky in Unity (I reiterate it works but you won't be able to test or preview them cuz the Unity file breaks)
Hello! Can you elaborate on what it means to "break your Unity files"? I did some testing on any free VRoid models I can find and the workflow does work swimmingly for VSeeFace.
Now, I am currently rewriting and recoding the entire NEB plugin to make it even more streamlined, so please do share your suggestions on improving this tool! ^_^
@@ReForgeMode you know in the bleshape and animation preview we can see samples of how each Blendshape clip looks like? It kinda stopped showing up altogether and I can't get it back. I tried importing different models and their previews and blendhapes show up and have no issues.
I also can't edit or adjust the blendshapes themselves anymore because the whole panel won't load-
If you want a screenshot or something do let me know how I can send it to you.
Sure thing. Hit me up on my Discord server. Links in the description.
Though, have you checked if the display window itself is just closed? Hover your mouse on bottom right on the screen in the inspector, and drag it up. It should show up the preview window again.
on VNyan somehow the app doesn't detect the blendshapes (the ARKit blendshapes or something) and refers back to the 4 defaults
Yes, it's because the tools don't generate the BlendshapeClips automatically. Give this method a try and see if it helps: th-cam.com/video/Q1_obTcE_uE/w-d-xo.htmlsi=P8Ujt-dM9_yDo_ir
Hi! I followed the tutorial and did everything but it still says for VNyan that my avatar doesn't seem to contain ARKit-blendshape clips. ): Any ideas? I see that they have been added to the model.
I think you can just use the BlendshapeClipMaker extension included in your NEB download. Do this before you export the model out of Unity. That should take care of the blendshape issues.
I have this error: NullReferenceException: Object reference not set to an instance of an object
Idk what to do and what's happening..
Hello! I need more details on this error. When does it appear and can you trigger it consistently?
Also, the Vita prefab included in the download is giving me the vertices mismatch error when I tried to NEB copy the blendshapes from Hinzka.
Oh, let me give that a check tomorrow. I'm recovering from illness from this Unity debacle. I will notify you as soon as possible!
@@ReForgeModeThank you, there's no rush, I just noticed there was an error and wanted to let you know. Please rest up and take care of yourself.
@@friendformationbotIt's fixed now. The github repo for the template projects have also been updated with free VRoid models.
@@ReForgeMode thank you!
I'm a little confused. When I try to import blendshapes clip maker into unity, it says there's a script missing? I'm using VRM0 and using one of the templates in unity and I just can't use the clip maker at all
oh NVM! I just took a breath, restarted my computer, and somehow just starting fresh fixed it! I'm not sure what I did exactly, but it worked!
Haha, another Unity shenanigans then! This can happen for some magical reason. Glad it worked out!
I have a problem when I install blendshape clips and put it to my model it says "update" instead of "create" new blendshapes even tho I had no other blendshapes before.
By default, all VRoid models come with premade blendshapes, like the usual 5 expressions: happy, sad, angry, laugh, and surprised. Simply update it and nothing wrong may happen.
I actually realized I forgot to copy blendshapes from the other model. Thank you now all my models work perfectly fine :3
@@mazekin9428 Haha, glad it works! Let me know if you need more help!
Is a vroid 1.0 model required for NEB or is a 0.0 model alright?
On the contrary, only VRM 0 model is supported. VRM 1 is not supported.
I'm super new to this but this tracking works with webcam as well? Not just Iphone? I'm going to attempt to do this :D
I think you misunderstand this tool. This tool helps you make your existing VRoid models to be able to do motion tracking for vtubing purpose. It doesn't immediately do facial tracking on its own. After using this tool, you will need to export your model and then use it on vtubing software, like VSeeFace.
I have tested VSeeFace and it indeed works with webcam. Though, it's not as accurate as buying actual motion capture device, but good enough for casual uses.
@@ReForgeMode Sorry for the confusion. I know it adds extra shape keys, I just wasn't sure if i could use those extra shape keys/track those extra shape key switch a webcam. I see "ARkit" is only for iPhone.
@@damidraws_vt Oh, I can only speak for VSeeFace, since I did tinker with it a bit. For facial muscles and ARKit, yes, it does work. But additional non-standard blendshapes will not. So for example, if you have an eye bulge blendshape, it won't be automatically tracked.
VSeeFace do allow you to trigger the blendshape manually though, by pressing any keys on the keyboard once you set it up.
Does this work with any VRM or just Vroid VRMs?
It works with any 3D models that have the same mesh. So it won't work if you're transferring from random 3D model to VRM model.
It works with any 3D models that have the same mesh. So it won't work if you're transferring from random 3D model to VRM model.
Still waiting for a solution to add physics hairstyles to one character.
Physics is tricky because it depends on each engine. What works in Unity doesn't mean it will work in VSeeFace or any other vtubing software.
But if you're talking about making games with it, I have some ideas cooking right now.
Hey! I think I might be doing something wrong despite following the tutorial.
I succesfully copy the blendshapes from the given example model and they work well in other vtubing softwares. But when I use the blendshape clip creator, it seems to do nothing despite giving me a message that the process was succesfull.
I can see the new blendshapes in the folder, but when I preview them there is nothing on the preview window. It doesn't even show the face of the model, just a grey screen.
And of course they don't work in VseeFace either.
I'm a complete Unity noob so I apologize if my explanation was poor :'D
Thank you!
Hmmm... That's weird. Have you copy the blendshapes via NEB to your model?
To clarify, the preview window is the window on the bottom of Inspector Window, right? Because to preview each expression, you need to open BlendshapeAvatar in the folder. It is usually just called "Blendshape"
@@ReForgeMode Yes, the inspector! I tried to re-do the whole process and now I am able to see the expressions in the inspector but they don't change, so clearly they have not been copied. The normal vroid expressions still change on the inspector as I click them.
EDIT: I tried this in the newest Blender version just in case. I am now able to see all the different expressions in the BlendShape folder and they update in the inspector. However, they still do not work in VSeeFace itself. It must just be something I am missing, since I am not familiar with Unity :D
In that case, please join our discord server and let's talk about it in more detail. You can send the video on how you do it so I can spot if there's any mistake. Link is in the video description
thanks
No problem! Glad I could help! 😄😄
Wait.. you're asian? I lowkey thought you were a European White Man tbh
Hehe, well, I guess I don't really have an accent.
weird thing to say
@horsechow6390 yeah I realised that mb
@@ShatterinSpider honestly props to you for realizing it, youre cool imo