Dani Periapsis
Dani Periapsis
  • 2
  • 116 488
How to Create ARKit Face Tracking for 3D VTubing - FULL Tutorial
*2024 UPDATE*
You can now do ARKIT face-tracking without selling a kidney to Apple! Praise be the devs at ifacialmocap! 神です!
Check link below:
ifacialmocap/status/1762455154270556308
5ish minute -Lazy- tutorial covering everything from blender blendshapes to esoteric Unity rituals & VSeeFace! ft. kidnapped sister from #genshinimpact
Very Quiet ARKit Discussion Discord - discord.gg/W2CEAYWyFf
- Software -
Blender - www.Blender.org
Unity (2019.4.31f1) - unity3d.com/unity/whats-new/2019.4.31
VSeeFace - www.vseeface.icu/#download
ifacialmocap -apps.apple.com/us/app/ifacialmocap/id1489470545
- Mr. Baldy -
*24/03/01 New Link* thx GBs & TheNidoqueer for the heads up! Mr. Baldy Never Dies
drive.google.com/file/d/1OBG-hJTQldP3xx73ErBsTaptMg4gvgXX/view?usp=sharing
- Blendshape Names -
docs.unity3d.com/Packages/com.unity.xr.arkit-face-tracking@1.0/api/UnityEngine.XR.ARKit.ARKitBlendShapeLocation.html#fields
- Unity Packages -
UniVRM (0.89) - github.com/vrm-c/UniVRM/releases/download/v0.89.0/UniVRM-0.89.0_9470.unitypackage
VSF_SDK - github.com/emilianavt/VSeeFaceSDK/releases/download/v1.13.38a/VSF_SDK_v1.13.38a.unitypackage
Poiyomi - www.patreon.com/poiyomi
- Stolen Goods -
SPEED - Ian Hubert
3D Model - miHoYo, Hoyoverse
3D Model MMD Edit - 观海
Mr. Baldy - Previous link was from mads/ocuuda’s website, his tweets inspired me to look into ARKit in the first place. Since that depreciated it is now a different Google Drive link.
Knowledge - Other great youtubers such as deat, fofamit, kanafuyuko, royalskies, priichu, kaideart, etc. I'm just regurgitating their videos.
04:25 Aranara Perspective Lumine - **鯛** www.pixiv.net/en/artworks/101599186
iphone 13 - Dad ᐕ)♡
- Timestamps -
00:09 Blender
01:34 Unity
04:04 ifacialmocap & VSeeFace
มุมมอง: 112 425

วีดีโอ

ความคิดเห็น

  • @FlyingTortoiseStudios
    @FlyingTortoiseStudios หลายเดือนก่อน

    I've tried newer and older versions of the VRM and Unity packages and I successfully made a model with tracking and expressions a year ago, but with my latest export I'm not getting the Blendshapes script on the VRM. Anyone have a clue where to start troubleshooting?

  • @UcanKanatsizPenguen
    @UcanKanatsizPenguen หลายเดือนก่อน

    holy moly

  • @shelbae9190
    @shelbae9190 2 หลายเดือนก่อน

    Hey guys, I know this is a year later, but for anyone reading this: You DON'T need an iphone for this anymore! There's a program called "XR Animator" where you can have facial AND FULL BODY tracking from any webcam on your pc!

    • @hazelthio7622
      @hazelthio7622 หลายเดือนก่อน

      Hello! I want to try it out, but I've got no idea as to how I could set it up?

    • @shelbae9190
      @shelbae9190 หลายเดือนก่อน

      @@hazelthio7622 Hellooo! I don't wanna link to another persons channel lol, but there's a video that walks you through it. Just look up "FREE Full Body Tracking - Intro to XR Animator"

  • @themalcontent100
    @themalcontent100 2 หลายเดือนก่อน

    What other software beside unity can you use. Because unity.

  • @kimagure-chan
    @kimagure-chan 2 หลายเดือนก่อน

    Does it work with meow face

  • @abubakaramjad3343
    @abubakaramjad3343 2 หลายเดือนก่อน

    Hi Dani, I've just seen your portfolio and it's very beautiful. Would you mind sharing any tips for rendering a character? Do you render in Blender or Unity? And what about the lighting?

  • @Mosheven
    @Mosheven 2 หลายเดือนก่อน

    This is the fastest most comprehensive tutorial I've found on the subject and is exactly what I need. Thank you so much! Soon... Very soon. I'll be taking commission for characters. I'm going to start pumping out high quality models :3

  • @Raxis
    @Raxis 3 หลายเดือนก่อน

    A few notes to update how it went for a Linux user in case any future penguins waddle over this: - First, you can run Unity in Linux but chances are your vsfavatar Export will fail at the very end simply because you're on a Linux system. there is nothing that can be done because the exporter itself is incompatible with Linux. swap to a windows vbox instead from the getgo to avoid this issue altogether - Be sure to use the 2019.4.31 version of Unity, new versions mess with the exports and VSeeFace will error out - Be sure to remember iFacialMocap requires an Apple device with FaceID. not all iPads, iPhones, or apple cameras have it and FaceID is apparently pretty whack. swap to MeowFace on Android and everything else in the video is still applicable

  • @_splinky_
    @_splinky_ 3 หลายเดือนก่อน

    ATTENTION EVERY ONE, from my experience, meowface is a the facial mocap app for android

  • @kilianstarzengruber6835
    @kilianstarzengruber6835 3 หลายเดือนก่อน

    the hero we all need

  • @unf0rgettwbl3_
    @unf0rgettwbl3_ 3 หลายเดือนก่อน

    You can also use NEB (not enough blendshapes) its a plugin for unity that does everything manually, you just have to transfer the blendshapes from a model that already has them (and its provided) using the plugin (its really easy) and then u just export your model and it will be ARKit ready, but remember to actually edit how the blendshapes deform the mesh (you can do that by adjusting some sliders)

  • @mlgproplayer2915
    @mlgproplayer2915 4 หลายเดือนก่อน

    0:41 Alright... I made it until this point. But, how do I save the expressions I just made? Do anyone know a good tutorial? Both for Blender and for the expression part.

  • @Justakatto
    @Justakatto 4 หลายเดือนก่อน

    its funny to me that this is the only video you have on your channel and its a 10/10 banger

  • @cluelessguide
    @cluelessguide 4 หลายเดือนก่อน

    tho i'm a total newbie and downloaded blender for this video, getting stuck on 0.20 seconds was not something I expected xd how do i use multiple windows i did horizontal split but it only duplicated the model

  • @Demonicvalleygirl
    @Demonicvalleygirl 4 หลายเดือนก่อน

    This video is incredible and you are the best!

  • @AbrahamDizon-g2k
    @AbrahamDizon-g2k 4 หลายเดือนก่อน

    Hmmm what am i doing here why i am so 3d WAIT NOOOOOO

  • @AbrahamDizon-g2k
    @AbrahamDizon-g2k 4 หลายเดือนก่อน

    Oh no

  • @nalithea
    @nalithea 5 หลายเดือนก่อน

    Hey, Thanks so much for this tutorial! It was very well explained and simple to follow! I ended up exporting it as VRM at the end because VSF didn't work out for me xD

  • @mahabbat1960
    @mahabbat1960 5 หลายเดือนก่อน

    Not much is clear to do on your own.

  • @corelovergirl
    @corelovergirl 5 หลายเดือนก่อน

    That topology is horrible whoever made this model should feel ashamed of this monstrosity.

  • @PrelatFatui
    @PrelatFatui 5 หลายเดือนก่อน

    Сложно

  • @Matobit
    @Matobit 5 หลายเดือนก่อน

    I noticed the update about being able to use a normal webcam, so I got excited.... then I realised this part... "A software that enables face tracking with a machine equipped with NVIDIA's RTX series GPU " GODDDAMNNN IT! 🤣🤣

  • @soyleo_san
    @soyleo_san 5 หลายเดือนก่อน

    Never had tought of vtubers as ventriloquists... And I'm a 3D animator... My mind is blown xD

  • @bob632
    @bob632 5 หลายเดือนก่อน

    I'm thinking now, imagine if you had this in Virtual Droid 2 too? I'd be grateful if you comment here because it's a question 😊

  • @sitandlisten7602
    @sitandlisten7602 5 หลายเดือนก่อน

    ok, but who is mister bawdy? i can't find it

  • @jjpc6830
    @jjpc6830 5 หลายเดือนก่อน

    u totally know one will puase your video a thousand times, so u didn't wasted time, now i know how to blender to vroid, i enjoyed the humor 11 out 10 video

  • @JaliceTheShort
    @JaliceTheShort 6 หลายเดือนก่อน

    BRO YOUR MODEL BLEW UP

  • @remenemenev
    @remenemenev 6 หลายเดือนก่อน

    VRM from VROID somehow have no fascial bones and mouths, iyes and brows are all merged into 1 - SOS help me please I beg you

    • @mlgproplayer2915
      @mlgproplayer2915 4 หลายเดือนก่อน

      Same here...

    • @remenemenev
      @remenemenev 3 หลายเดือนก่อน

      @@mlgproplayer2915 there's a utility that helps to fix it, in another guys video, you may buy it or found for free

  • @Akaizets
    @Akaizets 6 หลายเดือนก่อน

    Do you think you’ll eventually release this model with quest compatibility?

  • @squidygirlgaming9545
    @squidygirlgaming9545 6 หลายเดือนก่อน

    Wish it was on quest

  • @Tierotrix
    @Tierotrix 6 หลายเดือนก่อน

    Really cool, I might use it next time I play VRChat.

  • @Sayv1Snay
    @Sayv1Snay 6 หลายเดือนก่อน

    This is amazing looking! Is the avatar gonna be mobile compatible?

  • @mizosis
    @mizosis 6 หลายเดือนก่อน

    this is gonna sound dumb but does this work for models that have rigify rigs? i don't know if i want to convert my rigifiy model to a regular model lol...

  • @omostar_9018
    @omostar_9018 6 หลายเดือนก่อน

    Do you know where to find the quest version? (I don't have discord)

  • @VocaloidFantasy
    @VocaloidFantasy 6 หลายเดือนก่อน

    Do you have the MMD version?

    • @dperiapsis
      @dperiapsis 6 หลายเดือนก่อน

      Yes! It's in our discord

    • @omostar_9018
      @omostar_9018 6 หลายเดือนก่อน

      @dperiapsis what if I don’t have discord?

    • @VocaloidFantasy
      @VocaloidFantasy 6 หลายเดือนก่อน

      @@dperiapsis Thanks

    • @Mxnkx
      @Mxnkx 4 หลายเดือนก่อน

      Where is the quest version I don't see it in discord??​@@dperiapsis

  • @WhooIsAngie
    @WhooIsAngie 6 หลายเดือนก่อน

    it wont let me move the eyebrows from my vrm model.... i might just be dumb but plz help !

  • @complicatedeggclips5635
    @complicatedeggclips5635 6 หลายเดือนก่อน

    Bro really cooked 🔥

  • @Guitarhero_02.21
    @Guitarhero_02.21 6 หลายเดือนก่อน

    is it nit quest compatable? ;<

    • @dperiapsis
      @dperiapsis 6 หลายเดือนก่อน

      someone already made one in our discord server, come check it out ᐕ)b

    • @bryantremblay587
      @bryantremblay587 6 หลายเดือนก่อน

      ​@@dperiapsiscant find it on quest😢

    • @bob632
      @bob632 5 หลายเดือนก่อน

      ​@@dperiapsisI'm thinking now, imagine if you had this in Virtual Droid 2 too? I'd be grateful if you comment here because it's a question >3

  • @SOPPI_srn
    @SOPPI_srn 7 หลายเดือนก่อน

    😍

  • @ksivl1690
    @ksivl1690 7 หลายเดือนก่อน

    you were so fast, I knew you reminded me of Ian Hubert 😂succinct, informative tutorial!

  • @Toffeeomppu
    @Toffeeomppu 7 หลายเดือนก่อน

    This is by far the best tutorial I've come across

  • @-Xavior-
    @-Xavior- 7 หลายเดือนก่อน

    Please make more videos if you have any ideas, I loved this tutorial, funny, fast and on point.

  • @ItzMeNido
    @ItzMeNido 7 หลายเดือนก่อน

    Mr Baldy link is dead. Rip.

  • @girlybits
    @girlybits 8 หลายเดือนก่อน

    Mr Baldy is gone- can't download him anymore.

  • @funAndwise
    @funAndwise 8 หลายเดือนก่อน

    can we do it without paying two kidneys to apple ?

  • @kakaiya
    @kakaiya 8 หลายเดือนก่อน

    thank you!

  • @dias2525
    @dias2525 8 หลายเดือนก่อน

    So how does this work with the VRM 1.0? the script is differently laid out and has no blendshape menu

  • @hreyo
    @hreyo 8 หลายเดือนก่อน

    i wanna marry u Dani.

  • @TechnoFox1
    @TechnoFox1 8 หลายเดือนก่อน

    can we have the animations tutorial?

  • @Restoe3D
    @Restoe3D 8 หลายเดือนก่อน

    I D O N ' T H A V E A N I P H O N E, how am i supposed to test it :(