ฝัง
- เผยแพร่เมื่อ 7 มิ.ย. 2024
- It's weird world out there for motion capture. How does one figure out where to put those hard earned CG dollars? This video is for developers, animators and vtubers who are trying to figure out this stuff for the first time.
_____________________________
/ woodydevs
/ woodydevs
/ discord
_____________________________
Creators mentioned in this video
@CitizenMetaOne @Fofamit @Megasteakman @PixelFire @Kana_Fuyuko @PrismaticaDev @pumpkinpotion @CodeMiko @Corridor @CorridorCrew @RokokoMotion @MovellaInc @TextureSupply @CinematographyDatabase
Gear Mentioned (Affiliate Links)
Valve Index amzn.to/3SbKgZV
Vive trackers amzn.to/3BrPDyc
Lighthouses amzn.to/3ODUBuZ
Straps amzn.to/3vpD56Z
USB hub amzn.to/3Q5BUBu
Ultra Leap amzn.to/3SPX34X
Rokoko
Perception Neuron 3
Xsens
Manus
Chapters
00:00 Intro
02:35 Chip shortage
03:13 Criteria for a good mocap solution
05:34 Rokoko
10:43 Xsens
12:40 Manus
13:47 Leapmotion
15:33 Optical Tracking
16:12 Steam VR / Vive
20:01 WHAT TO BUY
20:44 Tundra Trackers
21:45 Facial Tracking
23:09 The future of mocap
23:49 Closing
#unrealengine #vtuber #motioncapture
I hate how actually good informative videos like this one are super low view count and extremely hard to find but all the god awful videos are the thing that pops up 99% of the time.
Pure straight forward, easy to understand, not sponsored
For real, this is the best/most informative “so ya wanna buy a mocap suit?” Type video. I’ve been diving into these videos for about a week now and this just popped up in my recommended videos, I never saw it in my time actually searching I don’t think
You might consider reducing the music level. It can sometimes be difficult to hear since the music competes with your voice.
Constructive criticism is the best type of criticism. I do the same thing on videos, I feel like they never get enough attention but they help content. I just wish people would like more of them so we could see how creatives evolve. However I digress, good luck my friend, keep up the positivity
Agreed!
This was an amazingly comprehensive video! Very nice!
This is an excellent resource, thank you! Interesting one that I've seen being mentioned is Haritora X, might be worth a look as a low cost / lower quality option. There really isn't a lot of good content on this stuff out there so appreciate it.
Soooooooo well done!
Great overview, packed with golden gems and super entertaining ta'boot.
Thank ya kindly sir.
Amazing video! Very comprehensive and accurate: I totally agree with all the information here. I think iPhone and Leap Motion is the best set up for a VTuber: so convenient. Also, thanks for the shout out!
Once you get your tundra trackers, I think you are really going to appreciate the form factor. They will still cause a problem with your tramp stamp, but it's much improved.
I concur with leap motion & iPhone! Just from watching these videos I’m hooked & convinced that this is the least stressful way to stream as a VTuber
Recently considered learning how to use mocap to make short form comedy sketches. (Haven't started yet) It looks like a daunting process but I'm also really excited to see if I can learn it.
16:55 Just a small clarification, SteamVR basestations themselves don't actually "tell" anything, they're just used by the tracked devices as reference, they just beam out an IR laser pattern that sweeps the space many times per second; hence the name Lighthouse.
Yes! Correct. I script these pretty lightly and things just come out wrong sometimes. Thanks for the clarification.
Thanks for making this I'm planning to getting something one day for the action games I want to make
great vid! really helps narrow the scope of options out there for us plebes.
the prices on some of these things are organ donor levels of insanity, especially glove solutions.
Luckily my wallet is on a life support induced coma right now, so only I got the heart attack.
Lol having a medical breakdown as a reaction also sounds expensive.
Nice video and thanks for the mention!
you’re doing a lot of great work Kana!
This is definitely the best video I have looked into regarding this content. It is just surprising it onoly has 5214 views at time I am writing.Thank you so much for sharing this content. you save us hours and hours
Recently discovered the channel and I thoroughly enjoy the consistent quality and topics. Have you seen anything about iPi Soft's markerless mocap? I've seen some people get extraordinarily good results with two kinect 2's. The only issue is that it's not real time. Wondering what you think of it.
I never even thought that rokoko is based in Europe and contacting customer service might be a bit of a hassle. I’ve been figuring out if (or more importantly WHY) I want a mocap suit and thankfully I haven’t been getting ahead of myself and just blowing money. This video thus far has been the best video for someone trying to figure this out. And you like PrismaticaDev! He seems super knowledgeable and wholesome! 🙏🏻❤️🙏🏻
Liked and subscribed!
There used to be a jank oldschool optical setup where you get some PS3 Eye cameras and modify the cameras, you kick out the IR-filter lens and install an IR-pass-filter lens, you install IR ringlights on the cameras or weave sanded off IR LEDs into your costume, but i don't know if it ever was developed fully into anything you can use for puppeteering, i think the software was geared towards offline to BVH capture.
Im looking at going with the vive trackers as well for my setup, but im curious with Rokoko and PN you get finger tracking, how would you do finger tracking with a vive tracker setup?
Curious to get your thoughts on AI motion capture solutions and if you feel there's room for that in your process or others?
Are there any good ones that work live? All of the system mentions are non-retargeting solutions that work in real time. Google media pipe seems to be the only somewhat viable choice, and it's still pretty rough from everything I've seen.
In his suited environment.. . :) explaining stuff to us
nice video ❤
Just 1 out of the 4 base stations I ordered worked. The other ones were fully broken since the beginning and the last one never arrived. That’s an astronomical issue, since I own 7 trackers and the base stations are truly non existent.
The “avatar 2” from corridor shouldn’t be a benchmark, since Sam is just learning how to properly use all of this fuzz.
The best example out there I have seen is Xanadu, he uses the xscen hardware and iPhone combo.
It have been a nightmare figuring all this bs out, since I’m looking forward to make interactive games and mainly feature films with this tech. I’m currently taking UE5 courses, too bad all this information is obscure, unrealizable, and or non existent.
Devises such as meta quest pro and forward May add or change the way some things, but we will have to wait and see
If you can get on the Xsens Indie program, the software is free and renewable for up to 3 years iirc. The perpetual license for the software is insane, as much if not more than the mid-range suit. If you're a one-man studio, I don't know how you could afford this. Some resellers do offer payment programs, but I don't know how flexible it is beyond a deposit and once-off payment for the balance.
What I will say is that the fidelity of the suit is amazing. No sliding, no cleanup besides occasional penetration and it's free from magnetic interference. The Xsens Manus gloves however are prone to magnetic interference in very close proximity, even if you're holding a phone, I found out recently XD They also run via bluetooth, so even if your suit's range is 25-50m, likely your gloves won't transmit the data all the way. I don't know if there's onbody recording for the gloves and I think only the premium xsens suit has that, where you can go out of range and then come back and offload the data from the sensors.
Only downside I've had so far is that I don't have a laptop, so if I want to do a mocap session, I gotta take my whole workstation.
Do you have the lync or the Awinda?
Do you have any experiance on grabbing the capture from nintedo switch just dance? From the website it says to use a phone with the just dance app, I am a vtuber so would ned to have that data roll into unity/unreal somehow.
for me when i was searching mocap I ended up sticking with Mocap fusion a free software along with just 3 tacker 2.0 2 stations along with tundras straps an ive never had a problem. Ide say if your on budged I wouldnt go for 7 cuz so far ive gotten equal quality as 7 of them just with 3. maybe if you want range of your elbows an knees. a good pair up with them to is the vive face tracker if you want to record lip stuff an dont have a iphone
Would be great if the BGM was slightly tuned down, love the video
Thanks for the video, I wanted to buy a rokoko, but after checking a few videos I won't, I need something like plug and play, just like the iphone with face live link, and is quite decent, and neither rokoko nor x sense do that right away, and I don't need extremely accuracy neither, just decent, so a solution would be something similar to face live link (using the Lidar sensor), but capturing the body, or at least a plug and play plugin that uses a camera connected to unreal engine or anything, so one can do some live recording or streaming like I want to.
Hm, it's not possible to use Leap Motion for face tracking? I would've thought someone would've released something like that by now...
18:28 what software name mentioned here?
(i mean the software shown in the video, not megasteakman)
Hope u make it big time $
so, with the VRChat beta now allowing mocap as a tracking option, I feel this video is going to get a *lot* more views lol
right into my TRAMP STAMP lmao
i just wanted to animate and now im overwhelmed 😔
Really really nice overview of the current landscape. The thing I am trying to determine now is whether the manus pro trackers are a superior option vs the tundra labs trackers. Pricing is 300 dollars for each manus pro module which is hard to swallow, but you can't really but the tundra labs trackers and it's not clear how long they will be unable to be ordered. I'd also like to hear your insight on a lesser known tool for Unreal called Rigel which costs 500 dollars but it supports up to 10 trackers, where as manus polygon is limited to 8 trackers. Rigel also has some interesting features I have not seen anywhere else, things like adjustable real time smoothing, and self clipping. Please let me know what you think.
I see a lot of people getting hung up here. I'd say just get the vive 3.0s. It's what I use, and they're great. As far as Polygon and Rigel, I actually write my own tracking software directly in unreal, so I can grab as many trackers as I want from live link. I have realtime smoothing and I actually added customizable presets on it too. At some point I'll probably make my movement controller available somehow. But It's still a little too early.
@@WoodyDevs thank you sir for your guidance
@@tachikomaticdays1858 pro trackers come with swapable batteries. So depending on the use case pro tracker can be cheaper. For longer sessions you just need batteries which are much cheaper then an additional tracker. Also because of swapping you dont need to repair a tracker which can take a lot of time in steam.
@@3v3rhard yes I totally agree, there is a quality of life you get with the convenience of the swappable batteries and extended life per charge. I guess I just want to hear some confirmation from someone somewhere that the manus pro trackers have the best performance overall as far as low occlusion accuracy and lack of shaking vs the competing three alternative tracker options. I wish there was more info out there from people who bought into the manus pro trackers but its sparse.
@@tachikomaticdays1858 I recently bought the manus pro trackers with polygon. I can let you know how it goes if interested.
I have manus gloves and use their polygon software to use the gloves + vive trackers - as far as I can tell this is the best bang for the buck (polygon is free also!)
Which manus gloves do you have? The only prime gloves they sell now are the ones with haptics. Do you use the haptic prime x gloves?
@@archi539 no prime, same ones that work withg xsens (just with vive trackers instead)
What plug-in you use to Mocap with VIVE Tracker or did you design the blueprint yourself?
I designed it myself. I don't use it a lot these days, but I did just feature it in a recent video.
Vive trackers are expensive as hell. If you own 7 of them, isn't that almost the price of a suit?
Atleast you don't have to worry about magnets.
Hey would you still recommend spending on vibe trackers and controllers for mocap in 2024? I'm currently using psmoveservice ex and its pretty good but I hear the vive is better, while at the same time hearing its outdated and not worth it anymore... but I can't find any solutions as good for less than 1k
Hmm. It's tough to recommend vives too now. I'm gonna do a new version of this video soon. There's a lot of new cool stuff out there now.
Anyone have experience getting all the trackers for VRmocap to anchor and track consistently/repeatable without a VR headset (headless setup)?
Can you get just tundra trackers? Or do you need a vive.
You're gonna need some kind of hmd
where is the xsens rokoko comparison?
The information and explanation are very good but the music is very distracting especially because it's so loud.
Not valve index, wireless vive pro eye, and add face tracking to it.
You just helped me save a ton on my car insurance... nah, fr though this video literally just saved me time and possibly thousands of dollars on my future mocap rig. when i say future i definitely mean within the next six months. Thank you kindsir.
Happy to help!
@@WoodyDevs the greatest. i decided to go with a index, and the what was it avalance?; sensors, would it make a difference if i used just two lighthouses? if so would 3 be sufficient? id eventually just do 4 but curious anyway.
@@SkribblerStudios It has to do with how many body parts you want to track and how much you're comfortable estimating.
You also might want to figure out what software you want to use.
@@WoodyDevs well i plan to mostly use the mo cap portion for game dev. Ill start lookin here soon. thanks for all the tips and advice! i wont bother you....TOO much more haha.
I used Vive Trackers and my own solution for Unity to record pretty much every animation in a story-driven game - Best Month Ever. Having said that, I've bought Noitom Perception Neuron Studio for my next project :). So far, I like it a lot (it's like XSENS, but half the price, and you don't pay for the software).
Are you a member of our discord? I’d love to hear more about this project! Sounds cool :)
@@WoodyDevs Joining now :)
Hey Maciej, are you still happy with Perception Neuron after 4+ months? Would you recommend it over Rokoko?
@@LaurynasSFM Hey! Yeah, Perception Neuron Studio is my "primary mocap" (for games). I was able to record stuff like climbing and parkour. Obviously, you still need to edit the animations after recording (but that is true for all mocap solutions).
@@mszczesnikso you were able to connect your vive trackers with perception neuron?
Ta'boot? Haha he is such a character!
I have no experience in this, was just looking at what is out there for cheap setups for animation and I am surprised that the suggested way is to use around 7 trackers on body that end up being (say for tundra) 480$ + 360 + straps 156(38 belt + 35 feet + 45 limbs + 38 arms) so $996 without head tracking or elbow bending/hands unless you have gloves/vr equip already? I would have thought buying a bunch of cameras to put around you on stands would be more accurate for the whole body and more comfortable, than over a grand and be reliant on batteries and pay extra $100-200 for added points? I thought webcam based software was making a lot of the suits redundant, I just watched a video on using a $20 kinect controller but had limitations on body parts out of camera view, seems like there should be a lot of options inbetween the $20 kinect and the $1000-3000 suits?
I’m actually looking into some of those solutions right now. You’re right that there are cheaper options that use these techniques. Pretty much none of those solutions work in real-time currently. Google media pipe is one exception. For me, the ability to do real-time mocap is a must. So that’s why this list was culled the way it was. I haven’t rewatched this video in a while, but I think I talked about this a little bit. There’s plenty of great mocap solutions at all price ranges for people who don’t mind doing clean up, or applying the mocap in traditional animation workflows.
@@WoodyDevs awesome thanks for the reply, yea I think cleanup factor is less worrying to me and definitely don't need the live part hadn't thought of that benefit in the prices, i am just interested in ways to help speed up animation creation
@@hughmcgown Makes total sense. A lot of people who follow this channel are interested in the vtubing style of animation. And that's a big part of my priorities too. I think at some point I'll talley up a more animator friendly list.
@@WoodyDevs Mediapipe if setup correctly it can provide a good live streaming finger/arm/hand mocap. It's not perfect or high end mocap quality, but for live streaming and Vtubing it's very easy to setup and good enough since no suits/trackers/sensors are needed. Just need an iphone and a regular HD webcam and you have your upper body/arms/hands/fingers/face working pretty decently. It's working in Unity currently for me.
SD wants $1200 for the headmount? Does it fold the laundry too?
I have the SD headmount. In the end you get what you pay for. After trying to diy the SD helmet was definitely the way to go. It’s a little uncomfortable but more comfortable than others and it just works.
How about perception neuron?
Great question! I actually did a whole interview with a friend who uses it. Unfortunately I had to cut it for time!
Great content, but your animation was a bit Willy Wonka with your elbows looking like you're airing out your armpits. You could fix that with changing the table height to look like your arms are resting on the table.
lol....
Are there any decent software for full body motion capture using Vive?
Check out VR Mocap from Megasteakman!
Polygon by manus
Thanks for the video, but the backgroundmusic is to loud and very repetitive.
am shit at animating, searching for ways to make nice looking animations easily with mo-cap, let's see.
The music is too loud, man.
Does Mocap make sense for SFM2
It makes sense for anything. S2FM, UE5, Blender etc.
@@LaurynasSFM thank you
Don't buy tundra trackers they have alot of tracking issues
what a joke FaceCam iPhone HMC 1200 bucks!! ? i rather use that money on a full bod suit then just a head mount i might use maybe 50 precent of the time
none animate yourself