![The Art Of Victory](/img/default-banner.jpg)
- 5
- 17 862
The Art Of Victory
เข้าร่วมเมื่อ 27 ต.ค. 2021
Hey I'm Victor and I'm a technical animator. Thanks for visiting my channel where I share about some of the things that I've been working on :)
LiveLink Face calibration tool Puppeteer refactored - easier to setup with MetaHuman
As my first step of coming back to this project, I've refactored Puppeteer so it's a lot easier to use.
There are way fewer steps for setting things up.
In summary:
1. Download the plugin from github.com/ViktroNZ/Puppeteer
2. Extract it into [YourProject]/Plugins/ folder
3. Add the PuppeteerManager Actor into the level (can be placed anywhere)
4. Add a reference to the MetaHuman within the PuppeteerManager
5. On the MetaHuman Actor in the level, set the Face Component's AnimBP to be Puppeteer_AnimBP
6. Connect your iPhone to LiveLink (you'll need to set the IP address in your LiveLink iPhone App to the IP address of your computer)
7. Set the LiveLink Subject in the PuppeteerManager to your iPhone
I did a brief try of using the Take Recorder with this setup, but adding the MetaHuman to the tracks caused some conflict with the AnimBP or something - because the LiveLink stopped driving the rig. Something to debug later. Open to suggestions if anybody knows what might be happening.
The tracking was pretty poor, but I was doing this in the evening with low light.
On another note, I'm thinking about how this fits in with MetaHuman Animator. I haven't had a chance to have a play with that yet - but will have a better idea once I've had a play.
I expect Puppeteer might be best used in real time situations where you're doing a live stream or perhaps in virtual production/pre-vis? Curious to know what people think - as it doesn't feel like offline animation work is a good use of Puppeteer.
Thanks for your support :)
There are way fewer steps for setting things up.
In summary:
1. Download the plugin from github.com/ViktroNZ/Puppeteer
2. Extract it into [YourProject]/Plugins/ folder
3. Add the PuppeteerManager Actor into the level (can be placed anywhere)
4. Add a reference to the MetaHuman within the PuppeteerManager
5. On the MetaHuman Actor in the level, set the Face Component's AnimBP to be Puppeteer_AnimBP
6. Connect your iPhone to LiveLink (you'll need to set the IP address in your LiveLink iPhone App to the IP address of your computer)
7. Set the LiveLink Subject in the PuppeteerManager to your iPhone
I did a brief try of using the Take Recorder with this setup, but adding the MetaHuman to the tracks caused some conflict with the AnimBP or something - because the LiveLink stopped driving the rig. Something to debug later. Open to suggestions if anybody knows what might be happening.
The tracking was pretty poor, but I was doing this in the evening with low light.
On another note, I'm thinking about how this fits in with MetaHuman Animator. I haven't had a chance to have a play with that yet - but will have a better idea once I've had a play.
I expect Puppeteer might be best used in real time situations where you're doing a live stream or perhaps in virtual production/pre-vis? Curious to know what people think - as it doesn't feel like offline animation work is a good use of Puppeteer.
Thanks for your support :)
มุมมอง: 807
วีดีโอ
I'm back! Puppeteer development resumes!
มุมมอง 63ปีที่แล้ว
I unexpectedly received a MegaGrant and now I'm back to finish what I started. Watch this space!
How does the Puppeteer UE5 plugin work?
มุมมอง 1.6K2 ปีที่แล้ว
A few weeks ago I shared a little tool I created for improving the ARKit Live Link face tracking for the Metahuman rigs in UE5. It's not fully complete and not the way I would normally want to document something - but hey, I wasn't going to do more and thought someone might find it useful or apply some of the ideas from it. I thought I better put together a video explaining how some of the blue...
(Super) Quick instructions for Puppeteer setup
มุมมอง 7K2 ปีที่แล้ว
I made a tool to try and improve the performance I could get out of UE5 Live Link Face with Metahuman and here's the instructions on how to get it set up in your own project. Here's the video demoing it as a comparison with the default setup, with terrible audio: th-cam.com/video/eBxuJmxkrSY/w-d-xo.html And a video explaining how the blueprints work: th-cam.com/video/fC3UHKr0Wpg/w-d-xo.html And...
A tool for improving Live Link Face with Metahumans in UE5
มุมมอง 9K2 ปีที่แล้ว
The Live Link Face tracking can be a bit noisy and miss some of the shapes. It's particularly bad at speech shapes - but I haven't done anything about that yet. I created a tool and some inference logic to improve the output and this is an early look at it. Edit: Please excuse the horrendous audio quality. I made this video prior to getting a proper mic! Unreal documentation: docs.unrealengine....