MetaHuman Animator to iClone 8 to Unreal Engine 5.2 test
ฝัง
- เผยแพร่เมื่อ 14 ส.ค. 2023
- Just a quick test, not perfect yet! I'm working on iClone 8 plugins that import MetaHuman Animator animation and then process it/adjust it. Then you render the result inside Unreal Engine 5.2
====== HOW WAS THIS DONE? ========
I recorded this with my iPhone 14 Pro Max, using Epic Games' LIVE LINK FACE app, set to 'MetaHuman Animator' mode. I then transfered the result clip to my PC. Then I changed my voice using ALTERED.AI to be the elderly lady's voice.
I then imported it into Unreal Engine 5.2.1 and processed it with MetaHuman Animator.
Then I exported it from Unreal as a CSV, using my “metahumanface2csv” script. Then I imported the csv into iClone 8 using my “Face Animation Importer” plugin for iClone 8. Then I used my “Performance Magik” iClone 8 plugin to reduce the ‘mouth overhang’ visual problems.
The words are from a public domain novel, "Strange Case of Dr Jekyll and Mr Hyde".
This pipeline is ONLY for rendering your final pixels (ie. video) inside Unreal Engine. It cannot be used to render final video pixels in any other way.
================================ - ภาพยนตร์และแอนิเมชัน
FINALLY! :-) A new version of the plugin, supporting MetaHuman Animator, is now available as of August 20, 2023. You can download it by signing up for the Beta program at "virtualfilmer.com".
Hey Toby. I'm back from holidays and can't wait for testing all these new stuffs. Thank you again buddy, love your work
That’s great charly! Hope you had a great vacation :)
I'd appreciate it if you could demonstrate to us how you would fix imperfections from the lite version of this plugin. It would help us who couldn't afford to buy the pro version yet.
That’s a fantastic idea! I’ll try to work on one. Thanks!
Crazy I love it!
I have try MHA in iclone with your plugin, with your CSV and Mine too, when letter P is pronunced, mouth is creepy, lips are exagerated outside face, how can I fix it?
The rest is very good!!!
Hi mate! You need to run PERFORMANCE MAGIK after you run the FACE ANIMATION IMPORTER. This is because “face animation importer” is raw data, and it’s too exaggerated for iClone. Performance Magik has an algorithm that adjusts it.
Thumbs Up👍👍
Thanks 👍
If you could make a full tutorial, I'd really appreciate it. All I want is to take everything from iClone including characters, set, and props but have the face be animated using MetaHuman Animator.
Do you mean you want to end up rendering in iClone, or rendering in unreal? And where do you want to animate everything (aside from the face) - iClone or unreal? The best option sounds like you should record your face animation with the LiveLink Face app on iphone, set to metahuman animator mode, and make sure you record “calibration poses” (look left, look right, bare your teeth). Then in unreal, process the metahuman animator animation, then use the special python script that comes with my plugin “Face Animation Importer” to export the face animatjon to iClone, then import the raw facial animation into iClone with “Face Animation Importer”, and then use my plugin “Performance Magik” to adjust the raw facial animation to remove lip overlap etc etc. Then animate everything in the scene as you like. And the final step would be to transfer everything to unreal. There are lots of instructions about all of the above process on my site, if it helps: virtualfilmer.com/iclone-plugins/
@@virtualfilmer Metahuman Animator caught my eye recently but I actually don't know anything about Unreal so it'd be great if I could just learn how to do the face animation there but render everything in iClone in the end.