NVIDIA Omniverse Audio2Face 2023.2.0 with a MetaHuman (in Unreal 5.3)

NVIDIA Omniverse Audio2Face has definitely improved! These results are with "2023.2.0".
But I find that it still struggles with the Australian accent. Still, it's much much better (with Australian accents) than iClone's AccuLips, which unfortunately doesn't work at all.
HOW WAS THIS CAPTURED?
This was captured using Omniverse Audio2Face which is a part of Omniverse Launcher, a free program by Nvidia.
I streamed the data to Unreal 5.3 (because there's not a UE5.4 version yet). The animation was recorded inside Unreal using the TAKE RECORDER, then I exported the result using the Movie Render Queue.
I then had to unite that video render with the original audio in Adobe Premiere, and output a movie from that.
DID YOU ADD ANY KEYFRAMES?
There is NO cleanup of the lipsync. So this could easily be improved by adding some extra keyframes in Sequencer!
HOW DO I INSTALL OMNIVERSE AND TRY THIS MYSELF?
You can follow the instructions on this page:
docs.omniverse.nvidia.com/ins...
It's really easy. Just install the OMNIVERSE LAUNCHER - everything has to then be installed FROM that Omniverse Launcher! Audio2Face is available only within that program.
HOW DO I INSTALL AUDIO2FACE PLUGIN FOR UNREAL?
You have to manually install it. It is included in the files that install with Omniverse Launcher, but is somewhat hidden. It will be somewhere bizarre like this:
C:\Users\YOURUSERNAME\AppData\Local\ov\pkg\deps\b9070d65cb1908ec472cf47bc29f8126\ue-plugins\audio2face-ue-plugins

[@BabylonBaller]

This is sort of like when a ventriloquist controls a puppet, you see the puppet's mouth somewhat moving but the voice just doesn't match it LOL

[@virtualfilmer]

😂 so true

[@opsxp23]

It's good but there's still this lag or maybe the face isn't expressive enough. Head and body motion would help a lot too. That's proly were machinima would come in

[@virtualfilmer]

Yeah I reckon maybe in another year they will improve it to a good cinematic quality. But for now it’s very rough, in my opinion :)