Justus Thies
Justus Thies
  • 32
  • 49 003

วีดีโอ

Joker: Conditional 3D Head Synthesis with Extreme Facial Expressions (3DV 2025)
มุมมอง 73หลายเดือนก่อน
We introduce Joker, a new method for the conditional synthesis of 3D human heads with extreme expressions. Given a single reference image of a person, we synthesize a volumetric human head with the reference identity and a new expression. We offer control over the expression via a 3D morphable model (3DMM) and textual inputs. This multi-modal conditioning signal is essential since 3DMMs alone f...
GEM: Gaussian Eigen Models for Human Heads
มุมมอง 2.4K5 หลายเดือนก่อน
Project page: zielon.github.io/gem/
HAAR: Text-conditioned Generative Model of 3D Strand-based Human Hairstyles (CVPR 2024)
มุมมอง 1.7Kปีที่แล้ว
Project page: haar.is.tue.mpg.de/
360° Volumetric Portrait Avatars (GCPR 2024)
มุมมอง 1.1Kปีที่แล้ว
jalees018.github.io/3VP-Avatar/
D3GA: Drivable 3D Gaussian Avatars (3DV 2025)
มุมมอง 9Kปีที่แล้ว
We present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the r...
3DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing (ArXiv)
มุมมอง 1.2Kปีที่แล้ว
balamuruganthambiraja.github.io/3DiFACE/
GAN-Avatar: Controllable Personalized GAN-based Human Head Avatars (3DV 2024)
มุมมอง 2.5Kปีที่แล้ว
Project page: ganavatar.github.io/
Imitator: Personalized Speech-driven 3D Facial Animation (ICCV 2023)
มุมมอง 3.2Kปีที่แล้ว
Speech-driven 3D facial animation has been widely explored, with applications in gaming, character animation, virtual reality, and telepresence systems. State-of-the-art methods deform the face topology of the target actor to sync the input audio without considering the identity-specific speaking style and facial idiosyncrasies of the target actor, thus, resulting in unrealistic and inaccurate ...
DINER: Depth-aware Image-based NEural Radiance fields (CVPR 2023 - Presentation)
มุมมอง 192ปีที่แล้ว
DINER: Depth-aware Image-based NEural Radiance fields (CVPR 2023 - Presentation)
DINER: Depth-aware Image-based NEural Radiance fields (CVPR 2023)
มุมมอง 1Kปีที่แล้ว
We present Depth-aware Image-based NEural Radiance fields (DINER). Given a sparse set of RGB input views, we predict depth and feature maps to guide the reconstruction of a volumetric scene representation that allows us to render 3D objects under novel views. Specifically, we propose novel techniques to incorporate depth information into feature fusion and efficient scene sampling. In compariso...
High-Res Facial Appearance Capture from Polarized Smartphone Images [CVPR2023]
มุมมอง 358ปีที่แล้ว
We propose a novel method for high-quality facial texture reconstruction from RGB images using a novel capturing routine based on a single smartphone which we equip with an inexpensive polarization foil. Specifically, we turn the flashlight into a polarized light source and add a polarization filter on top of the camera. Leveraging this setup, we capture the face of a subject with cross-polariz...
INSTA: Instant Volumetric Head Avatars (CVPR 2023)
มุมมอง 8Kปีที่แล้ว
For immersive telepresence in AR or VR, we aim for digital humans (avatars) that mimic the motions and facial expressions of the actual subjects participating in a meeting. Besides the motion, these avatars should reflect the human's shape and appearance. Instead of prerecorded, old avatars, we aim to instantaneously reconstruct the subject's look to capture the actual appearance during a meeti...
Neural Head Avatars from Monocular RGB Videos [CVPR2022]
มุมมอง 1.2K2 ปีที่แล้ว
We present Neural Head Avatars, a novel neural representation that explicitly models the surface geometry and appearance of an animatable human avatar using a deep neural network. Specifically, we propose a hybrid representation consisting of a morphable model for the coarse shape and expressions of the face, and two feed-forward networks, predicting vertex offsets of the underlying mesh as wel...
MICA: Towards Metrical Reconstruction of Human Faces [ECCV2022]
มุมมอง 6K2 ปีที่แล้ว
Face reconstruction and tracking is a building block of numerous applications in AR/VR, human-machine interaction, as well as medical applications. Most of these applications rely on a metrically correct prediction of the shape, especially, when the reconstructed subject is put into a metrical context (i.e., when there is a reference object of known size). A metrical reconstruction is also need...
Neural Capture & Synthesis Group Teaser
มุมมอง 1162 ปีที่แล้ว
Neural Capture & Synthesis Group Teaser
NerFACE: Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction
มุมมอง 1.6K4 ปีที่แล้ว
NerFACE: Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction
Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction
มุมมอง 1264 ปีที่แล้ว
Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction
Neural Non Rigid Tracking
มุมมอง 3244 ปีที่แล้ว
Neural Non Rigid Tracking
CycleFace: Face-swapping using CycleGAN in Texture Space
มุมมอง 8904 ปีที่แล้ว
CycleFace: Face-swapping using CycleGAN in Texture Space
3D Neural Textures
มุมมอง 2404 ปีที่แล้ว
3D Neural Textures
Neural Voice Puppetry: Audio-driven Facial Reenactment
มุมมอง 1.7K4 ปีที่แล้ว
Neural Voice Puppetry: Audio-driven Facial Reenactment
IMU2Face: Real-time Gesture-driven Facial Reenactment
มุมมอง 1514 ปีที่แล้ว
IMU2Face: Real-time Gesture-driven Facial Reenactment
IGNOR: Image-guided Neural Object Rendering
มุมมอง 1954 ปีที่แล้ว
IGNOR: Image-guided Neural Object Rendering
Deferred Neural Rendering: Image Synthesis using Neural Textures
มุมมอง 1.1K4 ปีที่แล้ว
Deferred Neural Rendering: Image Synthesis using Neural Textures
HeadOn: Real-time Reenactment of Human Portrait Videos
มุมมอง 1714 ปีที่แล้ว
HeadOn: Real-time Reenactment of Human Portrait Videos
FaceForensics++: Learning to Detect Manipulated Facial Images
มุมมอง 3504 ปีที่แล้ว
FaceForensics : Learning to Detect Manipulated Facial Images
FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality
มุมมอง 1614 ปีที่แล้ว
FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality
FaceForge: Markerless Non-Rigid Face Multi-Projection Mapping
มุมมอง 5024 ปีที่แล้ว
FaceForge: Markerless Non-Rigid Face Multi-Projection Mapping
Face2Face: Real-time Face Capture and Reenactment of RGB Videos
มุมมอง 2.6K4 ปีที่แล้ว
Face2Face: Real-time Face Capture and Reenactment of RGB Videos

ความคิดเห็น

  • @李飛飛大燒B
    @李飛飛大燒B 15 วันที่ผ่านมา

    0:30 bro they whitewashed obama

  • @vanyakapetanovic4018
    @vanyakapetanovic4018 3 หลายเดือนก่อน

    That's all cool but how do you do this? What's the site or the app?

  • @maartenn165
    @maartenn165 4 หลายเดือนก่อน

    This is amazing work. Is the goal to replace the previous techniques? Where you take photos of your face from 3 sides and a generated 3d head with blendshapes will be created. The head attached to a body is the result so that it can be used in games / experiences. Do you think that will be a possibility? Will blendshapes be possible with this technique?

  • @calabasas-h1
    @calabasas-h1 5 หลายเดือนก่อน

    Hey. Read that you were able to achieve over 200fps in some cases, this being on one a100 gpu. Would multiple gpus make a difference in the speed? It's plenty fast right now for real time generation for low quality images, but it still hits a limit at let's say 1024 by 1024.

  • @ivansivakART
    @ivansivakART 5 หลายเดือนก่อน

    This sounds very promising! <3 I'm an artist playing around with LivePortrait at the moment and while I'm loving the results I am very aware of the limitations, and your method looks even more powerful, congrats! Any idea when we'll be able to try out your tech?

  • @fontenbleau
    @fontenbleau 5 หลายเดือนก่อน

    it's what i'm searching for to reconstruct face of deceased relatives which we need on gravestone, there's a problem when only one photo from person saved which can be damaged/bad/one sided, the problem will be global and worse because of mass decay of digital media by time, i mentioned example with physical photo sample, really don't know what people could save in future about their relatives looking

  • @cancelz
    @cancelz 5 หลายเดือนก่อน

    you should check out Deferred Diffusion for High-fidelity 3D Head Avatars it would be amazing to see the comparison

  • @thegoat-os1ic
    @thegoat-os1ic 8 หลายเดือนก่อน

    i want dataset. how to download that dataset, can u help me?

  • @itxtayab001
    @itxtayab001 11 หลายเดือนก่อน

    when will you release the code?

  • @briancunning423
    @briancunning423 11 หลายเดือนก่อน

    Any update on the source code?

  • @kimberlyfrancis2626
    @kimberlyfrancis2626 ปีที่แล้ว

    When will the source code released

  • @tomasjony8910
    @tomasjony8910 ปีที่แล้ว

    hi can u share D3GA code or links to provide it ?? and thank u

  • @kimberlyfrancis2626
    @kimberlyfrancis2626 ปีที่แล้ว

    Where can we find source code please

  • @BUY_YOUTUBE_VIEWS_g0g15
    @BUY_YOUTUBE_VIEWS_g0g15 ปีที่แล้ว

    I showed this to my cat. Now he thinks he's the star of the show

  • @kingskye7110
    @kingskye7110 ปีที่แล้ว

    Can anyone successfully run the code provided on github?

  • @赵云来
    @赵云来 ปีที่แล้ว

    Will you release the code

  • @autonate_ai
    @autonate_ai ปีที่แล้ว

    So how do I get my face into this system? Just download the code and upload my picture then wait? Also, how can I get it to speak my recorded voiceovers?

  • @hayderia110
    @hayderia110 2 ปีที่แล้ว

    Where can I get this software?

  • @kmillight
    @kmillight 2 ปีที่แล้ว

    Hi, I'm very interested by your solution for a theater company show. Is this possible to get your code or soft somewhere ? Thanks in advance. Camille COTINEAU

  • @joelkaiser6127
    @joelkaiser6127 2 ปีที่แล้ว

    Brilliant! Just brilliant. Great work as always, Thies

  • @ghaznavipc
    @ghaznavipc 2 ปีที่แล้ว

    4:33 can you generalize the mouth position but be Person-specific in expressions? it seems in your method after generalizing, A.I. fear to open mouth enough. it average mouth movements and delete expression and feelings. because every person may have specific feeling in words that others don't have... person specific had better expression but it jitters in the mouth section a lot.

  • @ntweat
    @ntweat 3 ปีที่แล้ว

    Code?

  • @ifgcguitarclub1395
    @ifgcguitarclub1395 3 ปีที่แล้ว

    is it on github codes ?? thanks

  • @chr0my134
    @chr0my134 3 ปีที่แล้ว

    this is literally the definition of putting words in my mouth lol. keep it up!

  • @chr0my134
    @chr0my134 3 ปีที่แล้ว

    umm, this is history right here guys. just letting you know lmao.

  • @diyasaxena9956
    @diyasaxena9956 3 ปีที่แล้ว

    Pl tell how to approach u