Yanjie Ze
Yanjie Ze
  • 3
  • 1 704
Generalizable Humanoid Manipulation with Improved 3D Diffusion Policies
Humanoid robots capable of autonomous operation in diverse environments have long been a goal for roboticists. However, autonomous manipulation by humanoid robots has largely been restricted to specific scenarios, primarily due to the difficulty of acquiring generalizable skills. Recent advances in 3D visuomotor policies, such as the 3D Diffusion Policy (DP3), have shown promise in extending these capabilities to wilder environments. However, 3D visuomotor policies often rely on camera calibration and point cloud segmentation, which present challenges for deployment on mobile robots like humanoids. In this work, we introduce the Improved 3D Diffusion Policy (iDP3), a novel 3D visuomotor policy that eliminates these constraints by leveraging egocentric 3D visual representations. We demonstrate that iDP3 enables a full-sized humanoid robot to autonomously perform skills in diverse real-world scenarios, using only data collected in the lab.
มุมมอง: 830

วีดีโอ

GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fields
มุมมอง 539ปีที่แล้ว
CoRL 2023 Oral
Visual Reinforcement Learning with Self-Supervised 3D Representations
มุมมอง 4152 ปีที่แล้ว
Visual Reinforcement Learning with Self-Supervised 3D Representations

ความคิดเห็น

  • @ChuckBaggett
    @ChuckBaggett 10 วันที่ผ่านมา

    How much is this sped up?

    • @yanjieze
      @yanjieze 10 วันที่ผ่านมา

      4x. the not accelated video actually looks good (but would be too long to watch)

  • @EzekielBublicalProphet2018
    @EzekielBublicalProphet2018 ปีที่แล้ว

    Hello!