OMRON SINIC X
OMRON SINIC X
  • 44
  • 35 809
Comp-ACT: Learning Variable Compliance Control From a Few Demonstrations
Abstract: Automating dexterous, contact-rich manipulation tasks using rigid robots is a significant challenge in robotics. Rigid robots, defined by their actuation through position commands, face issues of excessive contact forces due to their inability to adapt to contact with the environment, potentially causing damage. While compliance control schemes have been introduced to mitigate these issues by controlling forces via external sensors, they are hampered by the need for fine-tuning task-specific controller parameters. Learning from Demonstrations (LfD) offers an intuitive alternative, allowing robots to learn manipulations through observed actions. In this work, we introduce a novel system to enhance the teaching of dexterous, contact-rich manipulations to rigid robots. Our system is twofold: firstly, it incorporates a teleoperation interface utilizing Virtual Reality (VR) controllers, designed to provide an intuitive and cost-effective method for task demonstration with haptic feedback. Secondly, we present Comp-ACT (Compliance Control via Action Chunking with Transformers), a method that leverages the demonstrations to learn variable compliance control from a few demonstrations. Our methods have been validated across various complex contact-rich manipulation tasks using single-arm and bimanual robot setups in simulated and real-world environments, demonstrating the effectiveness of our system in teaching robots dexterous manipulations with enhanced adaptability and safety.
Project Page: omron-sinicx.github.io/CompACT
ArXiv: arxiv.org/abs/2406.14990
มุมมอง: 683

วีดีโอ

Integrated Task and Motion Planning for Real-World Cooking Tasks(ICRA2024 Cooking Robotics Workshop)
มุมมอง 326หลายเดือนก่อน
To fully realize robots in household environments, robots would need to be able to plan and execute a variety of tasks autonomously. However, task and motion planning for multi-step manipulation tasks is still an open challenge in robotics, particularly for long-horizon tasks in dynamic environments. This work proposes an integrated task and motion planning (TAMP) robotic framework for real-wor...
Symmetry-aware Reinforcement Learning for Robotic Assembly under Partial Observability
มุมมอง 3623 หลายเดือนก่อน
This study tackles the representative yet challenging contact-rich peg-in-hole task of robotic assembly, using a soft wrist that can operate more safely and tolerate lower-frequency control signals than a rigid one. Previous studies often use a fully observable formulation, requiring external setups or estimators for the peg-to-hole pose. In contrast, we use a partially observable formulation a...
An Electromagnetism-Inspired Method for Estimating In-Grasp Torque from Visuotactile Sensors
มุมมอง 3113 หลายเดือนก่อน
Tactile sensing has become a popular sensing modality for robot manipulators, due to the promise of providing robots with the ability to measure the rich contact information that gets transmitted through its sense of touch. Among the diverse range of information accessible from tactile sensors, torques transmitted from the grasped object to the fingers through extrinsic environmental contact ma...
Benchmarking Actor-Critic DRL Algorithm for Robotics Control with Action Constraints (ICRA 2024)
มุมมอง 1413 หลายเดือนก่อน
A presentation video for "Benchmarking Actor-Critic Deep Reinforcement Learning Algorithm for Robotics Control with Action Constraints" in ICRA 2024 Project Page: omron-sinicx.github.io/action-constrained-RL-benchmark/ Paper: ieeexplore.ieee.org/document/10146410 github: github.com/omron-sinicx/action-constrained-RL-benchmark
Crystalformer: Infinitely Connected Attention for Periodic Structure Encoding (ICLR 2024)
มุมมอง 3644 หลายเดือนก่อน
Crystalformer: Infinitely Connected Attention for Periodic Structure Encoding Tatsunori Taniai, Ryo Igarashi, Yuta Suzuki, Naoya Chiba, Kotaro Saito, Yoshitaka Ushiku, and Kanta Ono In The Twelfth International Conference on Learning Representations (ICLR 2024) Paper: openreview.net/forum?id=fxQiecl9HB Project page: omron-sinicx.github.io/crystalformer/
SliceIt! - A Dual Simulator Framework for Learning Robot Food Slicing.
มุมมอง 2534 หลายเดือนก่อน
Abstract: Cooking robots can enhance the home experience by reducing the burden of daily chores. However, these robots must perform their tasks dexterously and safely in shared human environments, especially when handling dangerous tools such as kitchen knives. This study focuses on enabling a robot to autonomously and safely learn food-cutting tasks. More specifically, our goal is to enable a ...
ViLaIn: Vision-Language Interpreter for Robot Task Planning (ICRA2024)
มุมมอง 5514 หลายเดือนก่อน
A movie presentation for "Vision-Language Interpreter for Robot Task Planning," ICRA2024. [paper] arxiv.org/abs/2311.00967 [github] github.com/omron-sinicx/ViLaIn
Swarm Body: Embodied Swarm Robots (Video Preview, 30sec)
มุมมอง 554 หลายเดือนก่อน
Sosuke Ichihashi, So Kuroki, Mai Nishimura, Kazumi Kasaura, Takefumi Hiraki, Kazutoshi Tanaka, and Shigeo Yoshida. 2024. Swarm Body: Embodied Swarm Robots. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11-16, 2024, Honolulu, HI, USA. ACM, New York, NY, USA, 19 pages. doi.org/10.1145/3613904.3642870 Preprint (arxiv) arxiv.org/abs/2402.15830 Abstract Th...
Swarm Body: Embodied Swarm Robots
มุมมอง 1.2K4 หลายเดือนก่อน
Sosuke Ichihashi, So Kuroki, Mai Nishimura, Kazumi Kasaura, Takefumi Hiraki, Kazutoshi Tanaka, and Shigeo Yoshida. 2024. Swarm Body: Embodied Swarm Robots. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11-16, 2024, Honolulu, HI, USA. ACM, New York, NY, USA, 19 pages. doi.org/10.1145/3613904.3642870 Preprint (arxiv) arxiv.org/abs/2402.15830 Abstract Th...
LfDT: Learning Dual-Arm Manipulation from Demonstration Translated from a Human and Robotic Arm
มุมมอง 2329 หลายเดือนก่อน
M. Kobayashi, J. Yamada, M. Hamaya, K. Tanaka, ``LfDT: Learning Dual-Arm Manipulation from Demonstration Translated from a Human and Robotic Arm,'' The 2023 IEEE-RAS International Conference on Humanoid Robots (Humanoids 2023), 2023.
Reference-based Dense Pose Estimation via Partial 3D Point Cloud Matching
มุมมอง 1899 หลายเดือนก่อน
ACM Multimedia 2023 Demo Track Paper.
When to Replan? An Adaptive Replanning Strategy for Autonomous Navigation
มุมมอง 23010 หลายเดือนก่อน
paper: arxiv.org/abs/2304.12046
Learning Robotic Assembly by Leveraging Physical Softness and Tactile Sensing
มุมมอง 68910 หลายเดือนก่อน
Learning Robotic Assembly by Leveraging Physical Softness and Tactile Sensing
Learning Robotic Powder Weighing from Simulation for Laboratory Automation
มุมมอง 48110 หลายเดือนก่อน
Learning Robotic Powder Weighing from Simulation for Laboratory Automation
Robotic Powder Grinding with Audio-Visual Feedback for Laboratory Automation in Materials Science
มุมมอง 41610 หลายเดือนก่อน
Robotic Powder Grinding with Audio-Visual Feedback for Laboratory Automation in Materials Science
(IJCV) View Biridification in the Crowd: Ground-Plane Localization from Perceived Movements
มุมมอง 97ปีที่แล้ว
(IJCV) View Biridification in the Crowd: Ground-Plane Localization from Perceived Movements
Robotic Powder Grinding with a Soft Jig for Laboratory Automation in Material Science
มุมมอง 358ปีที่แล้ว
Robotic Powder Grinding with a Soft Jig for Laboratory Automation in Material Science
ViewBirdiformer: Learning to recover crowd trajectories and ego-motion from an ego-centric view
มุมมอง 203ปีที่แล้ว
ViewBirdiformer: Learning to recover crowd trajectories and ego-motion from an ego-centric view
Learning Food Picking without Food: Fracture Anticipation by Breaking Reusable Fragile Objects
มุมมอง 210ปีที่แล้ว
Learning Food Picking without Food: Fracture Anticipation by Breaking Reusable Fragile Objects
[Presentation] Learning Food Picking without Food
มุมมอง 67ปีที่แล้ว
[Presentation] Learning Food Picking without Food
Risk-aware Path Planning for Planetary Rovers on Heterogeneous Terrains (ICRA 2023)
มุมมอง 296ปีที่แล้ว
Risk-aware Path Planning for Planetary Rovers on Heterogeneous Terrains (ICRA 2023)
Presentation: Twist Snake (ICRA2023)
มุมมอง 316ปีที่แล้ว
Presentation: Twist Snake (ICRA2023)
Twist Snake: Plastic table-top cable-driven robotic arm with all motors located at the base link
มุมมอง 16Kปีที่แล้ว
Twist Snake: Plastic table-top cable-driven robotic arm with all motors located at the base link
Simulation: learning robotic contact juggling
มุมมอง 81ปีที่แล้ว
Simulation: learning robotic contact juggling
Presentation: Learning Robotic Contact Juggling
มุมมอง 112ปีที่แล้ว
Presentation: Learning Robotic Contact Juggling
Body of a high-speed anthropomorphic table-tennis robot with a linkage mechanism
มุมมอง 3Kปีที่แล้ว
Body of a high-speed anthropomorphic table-tennis robot with a linkage mechanism
TRANS-AM: Transfer Learning by Aggregating Dynamics Models for Soft Robotic Assembly
มุมมอง 70ปีที่แล้ว
TRANS-AM: Transfer Learning by Aggregating Dynamics Models for Soft Robotic Assembly
A Compact, Cable driven, Activatable Soft Wrist with Six Degrees of Freedom for Assembly Tasks
มุมมอง 255ปีที่แล้ว
A Compact, Cable driven, Activatable Soft Wrist with Six Degrees of Freedom for Assembly Tasks
Quasistatic contact-rich manipulation via linear complementarity quadratic programming (IROS 2022)
มุมมอง 300ปีที่แล้ว
Quasistatic contact-rich manipulation via linear complementarity quadratic programming (IROS 2022)

ความคิดเห็น

  • @nikbivation
    @nikbivation 3 หลายเดือนก่อน

    this is amazing an relatively simple, with good performance, thank you for this!

  • @paulharvey6719
    @paulharvey6719 4 หลายเดือนก่อน

    yes!!!

  • @wintermute_2501
    @wintermute_2501 5 หลายเดือนก่อน

    I want to see a fully functional humanoid robot comprised of a single torso unit with 50 servo motors, and all movement cable driven. I believe you are almost there! #stringbot

  • @oskarzielinski4928
    @oskarzielinski4928 5 หลายเดือนก่อน

    Amazing, I was searching to see if someone has done this! Very cool to see it working.

  • @AESETC
    @AESETC 9 หลายเดือนก่อน

    Duel-Arm Manipulation is an excellent advent of cutting edge robotics, and aligns with the caliber of developments in this Nexus Phase of current Robotics.

  • @wurstelei1356
    @wurstelei1356 10 หลายเดือนก่อน

    Hi, nice robotic arm. I made one with a similar principle, but it looks completely different. May I ask, if the source code is available and how you did the inverse kinematics ?

  • @kristine8338
    @kristine8338 ปีที่แล้ว

    My kittens are learning to climb in a tree and to descend from it. What a time to be alive.

  • @thomas10017
    @thomas10017 2 ปีที่แล้ว

    both links dead

  • @MaksymCzech
    @MaksymCzech 2 ปีที่แล้ว

    Nice!

  • @troposferaxyz
    @troposferaxyz 3 ปีที่แล้ว

    Nice work! I'm really interested in this! There is a way that we can talk about this project? It's possible to capture more complex maneuvers? There is a way that we can collaborate in some way? Thanks for your time! Keep Juggling Dídac

    • @omronsinicx9931
      @omronsinicx9931 3 ปีที่แล้ว

      We plan on releasing an OpenAI gym environment to learn more complex maneuvers. Feel free to email us with details on your ideas for collaboration!

    • @frycomfort4002
      @frycomfort4002 3 ปีที่แล้ว

      @@omronsinicx9931 Thank you. But I have not yet found a third-party environment relating to diabolo under this url: github.com/openai/gym/blob/master/docs/environments.md#third-party-environments I was wondering is this url the right place to look for a possible release? Thank you for your time.

    • @felixvondrigalski294
      @felixvondrigalski294 3 ปีที่แล้ว

      @@frycomfort4002 There has been no release yet, but we are working on it and will announce progress on our website and social networks. Do get in touch if you have a specific interest and wish to collaborate! -> contact@sinicx.com

  • @Apfellll
    @Apfellll 3 ปีที่แล้ว

    What a time to be alive

  • @rohitmujumdar8195
    @rohitmujumdar8195 3 ปีที่แล้ว

    Wow Devwrat! Such cool work! Congratulations!