Vikash Kumar
Vikash Kumar
  • 103
  • 153 958
Embodied Sensory Motor Intelligence
A positioning talk at Human Modelling in Physical Human-Robot Interaction workshop ICRA'24-Japan
Workshop: sites.google.com/view/icra2024-workshop-human-phri
Speaker: vikashplus.github.io/
มุมมอง: 396

วีดีโอ

MyoSuite - overview & tutorial (ICRA 2024)
มุมมอง 277หลายเดือนก่อน
MyoSuite - overview & tutorial (ICRA 2024)
RoboHive v.7 Release
มุมมอง 533 หลายเดือนก่อน
Robohive is a unified robot learning platform. For more details: sites.google.com/view/robohive
Visual Dexterity - dynamic in-hand reorient of complex objects in air
มุมมอง 3.9K8 หลายเดือนก่อน
Successfully reorienting complex shapes in hand is pivotal for versatile robotic tool use. Our system can dynamically reorient diverse real-world objects in hand while in the air, even when the hand faces downward. 📚Project website: bit.ly/3uuStkQ. 🧑‍💻Code: bit.ly/40UBlRt.
RoboHive - A unified framework for robot learning
มุมมอง 1K10 หลายเดือนก่อน
sites.google.com/view/robohive RoboHive, is a modular framework for research in the field of Robot Learning and Embodied AI. RoboHive ecosystem encompasses a range of pre-existing and novel environments, including dexterous manipulation with the Shadow Hand, whole arm manipulation tasks with Franka and Fetch robots, and various quadruped loco-motion tasks. In comparison to previous works, RoboH...
Hand tele-operation
มุมมอง 11211 หลายเดือนก่อน
Hand tele-operation
Object pickup via tele-operations on Mujoco Haptix
มุมมอง 23211 หลายเดือนก่อน
Hand pick up dataset
Myosutie2 0
มุมมอง 18511 หลายเดือนก่อน
sites.google.com/view/myosuite
MyoDex
มุมมอง 22911 หลายเดือนก่อน
sites.google.com/view/myodex The complexity of human dexterity has attracted attention from multiple fields. Still, much is to be understood about how hand manipulation behaviors emerge. Studying manipulation behaviors with a physiological realistic hand model (MyoHand) at scale, MyoDex is an attempt at recovering generalizable priors for dexterous manipulation.
RoboAgent: A showcase of skills, capabilities, and diversity
มุมมอง 106ปีที่แล้ว
robopen.github.io/ Trained merely on 7500 trajectories, RoboAgent is a universal AI agent that can exhibit a diverse set of 12 non-trivial manipulation skills (beyond picking/pushing, including articulated object manipulation and object re-orientation) across 38 tasks and can generalize them to 100s of diverse unseen scenarios (involving unseen objects, unseen tasks, and to completely unseen ki...
RoboAgent and HumanAgent taking turns picking towel
มุมมอง 46ปีที่แล้ว
robopen.github.io/ RoboAgent can efficiently acquire a wide diversity of non-trivial skills and can generalize them to diverse unseen scenarios. Trained merely on 7500 trajectories, we are demonstrating a universal RoboAgent that can exhibit a diverse set of 12 non-trivial manipulation skills (beyond picking/pushing, including articulated object manipulation and object re-orientation) across 38...
RoBoPen -- a distributed robot cluster for robotic experimentation
มุมมอง 523ปีที่แล้ว
RoBoPen V0.20
Is the Brain in the Business of Making Decisions?
มุมมอง 86ปีที่แล้ว
Invited lecture by Vikash Kumar at Janelia Research on the role of the brain in biological movement synthesis.
MyoChallenge'22 DieRotation Phase1 winner's solution
มุมมอง 55ปีที่แล้ว
sites.google.com/view/myosuite/myochallenge
MyoChallenge'22 BaodingBalls Phase2 winning solution
มุมมอง 70ปีที่แล้ว
sites.google.com/view/myosuite/myochallenge
MyoChallenge'22 BaodingBalls Phase1 winner solution
มุมมอง 71ปีที่แล้ว
MyoChallenge'22 BaodingBalls Phase1 winner solution
MyoChallenge'22 DieRotation Phase2 Winner Solution
มุมมอง 84ปีที่แล้ว
MyoChallenge'22 DieRotation Phase2 Winner Solution
RoboHive+TorchRL integration demo
มุมมอง 175ปีที่แล้ว
RoboHive TorchRL integration demo
DClaw Turn using GoFAR
มุมมอง 28ปีที่แล้ว
DClaw Turn using GoFAR
MyoDex: Generalizable Representations for Dexterous Physiological Manipulation
มุมมอง 104ปีที่แล้ว
MyoDex: Generalizable Representations for Dexterous Physiological Manipulation
R3M: A Universal Visual Representation for Robot Manipulation
มุมมอง 468ปีที่แล้ว
R3M: A Universal Visual Representation for Robot Manipulation
VIP: Towards Universal Visual Reward and Representation
มุมมอง 54ปีที่แล้ว
VIP: Towards Universal Visual Reward and Representation
MyoSuite's MyoLeg Gaits Baseline(s)
มุมมอง 474ปีที่แล้ว
MyoSuite's MyoLeg Gaits Baseline(s)
MyoLeg: MyoSuite's lower Extremity model
มุมมอง 203ปีที่แล้ว
MyoLeg: MyoSuite's lower Extremity model
MyoSuite1.4 release
มุมมอง 142ปีที่แล้ว
MyoSuite1.4 release
MyoSymposium2022: MyoChallenge2022 Workshop @Neurips2022
มุมมอง 356ปีที่แล้ว
MyoSymposium2022: MyoChallenge2022 Workshop @Neurips2022
MyoSim Overview
มุมมอง 321ปีที่แล้ว
MyoSim Overview
RoboHive Demo: TeleOp with Oculus
มุมมอง 205ปีที่แล้ว
RoboHive Demo: TeleOp with Oculus
Franka reaching random targets using learned IK
มุมมอง 264ปีที่แล้ว
Franka reaching random targets using learned IK
RoboHive: Sim-Real bridge + teleOp demo
มุมมอง 376ปีที่แล้ว
RoboHive: Sim-Real bridge teleOp demo

ความคิดเห็น

  • @rainlovelife
    @rainlovelife 7 หลายเดือนก่อน

    Imagine it's optimized to the point where it can essentially toss/flick this thing, spinning it, and then catching in all under half a second. Then imagine these types of robotics not taking every single manual labor job in the next 10 years...

    • @jelivanlolz1187
      @jelivanlolz1187 5 หลายเดือนก่อน

      If that happens then most jobs would be in maintenance of this things, so learning electronics now is still the best thing anyone can do

  • @martinlee965
    @martinlee965 7 หลายเดือนก่อน

    WoW great!

  • @user-gd5fx1gt2f
    @user-gd5fx1gt2f 7 หลายเดือนก่อน

    Thanks for your sharing! But as a freshman, I didn't know whether the process data is from the physical sensor in the real world (i.e. cyber gloves) or just simulated by the computer? If the data is from the real sensors, how to realize the transfer the signal data from real sensor to the Mujoco Haptix program? Thank you!

    • @vikashplus
      @vikashplus 7 หลายเดือนก่อน

      Its from cyberglove. Here is the repo that I developed to use cyberglove with MuJoCo - github.com/vikashplus/puppet

  • @VikashKumargmk
    @VikashKumargmk 10 หลายเดือนก่อน

    Good morning

  • @user-is1zr5bc1k
    @user-is1zr5bc1k 11 หลายเดือนก่อน

    fantastic, will you release the code and when?

  • @MOHITKUMAR-xe7bg
    @MOHITKUMAR-xe7bg ปีที่แล้ว

    sir, Do you have any paper reference for this ? it would be helpful for me.

  • @user-hyma6858
    @user-hyma6858 ปีที่แล้ว

    This is so exciting

  • @user-hyma6858
    @user-hyma6858 ปีที่แล้ว

    This job is so great !👍

  • @EdViaja
    @EdViaja ปีที่แล้ว

    Please add the XML files soon :D Excellent work!

    • @vikashplus
      @vikashplus ปีที่แล้ว

      Soon! Meanwhile, all models are available as compoiled mjbs for everyone to try.

    • @EdViaja
      @EdViaja ปีที่แล้ว

      @@vikashplus is there a plan to export the full model (neck, legs, arms, spine/thorax) this year?

    • @vikashplus
      @vikashplus ปีที่แล้ว

      We can certainly use some help in this direction. 1. We will be releasing the conversion pipeline that we have so that community can participate in 2. We find that conversion only takes us 20-40% of the way there. Embedding the models into functional tasks really exposes its limitations, especially in dynamic regimes. All myo_models go through a careful development process via interactive improvement post-conversion.

    • @EdViaja
      @EdViaja ปีที่แล้ว

      @@vikashplus I see. Thanks a lot.

  • @uvkush
    @uvkush ปีที่แล้ว

    cool stuff vikas

  • @hjkbnm-op3yu
    @hjkbnm-op3yu ปีที่แล้ว

    Bahut ache

  • @hjkbnm-op3yu
    @hjkbnm-op3yu ปีที่แล้ว

    Veri nice

  • @williamhuang5329
    @williamhuang5329 2 ปีที่แล้ว

    Hanzhen harmonic drive gear , over 30 years experience , robot arm gear

  • @williamhuang5329
    @williamhuang5329 2 ปีที่แล้ว

    Hanzhen harmonic drive gear , over 30 years experience , robot gear

  • @williamhuang5329
    @williamhuang5329 2 ปีที่แล้ว

    Hanzhen harmonic drive gear , over 30 years experience , robot arm gear

  • @japo8689
    @japo8689 3 ปีที่แล้ว

    god

  • @wataruimahayashi5937
    @wataruimahayashi5937 3 ปีที่แล้ว

    great

  • @v-sig2389
    @v-sig2389 3 ปีที่แล้ว

    Very cool work

  • @ashwanirathee508
    @ashwanirathee508 4 ปีที่แล้ว

    Awesome work,vikash...

  • @peterbriggs8181
    @peterbriggs8181 4 ปีที่แล้ว

    Hey Vikash! I've looked through the documentation and it seems like the servos are the most expensive element for the robots. Do you know of any affordable alternatives to the XM430-W210-R?

    • @vikashplus
      @vikashplus 4 ปีที่แล้ว

      ROBOTIS (www.robotis.us/x-series/) has some cheaper alternatives but they undergo heavy wear and tear as they use plastic gears. The robustness of the system definitely depends on your usage pattern. We run the robots for a few days per experiment and found XM430-W210-R to have the right price-robustness tradeoff for our usage.

  • @Flash-Strike
    @Flash-Strike 5 ปีที่แล้ว

    Planning to kill some humans humm mate?

  • @tigeruby
    @tigeruby 5 ปีที่แล้ว

    inspiring work! questions: arxiv link? github? was this all done via training in simulation and then transferring to hardware? or was some training done in a physical environment? also is there any benefit to say train in a physical environment exclusively with sensor feedback - or does simulation always end up being cheaper? or are hybrid methods the way to go? do these models or policies break down if say the motion were sped up several orders of magnitude? 10x, 100x? one assumes that the physics themselves would be slightly different so the policy unless robust to changing physics may or may not be able to handle that. - but it's cool seeing deep learning methods applied to fine precision motion/dextrous robotics, the open-ai hand being another cool example of which

    • @vikashplus
      @vikashplus 5 ปีที่แล้ว

      We are working on putting the materials together. Please watch this page for details: sites.google.com/corp/view/deeprl-handmanipulation PS: There is a link to the blogpost on the page that answers most of your questions.

    • @tigeruby
      @tigeruby 5 ปีที่แล้ว

      @@vikashplus wow thank you so much!

  • @amanchaure5584
    @amanchaure5584 5 ปีที่แล้ว

    where can i get the software?

    • @vikashplus
      @vikashplus 5 ปีที่แล้ว

      The software is baed on www.mujoco.org/

  • @user-wr4vu9zb4k
    @user-wr4vu9zb4k 6 ปีที่แล้ว

    ...хотя это, в основном, лишь компьютерная анимация..., впечатляет...!!!

  • @andyt1313
    @andyt1313 6 ปีที่แล้ว

    Amazing. Hmm. I wonder if the hand could be used to...never mind. 😁

  • @rwbot
    @rwbot 7 ปีที่แล้ว

    Loved this! The LEGO style design is very impressive. Are the CAD/code files for this project open source? Would love to make my own so I can do some research on myoelectric control

  • @roshankumarhota3029
    @roshankumarhota3029 7 ปีที่แล้ว

    Which simulation platform have you used?

  • @jandaletto
    @jandaletto 8 ปีที่แล้ว

    I really can't wait. Please freeze me and wake me up when we have robots. Good job guys.

  • @triethuynh7630
    @triethuynh7630 8 ปีที่แล้ว

    Very cool. Congratulations!

  • @randomquestion7592
    @randomquestion7592 8 ปีที่แล้ว

    Cool video :D. Keep it up!

  • @AddisNeger22
    @AddisNeger22 8 ปีที่แล้ว

    Im glad ur teaching it how to give a hand job early on, it will master it soon

    • @Flash-Strike
      @Flash-Strike 5 ปีที่แล้ว

      The lab folks uses it a lot, since they can't have a woman hand

  • @thomasr.miller5553
    @thomasr.miller5553 8 ปีที่แล้ว

    OK..this baby cant feed itself yet. KEEP WORKING ON IT ! Skywalker needs a hand..

  • @dich5088
    @dich5088 8 ปีที่แล้ว

    BRAVO guys. Очень круто.

  • @wlorenz65
    @wlorenz65 8 ปีที่แล้ว

    So if I wanted it to grasp a teaspoon at different positions and orientations from the table, lift it up, and bring it into the stirring posture with a few re-grasps, I would have to: 1) apply some infrared markers to the spoon 2) handcode an appropriate loss function in Matlab 3) bring the policy near the global optimum with an initial demonstration, and 4) let it search for the local optimum on its own with ~10*5 trials, manually resetting the starting conditions after each trial?

  • @bvim75
    @bvim75 8 ปีที่แล้ว

    fucking amazing