(Data Collection) Smile Like You Mean It: Driving Animatronic Robotic Face with Learned Models

Data collection video. To appear at ICRA 2021. The project website is at: www.cs.columbia...
Full overview video: • (Overview) Smile Like ...
Hardware description video: • (Hardware Animation) S...
Demo video: • (Demos) Smile Like You...
Abstract:
Ability to generate intelligent and generalizable facial expressions is essential for building human-like social robots. At present, progress in this field is hindered by the fact that each facial expression needs to be programmed by humans. In order to adapt robot behavior in real time to different situations that arise when interacting with human subjects, robots need to be able to train themselves without requiring human labels, as well as make fast action decisions and generalize the acquired knowledge to diverse and new contexts. We addressed this challenge by designing a physical animatronic robotic face with soft skin and by developing a vision-based self-supervised learning framework for facial mimicry. Our algorithm does not require any knowledge of the robot's kinematic model, camera calibration or predefined expression set. By decomposing the learning process into a generative model and an inverse model, our framework can be trained using a single motor babbling dataset. Comprehensive evaluations show that our method enables accurate and diverse face mimicry across diverse human subjects.

[@quantumfineartsandfossils2152]

my selfie experiment is a hit

[@VMasotti]

awesome

[@Alice8000]

can i buy that?

[@МихаилМихайлович-ь5ч]

Супер! Узнать бы из чего такую кожу искусственную делают. И можно ли её самому сделать. Я бы на протезы попробовал.

[@sonic-1968]

th-cam.com/video/b-eWgphPG3g/w-d-xo.html а как тебе такое)

[@mk8_it]

can we get a how to video soon?

[@isaacsantos8865]

As expressões até que estão mais ou menos, mas a maioria são negativas; quase não se vê alegria, nem vi sorriso quase.

[@Ms.Robot.]

❤️😍❤️

[@franksiam2975]

give me more vids pleaaase

[@sonic-1968]

Сначала сделаем похожими на нас, потом дадим интеллект , но не очень умный (иначе роботы поймут, что они лучше нас и мы в этом мире лишние) , потом роботами заменят людей (ведь роботы не болеют, не просят соцпакет и работают сутками, только подзаряжай, послушные во всем) ... А нас тем временем ширяют варевом от (для) ковидлы энное количество раз, пока иммунитет на сольется до нуля и не двинем кони... Миллионы уже на том свете, и это не предел... Так что роботы им ой как нужны стали...