V-JEPA, AI Reasoning from a Non-Generative Architecture with Mido Assran - 677

Today we’re joined by Mido Assran, a research scientist at Meta’s Fundamental AI Research (FAIR). In this conversation, we discuss V-JEPA, a new model being billed as “the next step in Yann LeCun's vision” for true artificial reasoning. V-JEPA, the video version of Meta’s Joint Embedding Predictive Architecture, aims to bridge the gap between human and machine intelligence by training models to learn abstract concepts in a more efficient predictive manner than generative models. V-JEPA uses a novel self-supervised training approach that allows it to learn from unlabeled video data without being distracted by pixel-level detail. Mido walks us through the process of developing the architecture and explains why it has the potential to revolutionize AI.
🔔 Subscribe to our channel for more great content just like this: th-cam.com/users/twimlai?sub_confi...
🗣️ CONNECT WITH US!
===============================
Subscribe to the TWIML AI Podcast: twimlai.com/podcast/twimlai/
Join our Slack Community: twimlai.com/community/
Subscribe to our newsletter: twimlai.com/newsletter/
Want to get in touch? Send us a message: twimlai.com/contact/
📖 CHAPTERS
===============================
00:00 - Introduction to the Video Joint-Embedding Predictive Architecture (V-JEPA)
01:33 - Inspiration for the JEPA
08:08 - How V-JEPA works
17:25 - How V-JEPA was built
29:10 - Prediction vs Generation
40:21 - Potential of V-JEPA
42:50 - Challenges and lessons learned
46:19 - The future of AI reasoning
47-55 - Conclusion
🔗 LINKS & RESOURCES
===============================
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture - arxiv.org/abs/2301.08243
Revisiting Feature Prediction for Learning Visual Representations from Video (V-JEPA) - ai.meta.com/research/publicat...
📸 Camera: amzn.to/3TQ3zsg
🎙️Microphone: amzn.to/3t5zXeV
🚦Lights: amzn.to/3TQlX49
🎛️ Audio Interface: amzn.to/3TVFAIq
🎚️ Stream Deck: amzn.to/3zzm7F5

[@igorg.8624]

This is one of the most complex episodes I've ever listened to on AI. A ton of complicated jargon that only experts can comprehend. I'm ambitious enough to stick with it until I master this one day 👍

[@raviwelcome19]

Every episode is an interesting