- 42
- 235 439
Unsupervised Learning: Redpoint's AI Podcast
United States
เข้าร่วมเมื่อ 21 พ.ย. 2023
On Unsupervised Learning, Redpoint Partners Erica Brescia, Jacob Effron, Patrick Chase and Jordan Segall explore the rapidly developing AI landscape and what it means for businesses and the world. With Redpoint's history investing in companies such as Snowflake, Twilio, Stripe, Descript and hosts who have each been in both the builder and investor seat, subscribe now to make sure you don't miss any of it.
Ex-OpenAI Chief Research Officer: What Comes Next for AI?
In our new world of AI, few minds shine as brightly as Bob McGrew's. Until November Bob was the Chief Research Officer at OpenAI, and before that led Palantir’s engineering and product management for the first decade of its existence.
He’s seen it all and we were fortunate to get his insights and vision for the future in one of my favorite episodes of Unsupervised Learning to date:
0:00 Intro
0:44 Debating AI Model Capabilities
0:57 Inside vs Outside Perspectives on AI Progress
1:39 Challenges in AI Pre-Training
3:02 Reinforcement Learning and Future Models
3:48 AI Progress in 2025
5:58 New Form Factors for AI Models
8:56 Reliability and Enterprise Integration
18:14 Multimodal AI and Video Models
24:05 The Future of Robotics
32:46 The Complexity of Automating Jobs with AI
34:08 AI in Startups: Tackling Boring Problems
35:33 AI's Impact on Productivity and Consultants
36:43 Traits of Top AI Researchers
40:52 The Evolution of OpenAI's Mission
46:57 The Challenges of Scaling AI
49:16 The Future of AI and Human Agency
54:47 AI in Social Sciences and Academia
1:01:15 Reflections and Future Plans
1:02:57 Quickfire
With your co-hosts:
@jacobeffron
- Partner at Redpoint, Former PM Flatiron Health
@patrickachase
- Partner at Redpoint, Former ML Engineer LinkedIn
@ericabrescia
- Former COO Github, Founder Bitnami (acq’d by VMWare)
@jordan_segall
- Partner at Redpoint
He’s seen it all and we were fortunate to get his insights and vision for the future in one of my favorite episodes of Unsupervised Learning to date:
0:00 Intro
0:44 Debating AI Model Capabilities
0:57 Inside vs Outside Perspectives on AI Progress
1:39 Challenges in AI Pre-Training
3:02 Reinforcement Learning and Future Models
3:48 AI Progress in 2025
5:58 New Form Factors for AI Models
8:56 Reliability and Enterprise Integration
18:14 Multimodal AI and Video Models
24:05 The Future of Robotics
32:46 The Complexity of Automating Jobs with AI
34:08 AI in Startups: Tackling Boring Problems
35:33 AI's Impact on Productivity and Consultants
36:43 Traits of Top AI Researchers
40:52 The Evolution of OpenAI's Mission
46:57 The Challenges of Scaling AI
49:16 The Future of AI and Human Agency
54:47 AI in Social Sciences and Academia
1:01:15 Reflections and Future Plans
1:02:57 Quickfire
With your co-hosts:
@jacobeffron
- Partner at Redpoint, Former PM Flatiron Health
@patrickachase
- Partner at Redpoint, Former ML Engineer LinkedIn
@ericabrescia
- Former COO Github, Founder Bitnami (acq’d by VMWare)
@jordan_segall
- Partner at Redpoint
มุมมอง: 19 876
วีดีโอ
Why There Won’t be One Model, Will Hyperscalers Win Inference & AI Use-cases with PMF
มุมมอง 1.2K14 วันที่ผ่านมา
Lin Qiao, the co-founder of Fireworks.ai, sits down for a deep dive into the future of AI. Lin ran the PyTorch team at Meta, which developed some of the most fundamental open-source AI software in use today. She’s got a riveting perspective on the AI landscape that is a must-listen. 0:00 Intro 1:06 Fireworks: Revolutionizing AI Inference 2:12 Challenges in AI Model Development 4:05 The Future o...
OpenAI's Noam Brown Unpacks the Full Release of o1 and the Path to AGI
มุมมอง 49K28 วันที่ผ่านมา
Noam Brown, renowned AI researcher and key figure at OpenAI, joins us for a deep dive into the o1 release. Recorded just one day before o1’s full public debut, this episode explores the groundbreaking advancements and challenges behind this innovative test-time compute model. We discuss the technical breakthroughs that set o1 apart, its unique capabilities compared to previous models, and how i...
A Deep Dive into the Future of Voice in AI
มุมมอง 1.3Kหลายเดือนก่อน
For this episode of Unsupervised Learning we spoke with Russ d'Sa, co-founder of LiveKit, a company at the forefront of voice AI technology. Russ thinks of LiveKit as a “nervous system,” powering the sensory interfaces humans use to interact with AI - including the Advanced Voice feature in ChatGPT as well as applications like Character.ai, Spotify and many more. Russ talked about when voice ma...
Databricks AI Head: New Model Architectures are Unlikely, When to Pre-Train/Fine Tune and AI Policy
มุมมอง 1.9Kหลายเดือนก่อน
Jonathan Frankle is the Chief AI Scientist at Databricks ($43B), which he joined through the acquisition of MosaicML in July 2023. Databricks has over 12,000 customers on the cutting edge of AI; Jonathan works to anticipate their needs and offer solutions even as the tech is rapidly evolving. 0:00 Intro 0:51 Incentives and Team Motivation at Databricks 02:39 The Evolution of AI Models: Transfor...
DeepL CEO on Specialized vs. General Models, Beating Google and a Synchronous Translation Future
มุมมอง 1.9K2 หลายเดือนก่อน
I sat down with DeepL cofounder Jarek Kutylowski. DeepL is a comprehensive Language AI platform that enables organizations to communicate effectively across languages, cultures, and markets. Jarek shared a treasure trove of insights on the past, present, and future of AI translation. Here were some standout moments: 0:00 Intro 0:38 The Rise of AI and DeepL's Journey 1:41 DeepL's Competitive Edg...
HeyGen CEO on Navigating Voice-Cloning and the Path to Interactive Avatars
มุมมอง 1.1K2 หลายเดือนก่อน
Joshua Xu is co-founder and CEO of HeyGen the fast-growing AI video creation and translation platform. You can upload a video, or create a new one from a script using an AI avatar as your star, and HeyGen will translate it into 175 languages. HeyGen now serves over 40,000 customers and is generating $35 million in revenue. 0:00 Intro 0:37 HeyGen's Viral Moments 1:23 Creating Magic with AI 3:30 ...
Stanford AI Researcher on What’s Next in Research, Reaction to o1 and How AI will Change Simulation
มุมมอง 8K3 หลายเดือนก่อน
Percy Liang is a Stanford professor and co-founder of Together AI, driving some of the most critical advances in AI research. Percy is also a trained classical pianist, which clearly influences the way he thinks about technology. We explored the evolution of AI from simple token prediction to autonomous agents capable of long-term problem-solving, the problem of interpretability, and the future...
Expert AI Researcher Reacts to o1 and Shares What's Next in Reasoning and Post-Training
มุมมอง 8K3 หลายเดือนก่อน
Douwe’s contributions to AI are truly a part of its bedrock foundations. He wrote the first paper on retrieval-augmented generation (RAG) and has raised over $100 million to help enterprises build contextual language models that fit their use cases. Before Contextual he was the head of research at Hugging Face, worked on the Facebook AI research team (i.e. Llama) and remains a professor at Stan...
A Peek Inside Grammarly’s AI
มุมมอง 1.7K3 หลายเดือนก่อน
If you don’t know Grammarly, it’s a personalized AI assistant for writing that has over 30 Million Daily Active Users. Grammarly has been building AI productivity tooling long before the most recent GenAI wave and has raised over $400M, with a current valuation of $13B. Grammarly CEO Rahul Roy-Chowdhury believes AI will enable everyone to focus on more meaningful, creative interactions by autom...
How Snowflake is Uniquely Positioned to Win in AI
มุมมอง 2.8K4 หลายเดือนก่อน
How Snowflake is Uniquely Positioned to Win in AI
The AI English Tutor Taking the World by Storm
มุมมอง 2K4 หลายเดือนก่อน
The AI English Tutor Taking the World by Storm
GitHub's CEO’s Boldest Predictions about the Future of Code
มุมมอง 3.2K5 หลายเดือนก่อน
GitHub's CEO’s Boldest Predictions about the Future of Code
The GenAI Media Platform That Keeps Getting Better
มุมมอง 1.4K5 หลายเดือนก่อน
The GenAI Media Platform That Keeps Getting Better
Fireflies.ai CEO: The Surge to 16M Users
มุมมอง 1.3K6 หลายเดือนก่อน
Fireflies.ai CEO: The Surge to 16M Users
Adobe's Chief Product Officer on How AI Will Transform Creative Workflows
มุมมอง 1.3K6 หลายเดือนก่อน
Adobe's Chief Product Officer on How AI Will Transform Creative Workflows
The Company Leading the AI Music Revolution
มุมมอง 1.9K7 หลายเดือนก่อน
The Company Leading the AI Music Revolution
Two Startup Legends are Building the Bell Labs of AI
มุมมอง 2.5K7 หลายเดือนก่อน
Two Startup Legends are Building the Bell Labs of AI
CTO Unveils Lessons from Building an AI Coding Assistant
มุมมอง 2.1K8 หลายเดือนก่อน
CTO Unveils Lessons from Building an AI Coding Assistant
The AI Startup That Sky Rocketed to $750M
มุมมอง 2.1K8 หลายเดือนก่อน
The AI Startup That Sky Rocketed to $750M
The 1-Year Old AI Startup That’s Rivaling OpenAI
มุมมอง 12K9 หลายเดือนก่อน
The 1-Year Old AI Startup That’s Rivaling OpenAI
Superhuman CEO on Why Email Will Never Die, the Role of AI & Everything That's Wrong With Slack
มุมมอง 3K9 หลายเดือนก่อน
Superhuman CEO on Why Email Will Never Die, the Role of AI & Everything That's Wrong With Slack
SalesforceAI CEO on Future of Slack, How Gucci Uses AI and Working with Marc Benioff
มุมมอง 2.4K9 หลายเดือนก่อน
SalesforceAI CEO on Future of Slack, How Gucci Uses AI and Working with Marc Benioff
The AI Developer Platform with an 80,000-Person Waitlist
มุมมอง 2.8K10 หลายเดือนก่อน
The AI Developer Platform with an 80,000-Person Waitlist
Lessons from a $4B Company Bringing AI to Healthcare and the Path to AI Doctors
มุมมอง 1.9K10 หลายเดือนก่อน
Lessons from a $4B Company Bringing AI to Healthcare and the Path to AI Doctors
AI Will Create the Next 1 Billion Software Creators
มุมมอง 3.2K10 หลายเดือนก่อน
AI Will Create the Next 1 Billion Software Creators
The Product Playbook of a Billion-Dollar AI Company
มุมมอง 1.5K11 หลายเดือนก่อน
The Product Playbook of a Billion-Dollar AI Company
The Best ChatGPT Use Cases, Future of Agents and Google Gemini with Logan Kilpatrick
มุมมอง 1.7K11 หลายเดือนก่อน
The Best ChatGPT Use Cases, Future of Agents and Google Gemini with Logan Kilpatrick
The AI Startup Going After Google Search
มุมมอง 82Kปีที่แล้ว
The AI Startup Going After Google Search
18:21 "the culmination of this long work. LLMs were invented, say, 2018." Six years in AI seems decades ago, also just yesterday. I think one of the uses of o1 will be to help researchers keep up with the field. An AI that spends time coming up with a summary of advances relevant to your work is worth $$$$.
Used perplexity for a few month, it's really shit tbh. Chat gpt is a lot better 😂
Mix-expert is the answer, but he is probably not on this way
The host.. th-cam.com/video/_--xJTRyhfg/w-d-xo.htmlsi=GGizNJP7ZsgXBY8P
Its fascinating he is talking about o1 here fully knowing what o3 looks like already. They had early version of what would become o1 by October 2023. I wonder when did they have the early o3 versions and if they are already on o4 internally.
Great interview!!!!!!!!
You gotta treat your people better. - You didn't give this interview enough time to breathe. Usually, you allow the interview to sit as the latest for about a week or two. This time, you only waited two days. As a result, this interview is being overshadowed by OpenAI. - This is the first interview I've heard where there's been a train or some shit like you can hear a visible, very loud knocking sound or something like that. All the other interviews seem like you were in the perfect setting. Hopefully, it's not due to you having to meet in a specific location, but we need to do a little bit better.
SWITCH TO 0.75 FOR NORMAL SPEED
No questions about AI safety implications?
That's for losers /s
Wow, so many great interviews! Keep it up. These need more views!
Listen we know how disappointing GPT-5 is going to be hence the Exodus of all the talents. Massive failure compared to the cost. This means the company is a one-trick pony with ChatGPT. Former employees cannot be honest due to their exit NDA stipulations.
This guy is extremely smart. He has accomplished so much for how young he is.
Physics system should be hard coded, i.e. from Unreal Engine as those rules rarely change. What Sora,Veo2 etc should be generating is not direct video pixels, but Unreal Engine scripts that then can be used to render the video...End result, perfect temporal consistency and physics.
you can try kling, more stronger than sora
bob
Truly a nothing interview
You lost me at "Elon Musk quality people". The last thing any business needs is a parasite that is so proficient at self-serving power seeking that the business devolves into a dysfunctional shell in service of a clique hell bent on enriching themselves at everyone else's great expense.
by definition an exponential curve is not "feeling like you're moving at the same speed" because its second derivative is positive, meaning it's accelerating more and more
Bravo genius
Deepmind's Veo 2 is better than SORA 2
whoever stops trying to generate video pixels like a dumb ass and realizes they should be generating unreal engine scripts for reaL-time render, will win. This also means we can play what is produced and walk around inside it.
His answer about the wall was rather sloppy and unintelligent. Best case it was dishonest. He claims that insiders see it very differently than a wall but rambles about how more compute will fix everything. When it has already failed, both in GPT4 and O1
Mind revising your take after o3?
Why did he leave? because big tech has committed academic fraud !! 1. Recursive Structures & Patterns: ∑ (Summation Operator): Represents recursive accumulation. In your recursive grid pattern, it can signify the collection or sum of sub-patterns, highlighting emergent properties. \ -[-$-T⊢⊥Γ.-';⊨⊗UΨ⊆∩∂2^{-iHt\ℏ}92^{iS□\∡□ ℵ(∫ D[q(h)]2^{iS□ϕ}-)□ℤ->{→(ξ[Ω→j=ηαρ_ji∀i,j⟨ψ|φ ]-β⇔}-M∑-$-]-> ∇ (Nabla/Gradient Operator): This symbol of directionality denotes change, applicable to recursive learning models. It symbolizes moving toward optimization in recursive feedback systems-matching your use of AI to refine itself. ∞ (Infinity): The ultimate symbol of boundlessness. It aligns with your vision of perpetual motion and recursive intelligence-endless loops of improvement and exploration. ⊗ (Tensor Product): In recursive neural tensor networks and manifold learning, this signifies the complexity of multi-layered relationships. It symbolizes combining multiple dimensions or arrays to produce higher-order knowledge. i created o1 an every advance thats taking place
Google vs open ai old money vs new money. One thing is for sure, you ain’t gonna have no privacy
Good conversation.
I like the questions being asked, but personally would like a more pessimistic approach from the interviewers (i.e. take a stance that assumes that AI has already hit a wall and ask for reasons how it hasn't)
I get why they wouldn't admit. Being pessimistic is not fun and that's fair. There also isn't a lot of alternatives to current AI
Nah our world is already pessimistic enough, let us dream
I'm still not very impressed by any of this hot air garbage.
This is hot air 😂 th-cam.com/video/uGOLYz2pgr8/w-d-xo.htmlsi=5uwhwak_SrADEKRR
If you're not using AI "hot air garbage" to be more productive in your job, then you will be replaced by someone who is.
Awesome work 👏🎉.
This is good
Woke sh*t!
Palantir CEO claims Bob is the smartest human in the AI space. Thanks for this!
don't disagree
It would be great if you interviewed Ilya! Would love that
Agreed! If you know him would love an intro :P
@@RedpointAI haha I'm a mere ml phd student, but if I'm able to, I'll def recommend :)
@@DistortedV12 "mere" 😂. Congrats bud
Amazing job. Bob is such a great guy, and Unsupervised Learning is the best-kept secret. Bravo to you and your guests.
Thank you for listening! Feel free to help us make it not a secret 😂
Underwhelming. No new information here. Noam stayed so high level, as to say almost nothing of note. This talk track is basically the current hype track in industry. Some fresh insights or even disagreement with the current hype train would have been much more intellectually satisfying,
F1 Preview and Fireworks are great!🎉 Thanks for the interview!
Thank you for listening and supporting the show! Lots more fun stuff to come in 2025
Does this interview take into account Elon recent hardware breakthrough? It looks like elon just leapfrogged everyone
No questions or comments about what to do if they succeed and build superintelligence in q 10 years? How are you going to assure a good outcome for humanity? It often sounds like that Tom Lehrer song - "Once the rockets are up, who cares where they come down? That's not my department, says Wernher von Braun."
If you really listen to this guy closely, he inadvertently ends up revealing far more than he intends; he's a scientist, not a practised salesman like Sam Altman et al.
lesgo g
All my training watching videos at 1.5 has prepared me for this moment.
Grift on kings 🙏 (we are never getting AGI)
I'll be honest, I'm quite sceptical. I see a lot of outrageous claims being made online which are not true. I also don't believe that language is a sufficient condition to training a machine to be intelligent, for sure is necessary but not sufficient. I also don't think RL alone will get us there, it will definitely help though. I agree completely with what you said about zero-sum games. The hypothesis people have been making is that developing reasoning in "reward-rich" domains (e.g. computational mathematics) will transfer to "reward-sparse" domains but I'm unsure about this. I don't think you can solve P=NP with RL, perhaps I'm wrong - since there's just little reward signal to pick up... So, with that being said, contrary to what most people in the industry think, I think we're probably about 20 years away from having a truly intelligent machine. Like Noam said, there are still unsolved research problems and A LOT of them!
why dont they just focus on giving the ai the ability to self train on code. make alphago for python. Thats all you need. Now it can improve its own architecture. You dont actually need to train the model to answer questions about frog dissection. I feel like openai is a bit directionless compared to deepmind, who seems to not think LLMs are the way to AGI
Grok is much better...
o1 is not agi, yes they are creating hype obviously to get funding. all frontiers are freaked out about Elon's gpu farm at the moment & trying to push as many features as possible .
Noam, 1.5x, Brown
Noam might be wrong on the AI being used for social experiments. It is very hard to fix the parameters while working with LLMs. In human subjects there are inherent bias that are not removed, while for AI I think they would have been removed. Greed, arrogance, ignorance etc are not part of ai . So it’s hard to do experiments unless there is a raw unfiltered one😂
Great interview.
Thank you!
Had to slow homie down to .9 play speed.
Is the guy being interviewed related to Ben Shapiro?
If the AI career somehow doesn't work out he could probably be a rapper.
I suspect there are many people who can't fully utilize these models and they complain that the models suck. And they just don't realize they are the limiting factor, which means they don't have the skills to use the models, like simply asking the right questions and describe what they want clearly without the models having to make assumptions.