Why DeepSeek is so cheap to train | Lex Fridman Podcast
ฝัง
- เผยแพร่เมื่อ 9 ก.พ. 2025
- Lex Fridman Podcast full episode: • DeepSeek, China, OpenA...
Thank you for listening ❤ Check out our sponsors: lexfridman.com...
See below for guest bio, links, and to give feedback, submit questions, contact Lex, etc.
GUEST BIO:
Dylan Patel is the founder of SemiAnalysis, a research & analysis company specializing in semiconductors, GPUs, CPUs, and AI hardware. Nathan Lambert is a research scientist at the Allen Institute for AI (Ai2) and the author of a blog on AI called Interconnects.
CONTACT LEX:
Feedback - give feedback to Lex: lexfridman.com...
AMA - submit questions, videos or call-in: lexfridman.com...
Hiring - join our team: lexfridman.com...
Other - other ways to get in touch: lexfridman.com...
EPISODE LINKS:
Dylan's X: x.com/dylan522p
SemiAnalysis: semianalysis.com/
Nathan's X: x.com/natolambert
Nathan's Blog: www.interconne...
Nathan's Podcast: www.interconne...
Nathan's Website: www.natolamber...
Nathan's TH-cam: / @natolambert
Nathan's Book: rlhfbook.com/
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Invideo AI: AI video generator.
Go to lexfridman.com...
GitHub: Developer platform and AI code editor.
Go to lexfridman.com...
Shopify: Sell stuff online.
Go to lexfridman.com...
NetSuite: Business management software.
Go to lexfridman.com...
AG1: All-in-one daily nutrition drinks.
Go to lexfridman.com...
PODCAST LINKS:
Podcast Website: lexfridman.com...
Apple Podcasts: apple.co/2lwqZIr
Spotify: spoti.fi/2nEwCF8
RSS: lexfridman.com...
Podcast Playlist: • Lex Fridman Podcast
Clips Channel: / lexclips
SOCIAL LINKS:
X: x.com/lexfridman
Instagram: / lexfridman
TikTok: / lexfridman
LinkedIn: / lexfridman
Facebook: / lexfridman
Patreon: / lexfridman
Telegram: t.me/lexfridman
Reddit: / lexfridman
Lex Fridman Podcast full episode: th-cam.com/video/_1f-o0nqpEI/w-d-xo.html
Thank you for listening ❤ Check out our sponsors: lexfridman.com/sponsors/cv8471-sa
See below for guest bio, links, and to give feedback, submit questions, contact Lex, etc.
*GUEST BIO:*
Dylan Patel is the founder of SemiAnalysis, a research & analysis company specializing in semiconductors, GPUs, CPUs, and AI hardware. Nathan Lambert is a research scientist at the Allen Institute for AI (Ai2) and the author of a blog on AI called Interconnects.
*CONTACT LEX:*
*Feedback* - give feedback to Lex: lexfridman.com/survey
*AMA* - submit questions, videos or call-in: lexfridman.com/ama
*Hiring* - join our team: lexfridman.com/hiring
*Other* - other ways to get in touch: lexfridman.com/contact
*EPISODE LINKS:*
Dylan's X: x.com/dylan522p
SemiAnalysis: semianalysis.com/
Nathan's X: x.com/natolambert
Nathan's Blog: www.interconnects.ai/
Nathan's Podcast: www.interconnects.ai/podcast
Nathan's Website: www.natolambert.com/
Nathan's TH-cam: youtube.com/@natolambert
Nathan's Book: rlhfbook.com/
*SPONSORS:*
To support this podcast, check out our sponsors & get discounts:
*Invideo AI:* AI video generator.
Go to lexfridman.com/s/invideoai-cv8471-sa
*GitHub:* Developer platform and AI code editor.
Go to lexfridman.com/s/github-cv8471-sa
*Shopify:* Sell stuff online.
Go to lexfridman.com/s/shopify-cv8471-sa
*NetSuite:* Business management software.
Go to lexfridman.com/s/netsuite-cv8471-sa
*AG1:* All-in-one daily nutrition drinks.
Go to lexfridman.com/s/ag1-cv8471-sa
*PODCAST LINKS:*
- Podcast Website: lexfridman.com/podcast
- Apple Podcasts: apple.co/2lwqZIr
- Spotify: spoti.fi/2nEwCF8
- RSS: lexfridman.com/feed/podcast/
- Podcast Playlist: th-cam.com/play/PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4.html
- Clips Channel: th-cam.com/users/lexclips
*SOCIAL LINKS:*
- X: x.com/lexfridman
- Instagram: instagram.com/lexfridman
- TikTok: tiktok.com/@lexfridman
- LinkedIn: linkedin.com/in/lexfridman
- Facebook: facebook.com/lexfridman
- Patreon: patreon.com/lexfridman
- Telegram: t.me/lexfridman
- Reddit: reddit.com/r/lexfridman
Deepseek gave the code away and also the paper. If that is not democracy, then what else is?
Banned and asking Nations of like mind to banned it are democracy.
The model itself is authoritarian, for example it will not talk about tiannamem square
@@henrycook859 similar to gemini, it doesn't talk about controversial topics like jan 6 insurrection, biden/trump, isreal/palestine. Same with anthropic. Censorship was always there. Just cuz chinese built better thing u r hearing about censorships
Also gemini was more censored during American election.
@@henrycook859you are an idiot
@@henrycook859 You don't understand shit about what an open source model of this capability means, authoritarian my ass.
The mixture of experts to brain analogy was brilliant .
Mixture of experts has been around and is being used by any significant model already. It's like saying we used Transformer technology to create these large language models well of course mostly everyone does duh
DeepSeek exposed a harsh truth, algorithmic innovation can bridge hardware gaps rendering NVIDIA's compute hegemony replaceable.
We need to run this stuff on desktop gpus vram is cheap but they don't add it. 128GB 4090
The 70b model is smoking my main pc, and it is already trained!
quantize the weights to 4 bits, you cannot run a raw 70b model even if you have the best specs
My strong prediction for the future of AI is we rush headlong into something we publically hail as AGI circa 2030, we get about 5 years of competition between nations to develop ever more powerful general models,
Then we quietly roll out a bunch of profitable applications for AI that are all basically just good at one thing and run in the backgroynd on a smartphone.
Such a great podcast, as usual. Thank you Lex
Because the Chinese can innovate while American companies just look to overcharge for their lower tier service/product.
I will be doing my PHD in China
Neither is about innovation. Both are big tech or big govt trying to take away human freedom by trapping us into their siloes (consider simpler things like messaging app like WhatsApp that have solutions from a lot of others) and ultimately replacing us with AI. It's not a villain and saint scenario.
Innovation in tech has started in America first, the Chinese then follow. Its easier to follow something that is already established. Up to this point that is though, this is not to discredit China.
they just optimize, not innovate
@ list every original idea that started in china in the last 60 years and then list America's.
Wrong question: you should ask Why OpenAI is so expensive to train
No one knows
Some of the most used codes were written in Machine Language.
The more I watch videos about AI the more I think, "should we be doing this?"
The answer is no. The final outcome of every possible future is dystopia for humanity, as I see it
Not the way it's being done. But yeah it's inevitable and great great things can be done science Healthcare but I should have to think what a few people are going to do with the open source capability of the more Advanced reasoning models that they are running at their own home with no restrictions.
Ai and Crypto has me excited about the future
AI is going to steal your crypto at some point. Then AI is going to either overthrow or exterminate the human race. I watched a series of documentaries called "The Terminator" and it was pretty clear and convincing 🤷🏻♂️
Skynet is coming....☠️💀☠️🤖
AI makes me weird and think I’m a pirate… we lost this already 😮
get this guy OUT
If he was born here then whats the issue. If he wasnt then why cant he come to work willingly? I agree though the citizenship is not a handout anymore...
What do you mean ? Musk is not born here. Should he be out ?
Who? Lex?
I like the food he makes keep him in
Are you okay? You responded this to like 6 videos
But MEGA don't want Indian, why you need him for explanation 😂😂😂😂
alex is jewish. they love popjeeets
Not true, it is about legal immigration that can contribute to the overall improvement of quality of life for all involved
That big headed nerd lost me.
Deepseek doesn't work now
Their servers can't handle the traffic. Download it and run it locally.
I am at the beginning of my "investment journey", planning to put 385K into dividend stocks so that I will be making up to 30% annually in dividend returns. any good stock recommendation on great performing stocks or Crypto will be appreciated
As a newbie investor, it’s essential for you to have a mentor to keep you accountable. Ruth Ann Tsakonas is my trade analyst, she has guided me to identify key market trends, pinpointed strategic entry points, and provided risk assessments, ensuring my trades decisions align with market dynamics for optimal returns.
I managed to grow a nest egg of around 120k to over a Million. I'm especially grateful to Adviser Ruth Ann Tsakonas, for her expertise and exposure to different areas of the market.
I don't really blame people who panic. Lack of information can be a big hurdle. I've been making more than $200k passively by just investing through an advisor, and I don't have to do much work. Inflation or no inflation, my finances remain secure. So I really don't blame people who panic.
Without a doubt! Ruth Ann Tsakonas is a trader who goes above and beyond. she has an exceptional skill for analysing market movements and spotting profitable opportunities. Her strategies are meticulously crafted on thorough research and years of practical experience.
how would you recommend i enter the crypto market? I am also looking at studying some traders and copying their strategy rather than investing myself and losing money emotionally. What's your take on this approach?? and How can i reach her, if you don't mind me asking??
I'm 51yrs old. $40,000 weekly and *I'm retired, this video have inspired me greatly in many ways that I remember my past of how I struggled with many things in life to be where I am today!!!!* ❤️
Hello how do you make such?? I'm a born Christian and sometimes I feel so down myself because of low finance but I still believe in God
It's Maria Frances Hanlon doing, she's changed my life.
Same here
waking up every 14th of each
month to 210,000 dollars it's a blessing to l and my family... I can now retire knowing that I have a steady income❤️Big gratitude to
Maria Frances Hanlon
I do know Ms. Maria Frances Hanlon, I also have even become successful....
Absolutely! I've heard stories of people who started with little to no knowledge but made it out victoriously thanks to Ms. Maria Frances Hanlon.
Dam I thought this guy was the guy off Harold and kumar
Dumb....😂