Topics Covered: 00:00 - The cost of compute 02:30 - Is this sustainable? 03:46 - The cost to train a model 05:58 - Computation requirements 09:58 - The relationship between compute, capital, and technology 13:31 - GPT4 commenting on the technology with help from ElevenLabs
Don't forget to catch Part 1 and 2 of the mini-series. Part 1: th-cam.com/video/-s_Ui5j0Guw/w-d-xo.html Part 2: th-cam.com/video/IPre5287P3I/w-d-xo.html
Hmm. I was actually expecting to hear an actual figure (not just an approximation or estimate), of exactly how much it cost the frontier models to be trained. Still, this episode was basically useful.
No doubt GPU suppliers like NVIDIA are like the suppliers of picks and shovels during the 1849 gold rush. Exciting to see what everyone's building, and to drive through Santa Clara and Sunnyvale and San Jose and see so much silicon still happening in Silicon Valley.
price of power is a real competitive factor, all the lessons from crypto mining apply to the true cost of compute. Also security as people want to steal $10,000,000 files that are less than 1TB
Topics Covered:
00:00 - The cost of compute
02:30 - Is this sustainable?
03:46 - The cost to train a model
05:58 - Computation requirements
09:58 - The relationship between compute, capital, and technology
13:31 - GPT4 commenting on the technology with help from ElevenLabs
This was really good :-)
Thanks a lot for uploading this series!!
Good 3 episode series👏. Would be also interesting to hear your take on the different Platform services around AI centric workloads
Great topic! Incredible to see the comparation with adoption of a tech and the demand of compute
Don't forget to catch Part 1 and 2 of the mini-series.
Part 1: th-cam.com/video/-s_Ui5j0Guw/w-d-xo.html
Part 2: th-cam.com/video/IPre5287P3I/w-d-xo.html
2:04 probably the first legit “this is not financial advice” claim I’ve ever seen
Illuminating! I wonder whether or not Moore's Law applies with respect to compute thrown at frontier models moving forward.
Very informative!
Awesome stuff!
Really insightful thoughts on Ai
Back to School Giveaway
another banger about the chip ecosystem!
Interesting topic. It makes me reflect on if we really need this huge amount of cputing works…
Further reinforcement that at its core, this is a hardware revolution
Hmm. I was actually expecting to hear an actual figure (not just an approximation or estimate), of exactly how much it cost the frontier models to be trained. Still, this episode was basically useful.
No doubt GPU suppliers like NVIDIA are like the suppliers of picks and shovels during the 1849 gold rush. Exciting to see what everyone's building, and to drive through Santa Clara and Sunnyvale and San Jose and see so much silicon still happening in Silicon Valley.
I like how they “fact checked” the epilogue, yet the graphics (1,000,000,000 chars) doesn’t match up with the audio math (100,000,000,000 chars). 😅
price of power is a real competitive factor, all the lessons from crypto mining apply to the true cost of compute. Also security as people want to steal $10,000,000 files that are less than 1TB
super fantastic content