Advanced AI Accelerators and Processors with Andrew Feldman of Cerebras Systems

On this episode, we’re joined by Andrew Feldman, Founder and CEO of Cerebras Systems. Andrew and the Cerebras team are responsible for building the largest-ever computer chip and the fastest AI-specific processor in the industry.
We discuss:
- The advantages of using large chips for AI work.
- Cerebras Systems’ process for building chips optimized for AI.
- Why traditional GPUs aren’t the optimal machines for AI work.
- Why efficiently distributing computing resources is a significant challenge for AI work.
- How much faster Cerebras Systems’ machines are than other processors on the market.
- Reasons why some ML-specific chip companies fail and what Cerebras does differently.
- Unique challenges for chip makers and hardware companies.
- Cooling and heat-transfer techniques for Cerebras machines.
- How Cerebras approaches building chips that will fit the needs of customers for years to come.
- Why the strategic vision for what data to collect for ML needs more discussion.
⏳ Timestamps:
0:00 Intro
2:22 The advantages of using large chips for AI work
4:20 Cerebras Systems’ process for building chips optimized for AI
8:20 Why traditional GPUs aren’t the optimal machines for AI work
27:30 Why efficiently distributing computing resources is a significant challenge for AI work.
18:31 How much faster Cerebras Systems’ machines are than other processors on the market
30:42 Reasons why some ML-specific chip companies fail and what Cerebras does differently
41:29 Unique challenges for chip makers and hardware companies
45:03 Cooling and heat-transfer techniques for Cerebras machines
51:22 How Cerebras approaches building chips that will fit the needs of customers for years to come
1:00:39 Why the strategic vision for what data to collect for ML needs more discussion
Resources:
- www.cerebras.net/
Thanks for listening to the Gradient Dissent podcast, brought to you by Weights & Biases. If you enjoyed this episode, please leave a review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation.
#OCR #DeepLearning #AI #Modeling #ML

[@philipbutler]

This was great, this should have so many more views

[@TheBestNameEverMade]

Why doesn't the cerebras chip not use the full circular platter? Seems like a lot of silicon was left on the table.