AMD CEO Lisa Su on the GPU shortage, the AI revolution, and Nvidia | Decoder
ฝัง
- เผยแพร่เมื่อ 17 พ.ค. 2024
- At this year’s Code Conference, the CEO of one the world’s largest computer chip companies discusses competing with Nvidia’s leading GPU, AI regulation, and the global supply chain. Presented by @PolestarCars
Read more: bit.ly/3ZEd5me
0:00 Intro
1:50 Interview
2:00 Lamini announcement
3:14 Chip market
5:24 CHIPS and Science Act
8:26 TSMC
8:50 Huawei seven-nanometer chip
10:11 Nvidia
13:40 CUDA and ROCm
15:44 PyTorch
18:03 Microsoft
18:50 Consumer prices and AI
20:55 Regulation
23:48 Gaming
24:24 Audience Q&A
The Verge’s sponsors play an important role in funding our journalism, but do not influence editorial content. For more information about our ethics policy, visit www.theverge.com/ethics-state....
Subscribe: goo.gl/G5RXGs
Like The Verge on Facebook: goo.gl/2P1aGc
Follow on Twitter: goo.gl/XTWX61
Follow on Instagram: goo.gl/7ZeLvX
Decoder Podcast: trib.al/iENzKtd
The Vergecast Podcast: pod.link/430333725
The Vergecast on TH-cam: / thevergecast
More about our podcasts: www.theverge.com/podcasts
Read More: www.theverge.com
Community guidelines: bit.ly/2D0hlAv
Wallpapers from The Verge: bit.ly/2xQXYJr - วิทยาศาสตร์และเทคโนโลยี
![Yoel Roth warns new X CEO about Elon and company status [FULL INTERVIEW]](http://i.ytimg.com/vi/M9XoUUYeZD8/mqdefault.jpg)
Do you think AMD can catch up to Nvidia’s AI chips?
I certainly hope so. monopolies are good for no one, except the monopolies ofc.
no, they are years behind and can't put up the money that NV spends on research.
Nope lol, Nvidia invested a lot and AMD chose not too, now Nvidia is reaping the benefit. AMD doesn't pay attention to software, that's the genius of Nvidia's dominance
@@Phoenix56801 n0p3 l0l
Yes. Trust in Su Bae.
Lisa Su is the best thing that happened to AMD.
still she is cpu guy, not an AI expert, so stop pretending u r one
@@MARKXHWANG stop yapping
@@MARKXHWANG so what's the point?
She's really turned the company around, considering where it was before Ryzen.
I was hoping the same turnaround story for BB, but no. 😢
Great interview, Dr Lisa handling the hard questions like a champ. Thanks for uploading the interview
A CEO who knows WTF she's doing, now compare this to Linda from Twitter's interview 😂
That video is hard to watch. Just bad all around.
Such a great comparison 😁
No kidding. Night and day.
To be fair. Linda’s interviewer wasn’t respectful either.
@@Nick-pc9tfdisagree, she’s a journalist not a PR firm. I don’t think she was unfair
IF, and that's a BIG IF, she can turn AMD around TWICE as she has done it ONCE in the past, she will go down in history as one of the GREATEST CEO's of - ALL TIME. Bar none.
Not really
Wrong. They were never going to be able to make RAM.
@@ericB3444why would they need to? There’s no that much profit margin in making ram.
@@ericB3444Hmmmm, CPU cache is SRAM, AMD seem to be pretty good at it, see Zen4 specs and the success of V-cache x3D SKUs
@@ericB3444Congrats on the most stupid comment in this section.
The difference Lisa has with other CEOs is that, most of the time while she avoids giving the answer you want or expect directly, she still gives you a useful related answer and expands on it as a respond your question, and because most of what she is saying are facts, it's not a pretentious way of approaching thing, a very different approach unlike most CEOs take, that's a rare talent.
So, so you are approaching the questioning like that, how can you lose credibility when you don't put yourself in a position where what you say, can't be perceived, mostly, in negativity light (figure of speech).
That's another level of smart.
Her difference with Jensen is that she is telling you about the potential of something without trying to drag you to it, she is just making excited about it so natural interest should come around on its own, unlike what Jensen does, who acts very desperately and miserably bad regardless of the performance of the products of his company.
I really didn't want to make a comparison between the two especially like that but it's the truth.
It's the product of having an engineer in a CEO position :)
@@SGCSmithnot really, Jensen is also an engineer. And a pretty brilliant one.
both are brilliant. Lisa saved AMD, and turned it back as a winner in the cpu arena, and now challenging Nvidia. But, IMO, Jensen has a more strategic vision - long term impact of what his company is delivering in the next 10 years with what ecosystem, while Lisa is more closer to what's in the production pipeline. Because of that difference, Nvidia will always be ahead - creating new markets, positioning R&D in area's where there is currently no market. For instance: omniverse (10 years ahead), or autonomous driving, or CRISPR research, etc.
Her and Jensen are cousins so they prob share ideas lol
Last night i wanted the "CEO " of X on stage and now i'm watching Dr Lisa Su. Talk about night and day.
I don't care much for the details of semiconductors, but I could listen to her talk for hours. She clearly knows her stuff and has a well thought out strategy. There are more consumer devices with AMD CPUs and GPUs than ever before, all thanks to her vision. Exciting times ahead.
Its jarring how different Jensen and she is. I cant stand Jensen.
@@roanwestraat9604 Jensen's much more matter of fact and in your face, which makes him more engaging. Lisa's too corporate and safe, I would be bored listening to her for long
Don't forget Rory, he was the CEO that put in place the console deals and prioritised Zen development. Lisa inherited good product with key ideas, so has the means to back up vision.
me too
Great job Nilay and verge team! Dr Lisa Su delivered as always, enjoyed how she handled many of those tough questions (only stumbled on the AI regulation on chip which was a hard one).
It's always amazing to watch any interview or presentation with Dr. Lisa Su.
She talks about everything confidently without telling a thing. Exciting in check. Such a well balanced CEO.
Sooo well-spoken
Nilay, you are such an amazing interviewer! And Lisa, ofcourse killed the answers.. keep it coming verge!
Post the unedited version. Jump @23:14
I’m enjoying this interview but I’d like to know what was cut from the answer about regulation and chip capabilities at around 23:18
I looked for a cut - I don’t think there is one. it is an interesting question, the possibility of controlling open source software at the chip level. That is not possible.
It would take a tremendous amount of resources, both an engineering and in the final product to have such a capability. then, there will be no hope to keep up with how easy it would be to modify open source software to dodge anything chipmakers do.
Came here after watching the Linda Yaccarino interview. Night and day difference in CEOs.
Such a great thing to have Lisa Su as AMD CEO. From near bankruptcy to competitive alternative or leader in multiple processor areas.
Great interview!
Both Lisa and Jensen from Taiwan 🇹🇼❤️
They’re related.
No seriously, they’re like second cousins or something.
@@ethanhannyes but i bet that they never talk to each other
They probably joke around about hardcore reddit fanboys on their spare time.@@HeroDai2448
God, it's amazing how sane she sounds in comparison to others I've seen on this topic.
This is a way better interview than Yoel and Linda. Both interviews were hard to watch.
While I'm not big fan of AMD, she deserves an honor of making AMD rise again with the Ryzen lineups.
Well , shortage is for AMD and not for Intel and Apple. And that's her next challenge
Having a CEO of one of the world's largest corporations just casually mention PyTorch (not a language btw, a framework) and JAX is quite mind-blowing, even if no in-depth analysis followed. Also: sneaky response to the question about regulating chip behavior.
The last sentence is the most important of the talk😂
Try to get Pat Gelsinger on for a follow up
Good interview, but I've always hated the tagline 'about big ideas and other problems', is a 'big idea' inherently a problem as the tagline suggests?
the best ones are!
She’s not afraid to say her competitors name. Impressive!
Jensen Hwang & Lisa Su, they look like Siblings in anyway :D
they are related, they're like first cousins or something
good lord she's good at fielding questions lol
She's a Star.
The way she carries herself is a masterclass in corporate leadership - when asked about Nvidia she only focuses on why AMD's product will be amazing
im still waiting for the fully autonomous vehicles and robotaxis that were promised several years ago. pretty clear the tech outlook is far more longterm than these growth valued companies are honing up to.
We are in a time of exponential growth: "We always overestimate the change that will occur in the next two years and underestimate the change that will occur in the next ten. Don't let yourself be lulled into inaction." - Bill Gates
This sentiment aligns with the idea that rapid technological advancements and societal changes often occur over the longer term, and the transformative impact becomes more apparent with the passage of time. It serves as a reminder to stay forward-thinking and to anticipate the more profound changes that may unfold over a longer horizon.
I wouldn't honestly expect Americans to know how to regulate anything. Lost war on drugs and guns already. Probably many others I'm forgetting too. Racism, sexism...Lost the war on crypto for a moment there.
Prohibition?
If fabs needed to be built in this country 5 years ago then industry should have built them. Reaching in my pocket to pay for a factory so someone else can make billions in profits is criminal at best.
question: why did the West industrials relocate their production in China ? It's not only semiconductor industry that has been relocated, it's the belief in a world agnostic economic order/dream chasing short term financial benefits, and now we have to turn back to reality to avoid economic dependance.
@3:15: “We’re betting on what the next big thing in AI is”. Did she ever actually say what the next big thing in AI is? Maybe I missed it but there was talk about LLMs, and hardware-agnostic AI API/SDK’s, etc. But the way she said that last line made it sound like there’s something more they’re aiming at, like AI that is more than just a stochastic parrot but capable of generalized reasoning and understanding. Or am I just reading too much into it?
When I asked chatgpt what's the next revolution and list the revolutions that we had. It answered electricity - computer intelligence - internet networks - 4G mobile revolution - Artificial intelligence - robotic intelligence with next gen commerical mobile network. Robotic intelligence refers to an era where tons of devices has local ai chips with access to cloud AI manager. It will be an era where there might be driverless cars, robot security patrol, robot assistants, robot delivery. There will be physical connection where we can bring AI into the physical world to make human life easier and better.
Without reading too much into it, I'd say she left at least breadcrumbs as to what's her take on the future of AI: Democratization of hardware for local compute, open software frameworks that are hardware agnostic and maybe the most important (and also most obvious) fact: That the whole AI-wave will sooner rather than later pivot towards an inference-dominated need for compute. That's something most people seem to overlook these days: Yes, everone and their mom want H100s right now, because it's training, training and more training. But when that's done, the surviving models need hardware to run on.
Lisa mentioned that their big bet with the AI industry over the next 5 years is on the increasing importance of hardware for inferencing AI models.
Same question was asked to Jensen. His answer was "we are in the manufacturing of intelligence." Nvidia's accelerating computing has many more applications than AI. Making driving autonomous was a choice made 10 years ago, and it will be available in the next 5 years. The next bet of Nvidia is Omniverse, or the virtual economy being twho times bigger than the physical economy.
We’d like a seat at the table and welcome it. But we have no idea “…how to regulate.” We simply make the hardware and let the chips fall where they may.
Nilay questions are spot on in this one.
Cloud gaming is already here cant wait start cloud vr gaming. I hope in 10 years we have mixed reality contact lenses with agi that are able to interconnect.
Name a more likeable CEO in the hardware space, I'll wait ❤️
Jensen Huang
@@namenotfound8747 they're cousins
@@moneymassx yeah right
Why do you need to tell us what we are about to hear?
can you make me look better on paper than superior competition like you guys do?
22:48 The reply by AMD CEO to this question... I thought Jensen Huang was dangerous...She's probably even worse.
What brought you to this conclsuion might I ask?
Jensen's like 60, the only thing he wants to hurt is your wallet, bloody cheapskate isn't even arsed to pay AIB partners that make the majority of consumer sales.
I felt heartbroken when she talked about PyTorch but not Tensorflow...
Should stop learning Tensorflow and just Learn PyTorch???
A total different approach compared NVIDIA. The open approach brings AMD here today and may bring AMD forward.
But competing with the exceptional good CUDA is a difficult game.
The AI market is moving too quickly for nVidia's proprietary software stack to lock devs vendor wise, given how H100s are on backorder for 12+ months and reselling for 80k on the used market, making code vendor agnostic is the obvious long term choice. Being bottlenecked by nVidia poses enormous missed opportunity costs, innovation does not halt progress for the demands of anyone in the AI market.
AMD, Microsoft, Meta, Qualcomm and making efforts to run on some standards like DirectML, OpenCL, ROCm so soon enough the ecosystem will be totally different, or it already is, lot of people using AMD GPU's already including me for LLM's, so if this is already in consumer segment, the server/cloud segment is usually ahead
AMD, as a matter of survival, had to propose an open approach to offer a valid alternative to Cuda, otherwise AMD would have disappeared. Nvidia has the leadership because of its ecosystem and has the ability to fine tune its propietary envvironment to allow better cost/performance. So RocM is freedom of choice, but what's the price ?
I love Lisa Su. Because of her, I became a multi-millionaire from AMD stock
Please inform me if this is misguided, but I am under the impression that Intel will come out victorious in the AI sector, as:
1. They possess their own fabs unlike AMD or nVidia, leaving them less vulnerable to the debilitating supply chain issues TSMC, and a technological edge as they have collaborated with IBM research (responsible for cutting edge developments in this space), alongside more freedom due to their vertical control over the entire hardware stack
2. If AI is believed to be the faceless image of the beast discussed in the book of revelation, it makes more sense the perpetrators would not be American/Taiwanese, but rather God's chosen people: and assuredly you cannot win against them.
And in terms of investment, it is quite late to invest in nVidia and AMD as they are already sky high, unlike Intel which is at a low point currently due to their aggressive reinvestment of profits.
*Not investment advice.
Intel is the new IBM , will always be a follower and eventually fall into obscurity like Nokia
@@XShollaj Clearly you haven't been keeping up to date with IBM, over the past 30 years they have transitioned from an OEM to a company that funds academia. To the point where it is currently the largest Industrial Research Organisation in terms of patents produced, notable for developments such as: the world's first 2nm chip, vertical gates, and analog/photonic AI chips. Furthermore, IBM and Intel have formed a close partnership giving them an advantage in terms of deploying these recent advancements.
@@locinolacolino1302look at Intel's AXG division disaster, long on snake oil but short on execution and delivery.
Right now they're way behind with a reputation for pushing clients into expensive server tech only to have the rug pulled as Intel jump ship
There is no GPU shortage. Stop making excuses for ridiculous pricing.
There is a shortage. There is only 1 leading edge foundry that everyone is using them. TSMC. And they don't have fabs online in the US.
NVIDIA is off samsung node.
@@pianobench6319 also most productions were shifted to AI related products and not consumer gaming gpus
@@pianobench6319 The shortage is in CoWoS packaging, which is not used for gaming GPU's.
If you as a company wanna order workstation GPUs for AI work, at least the latest models you are gonna have to buy in bulk (thousands of $$$) and preorder at least a year ahead in the hopes of getting anything on time to be competitive. There is only TSMC for these GPUs and production is as limited as it can be considering every AI company is ordering GPUs by the pallet in hopes of winning the arms race. The current shortage is even worse than the crypto boom, only this time it doesn't affect the gaming market as much but it still limits the silicon allocated to it.
Well there is an there isn't. People are paying $40000 for Nvidia H100 GPUs when they are supposed to retail around $33000. Nvidias profit margins on the chips are in the 1000% range they cost about $3000 to produce. People are having trouble buying RTX 4090s and despite the rest of their lineup being not stellar in the consumer market the prices of them aren't going down much from their original MSRPs.
I heard the same thing from steve...
There are CEO's who know what they are doing and then there are some like the Twitter lady who cant answer simple question...
Encryption used to be exported control. These AI tech will be available from many sources. Exported control is just shortsighted.
AMD GPU were so BS because of the Rocm drivers completely useless for ML. Thankfully Liza Tsu is doing something about it.
Was she wearing a Fitbit Inspire here? Interesting lol
Good thing Lisa is from Taiwan. Or else the interviewer will probably be slapped in the face for asking about Huawei BS. Lol
You'd think in a time when China is preparing to storm Taiwan we wouldn't try to aggravate them any further.
Where's cheap Ai hardware for middle-small businesses and startups? Why only certain biggest corporations allowed to hardware at all? Control of Ai tech already present? Why all this PR show with safety if no more than 5 companies allowed to create models at all and only them allowed to reach robots creation tech.
Relax....after few years the tech will bleed into smaller markets. The big businesses have to upgrade to new tech. Selling the old tech. With time the gap will narrow.
@@danishbashir4184 but it will be quite late...classic😅
@@fontende In life I have learned to be patient whenever I have been humbled. I am okay with it being year 2035
She gave pretty superficial, general answers on AI. Nothing visionary about where AMD is going. Just try to catch up to Nvidia on GPUs to do less demanding inference work.
That's not what she said or implied. She referenced training explicitly multiple times.
To be fair when it comes to AI the purpose of these semiconductor companies is to sell the shovels, not the gold. Sell compute power and let Google, Amazon, Meta and whoever else fight it amongst themselves, that's the vision. This is also how the datacenter industry has been operating forever, it's not really about vision, just sell the best compute package you can for enterprise, along with software and library support to create incentives.
If you take Nvidia for example they have innovated in a lot of ways with graphics but in general all their money right now comes from selling computational power for AI training, it is what made them the most money 10 years ago and it's the same thing now, only with AI instead of general purpose computing. The vision is the exact same as ever, only the means changed.
she never gives straight answers, like a true ceo
Dr. Su in Intel blue jacket!!!! She likes blue color for her dress...
A.I. CEOs will be cheaper then human CEOs
Cheaper? Yes.
Better? That’s extremely debatable.
누나 사랑해요
오~~ 수 누님~
mb
😂 GPU shortage
*SHE WANTS IT ALL!*
Really awesome work by her - the kind of computation TFlops growth she could achieve in last 10 years is 10x what Intel could. Intel was busy improving its wokeness publicity levels.
Intel decline has little to do that and more to do with how it became bloated and relied heavily on contractors.
AMD drivers and software stack are a mess. I wish this wasn’t the case. But it is and they don’t seem to find a way out. Same with Intel. Sadly, we are left at the mercy of Nvidia.
when they say .. should be as fast, you know its not up to the same scale as Nvidia.
She's not convincing
maybe you are not at level to understand her ...
Nilay Patel clearly do not have a clue about the semi market or tech ... zero tech background.
Nilay my man, how come your eyebrows are that far apart ?
I swear, Jensen Huang (Nvidia) and her are the SAME person! Guys don't be fooled, that's just Nvidia CEO in drag lol
He is her Uncle...
Nilay, you need to chill on shaving your eyebrows bro. They're getting wider and wider.
Rocm is 5 years behind. Amd gpu is always behind.
Lol so 5yrs ago statement😅😅😅
In terms of hardware they are about a generation behind, at least as far as AI is concerned. For software though yes, about 5 years sounds right. Although in general they are pushing really hard right now so it is exciting to see if they can actually close the gap. Eventually they will close it because tech innovation slows down at some point and everyone else catches up, by that time you have new tech avenues popping up.
Oh, I thought that was a man.
i thought she was an angel dropped down from moon for all the bathroom tikkis and bedroom sitkees like subby and patty
Lisa Su: Why Dont You Hack My Mackintosh Compatible. Faster and UN_Hackable. The ARM CPU is Like the Dalvic Java Virtual Machine.
Joke of the day , iphone15 pro best gaming console?????? , hahahahaha , hahahahahaha , ohhhhhh, hahahahahaha
People need to stop drinking apple coolaids ,
Best Gaming Mobile phone, yeah
Best Gaming console, nah
Literally comparing iPhone 15 Max Pro is better than the latest Asus ROG Phone in a lot of available Mobile Games that offer both platforms.
The reason is quite simple: Metal API is far more powerful than OpenGL or Vulkan which typically runs on Android games.
Go on, tell me just ONE Game on Android that uses complex API other than OpenGL or Vulkan.
That's why iPhone 15 is indeed the Best phone for Gaming thanks to Metal API. You name it, popular games like Genshin Impact, PUBG Mobile, Fortnite, run far better on iPhone than Asus ROG Phone, while also Less heat.
But when it comes to other portable handheld Gaming devices, obviously Apple don't even have it to begin with.
So, unless Android stepping up their OS to use a more advanced API than current time, Android will never beat iPhone because of Metal API.
@@ClayWheelerI'm a graphics programmer (who has worked with Metal and OpenGL) and I think you're a little misinformed here.
Metal and Vulkan are both newer APIs considered to have less overhead compared to OpenGL, but the API alone doesn't matter nearly as much as the performance of the hardware and the work developers do to optimize.
From a developer perspective, it definitely is nice that iOS devices don't have so many different GPUs that all have their own quirks though. I've seen instances where code that works on Snapdragon/Adreno chips doesn't on Mali and having to figure out which devices have issues and hunt them down for testing is not fun.
I like how quickly Lisa just shot that down and moved on. ROFL
P1G, P1G - You cant Separate Windows from Intel. Macintosh is Half Separated. The Reason it Costs Twice as Much and Runs Half The Speed. Gentoo Linux on the PlayStation 4 is Fully Separated. The Reason its Very Slow.
P1G, You're Nothing But a CHARADE. I Know More than Your GOD