AMD’s 128 Core MONSTER - Epyc Bergamo
ฝัง
- เผยแพร่เมื่อ 6 พ.ค. 2024
- Your business deserves a website! Create one for free at odoo.com/LTT
AMD has done it again, cramming 128 cores into their 4th generation EPYC server CPU and calling it ‘Bergamo’. But what exactly is Zen4c, and what’s it supposed to do?
Discuss on the forum: linustechtips.com/topic/15409...
Special thanks to @wolfmanmods1428
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH: lttstore.com
► GET EXCLUSIVE CONTENT ON FLOATPLANE: lmg.gg/lttfloatplane
► SPONSORS, AFFILIATES, AND PARTNERS: lmg.gg/partners
► EQUIPMENT WE USE TO FILM LTT: lmg.gg/LTTEquipment
► OUR WAN PODCAST GEAR: lmg.gg/wanset
FOLLOW US
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 Intro
1:18 How did they do it?
3:24 Let's Build!
7:17 Picking a lane
9:54 This deserves a case
12:15 Taking it for a little spin
16:00 Not so delicious after all
17:05 Don't try this at home. Or work. Or anywhere.
18:13 It had to happen.
22:28 Outro - วิทยาศาสตร์และเทคโนโลยี
At 6:17 Linus uses the unit 'foot pounds' where he should have used 'pound force inches.' We're working to update the video.
ok
ok
ko
SP5 waterblock needed the ThermoFlex 5000 Hungers!
Thanks Steve
I was looking for a CPU to run Cities Skylines II at a least 15 fps, I think this one will do.
nah this prob gonna give you max 10 fps
Might need a better graphics card tho
It's going to be 10 fps after they release new patch
You'll need three of these. Probably.
The problem with cities skylinies is simply that it is relying on single core performance and just isn't optimised at all.
Meaning more cores won't give you anymore performance rather it will hurt performance because each single core won't turbo as high.
Love the game but pls just optimise for miltithreading.
I can’t wait to spec out a full system I’ll never afford just to see how insane the performance would be😂
i litearly would do the same
Cheaper than a fully specced out Imac desktop
@@jackhemsworth7515definitely not lmao there’s NO way
I did this is 2006 a lot. Dreaming of the best gaming PC money could buy.
@@beeseechurgerIt's cheaper than a whole imac pro
The most insane feature of Bergamo is its power efficiency. Wendel from Level1Tech mentioned that Zen4c is even more power efficient than most currently available ARM CPUs
What!!!
@@User-dd2xv you can compare it to an Ampere Altra Max, which also has 128 cores. The Altra consumes about 130W in idle and 350-400W under load. Bergamo consumes abkut 120W in idle and 500-600W under load. But Bergamo is up to three times faster than the Altra Max
@@romanpulPower comsumed per unit of work done. For server chip, it kills :)
dang, very cool
With AMD aiming for compacted Zen-C cores and Intel aiming to put something like 300 E-cores in one socket fairly soon, the days of a Kilo-thread box are rapidly approaching.
yep sirrra forest successor is supposed to have 512
It’s crazy. Soon we might be referring to CPUs like: “4 Kilocores and 8Kilothreads” In 20 years.
Depends what you mean by box. Some of the server manufacturers have already done 4 node 2u chassis that support 8x Epyc CPUs across the nodes.
Intel was talking about 144 cores last year and they still haven't done it meanwhile bergamo is 6 months old.
Intel are like 3 years behind.
@@tomstech4390 Clearwater Forrest is on pace. Intel is behind in server core count overall yes, but this isn't another Sapphire Rapids situation with a year of delays.
I was genuinely shocked at Linus using a non-LTT screwdriver.
Torque extension on the store when ?!?!?
Came looking for a comment to figure out why?
haha same
@@kazoolians Torque specifications.
@@kazoolians It's a Gear Wrench 1/4" Drive Torque Screwdriver 1-6Nm
...a ~$220 screwdriver! Perfect for not overtightening the CPU screw and costing yourself $12,000.
Linus - buys and implements full workshop with cnc
Also Linus - only have this one heatsink
We do cloud computing and have been discussing and testing vCPU ratios and core contention. The performance effects of overlapping VM vCPU and VMs with more vCPUs is something we are always tweaking and eventually resolving with better hardware. It’s something that is surprisingly more strange than straightforward, since VMs experience slowdowns from neighboring VMs on the same CPUs/clusters/cores/caches. The perception of performance is related more to cumulative contention at any given instant than it is to peak capability (specifically in reference to user-facing experiences, not infrastructure which can often be measured in terms of load metrics).
In many cases, there is no direct software solution, which leads to scale up or scale out.
For us, the only way to see how the hardware perform is to benchmark and create these scenarios to see how we can load balance physical and virtual systems. My hope is that the 4c provides better small-mid scale VM performance and responsiveness in a way that is affordable for our needs.
I use to work in a factory that made telecom servers. And one day coming to the work there was a batch from might shift where every single server blade of the production line overheated.
Open upp the first. The plastic cover was still on the cpu, the second.. well every one of them.
Well someone asked the dude that assebmled them and he claim that there was no part in the instructiin to remove the plastic cap.
The person who made the instruction thought it was so obvius so he didnt write it.
He probably knew but wanted to make an example for why you idiot proof your instructions
This is a prime example of exactly why an instruction manual must contain the most blatantly obvious instructions possible. Because someone, somewhere, is going to be brilliant enough to mess it up.
When you write manuals or instructions, you have to think of all the possible stupid things that another person could do...😅
@@B0B_BELCHER no matter how well you write instructions there will always be an idiot who will beat it.
"Use your brain to command your arm to move towards the CPU, use your brain to command your hand to grab the CPU..."
I wanna see this CPU run GPU tasks.
Like, i wanna see DirectX ported to the CPU and have it run something like Doom 2016.
God yes, I need to see DX-for-CPU happen lol
If I remember correctly someone ran crisis on the 64 core epyc back then. Would definitely be interesting to see this on the new epyx
mesa 3d exists, and doom 2016 runs in opengl or vulkan modes (no d3d if I remember correctly)
So your wish might already be possible today
Ltt make it happe
and if I recall correctly, it got what...10 fps @720p? Which for CPU only is not bad at all @@gabenchrist7331
It would actually be pretty bad compared to even entry level GPUs because the core sizes for those are so small because they run a very limited number of instructions compared to x86-64, and they perform mathematical calculations with much more precision to make sure things don’t look all shimmery/warbley like a Sony PS1. For comparison the number of GPU cores on any discrete graphics card is going to have (at a minimum) at least 4x the number of threads as this CPU, for the closest comparison you’d have to look at iGPUs, like the Intel UHD 750 that’s included with the 11th Gen i5’s and up, which have 256 cores. We’ve reached a point where the most powerful GPUs have 1:1 core per pixel ratio.
So, what you’re suggesting might not be as exciting as you think and might make it look far less impressive than doing what it does, which is perform a ton of complex instructions in parallel and host a ridiculous number of containers and VMs that can all be allocated a reasonable amount of cores and memory, that it wouldn’t fare too poorly against older workstations that shipped with similar specs years ago.
With the setup LTT had, they could setup 16 VMs with 16 cores and 48 GB of RAM, which is overkill compared to most virtual servers I’ve ever worked with running on a VMware server farm. If you needed fairly robust virtual servers you could easily provision 32 servers with 8 cores and 24 GB of actual memory. More than likely these are going to be used in a mixture of uses where you’ve got VMs dedicated to specific virtual systems that will reserve the cores and memory, while others that are more dynamically allocated so that at idle it won’t use up very much, but as more demand is placed on the system, it will just start allocating more memory and CPU cores and cycles as needed.
If you’ve never seen how VMware server farms show the CPU and Memory usage it’s weird the first time you see it, because it will say goofy shit like 15 GHz CPU used, which is a running total for the usage within a particular timeframe, because that’s how they bill for some of these things, even though it’s not their hardware, they charge licensing fees based on usage, because people are willing to pay that much for their software.
Anyway, as interesting as these CPUs are for the most hyperconverged data centers, it’s still really boring for games because GPUs are just so much more parallelized and have been that way for a much longer time.
The takeaway that’s most interesting is the CCDs being so jam packed, because it means that we’re going to have consumer desktop and workstation CPUs with 32 or even 64 cores on a much smaller package with higher clock speeds within the next couple of refresh cycles, and/or more PCIe lanes for even more I/O and memory capacity. HEDT is just going to be overshadowed by regular desktops, and laptops that will be able to handle more multi-threaded workloads. Also, the power efficiency of those cores were pretty impressive as well.
This video was the last video my dad sent to me before he passed away last week. He was a genius with newer PC technology and I relied on him a lot for any computer questions I had. Recently, I had asked him if he knew of any CPUs that I could upgrade to, and he sent me a link to this. I knew he was looking around to find me something powerful for gaming but within budget before he passed. I'm not exactly fluent when it comes to computer parts, and most of the finer details in this video have gone over my head, but someday I want to learn what it all means.
I currently run an AMD FX 8350 but it seems to be somewhat incompatible with my new NVIDIA GeForce 3070- it reaches max CPU usage and gets hot when trying to run games such as Baldur's Gate 3- and now fails to run beyond the title screen. I've tried delegating my GPU to handle my gaming apps with high performance prioritized, but saw no improvement between the games or what task manager clocked my CPU at.
I feel strange asking the youtube comment section, but I was hoping if anybody who knew their computers would be able to tell me if the Bergamo would be worth investing in for an upgrade?
Hi, your father most likely sent this to you just to show where the technology is heading. Instead look at some videos about the ryzen 5600x3d and 5800x3d.
Good luck and keep thinking good thoughts about your father.
No, Bergamo is not the kind of processor you want for a desktop. These are designed to run cloud apps, not super fast but very efficient and many tasks at once. It's not a fast CPU in terms of running single tasks quickly, only that it can run so many at once. And the cost of a cheap car for a single CPU.
Depending on budget you'll be wanting either Ryzen 7000 series or Intel 13/14th gen.
If you need a workstation and want the types of cores this thing packs, then you're after either Intel W-2400 or Threadripper, but don't expect much change from $5k for a board, CPU and memory.
A bit late I think, but I figured I could contribute something, if not to you then to someone reading this. A massive amount of "small" cores is likely not going to give you much joy, certainly not in most games, as @morosis82 says. However you could get something almost as special and very closely related by going for a higher clocked Threadripper.
Your current setup is very very severely hampered by your CPU, those bulldozer chips were not particularly good when new and at this point your 3070 isn't able to do a lot of what it has the potential to, because of your CPU. I had the 9590 or what it was called, the "fastest" of that family of chips and even overclocked to the max it never did games well. Anything Ryzen based will be a huge leap, at the same clockspeed or lower, because it's massively more efficient and optimized, which includes both Epyc like in the video and Threadripper which I suspect would both make you get a large speedboost, as well as stay within what I would guess was the intent he had when he looked for something powerful for gaming.
My primary workstation has the 64 core 3990x which I use primarily with Arnold Render in Cinema 4D and Houdini. Been curious how much faster the 128 core CPU is. Looks like about 30% faster based on your test numbers. Great video!
Cinebench 2024 is using Redshift XPU which until recently was a GPU only renderer which is quite a bit different than the old CPU based physical renderer on previous cinebench tests.
It's WAAAAY more than that lol. It's about +40% over the Zen 3 64-core Threadripper Pro 5995WX which is already ≈+25% faster than your chip.
What an epic analysis! I can't wrap my processor around the fact that this beast accommodates 128 cores. Good point about the tech in high-end chips eventually trickling down to our home PCs. From raid controllers to cloud-based workloads, it's fascinating how our everyday tech is influenced by these monstrous CPUs. Thanks for the thorough walkthrough, I was on the edge of my seat - almost fell off when you started to spray the coolant! Maybe next time you can try gaming with a liquid nitrogen cooling setup, just to keep things chill. Looking forward to seeing more from the wild world of CPUs!
An "EPYC" analysis if you will ;D
@@Licher_ Dang it you got there first xD
They could have named this entire lineup EPYC Legion cause of the 6096 socketpins
and if todays programmers wouldnt be paid off by hardware manufacturers to put out even worse code that uses all 128 cores to full while providing the same performance as a 20 year old processor :)
@@DeviloftheHelll ???
I always think about how sooner or later they'll just run out of Italian cities and they'll have to use smaller and smaller tows. Like, imagine AMD EPYC BASSANO DEL GRAPPA
Si gode
Commento inaspettato del giorno ahahah
Lan party AMD da Nardini 😎
We have 8000 towns and villages, not happening anytime soon, where is my AMD Epyc Maranello? :D
Da un pò che aspetto AMD EPYC VILLARICCA
Some other cloud native workloads, in addition to containers, as another commenter mentioned, are people running bare metal servers and they have their own virtualisation layer on top of it. How this helps is since they own the virtualisation also, they can have multiple different VMs running on it, performing different operations on the same set of data. And since that data resides in the same CPU/Memory space, the latencies are ultra low (~10-100 ns), what is called HPC in the industry.
My org runs simulations on market data and these are hundreds of files spanning 10s of GBs each. Being able to load all of them into memory and then running parallel simulations, all on 1 single CPU would be a game changer in terms of performance as compared to running 64x2 CPUs in NUMA config as currently, we are maxxed out at the CPU level, only limited by the memory latency and memory throughput.
It would be awesome to see such a cpu compiling a big project like the linux kernel or something else to see how fast it is, the clock may not be so fast but so many threads could do it so fast I can't imagine
Generally speaking those "cloud native workloads" are based around virtualization and/or containers. For example, you generally give a container soft/hard cpu and memory limits. Then run lots of them per system. The more cpu and memory you have the more you can allocate. Linus made a comment about them not needing to share memory between cores and that is generally correct in this type of workloads.
Openshift benchmark when (not sure how that would work and what the meaning of such a test would be) 3000 apache pods on a single cpu let's gooo
Serverless L
That's what I was thinking too. Thats what this CPU makes sense for anyways. Usually the only workloads that benefit from more cores (even if the cores themselves are weaker) are anything to do with containerized workloads.
So it's like virtual Box but in a bigger packet
@@quanghuyvu2649 virtual box is an interesting example for this processor. It could very easily utilize all of those cores with vms. Outside of a lab, dev, or test setup it will rarely be used. In the path to prod you'd use something like openstack, docker, K8s, or something similar.
15 years ago, 128 cores where only available in compute clusters with high speed network interconnect.. I remember preparing computationnal fluid dynamics on this type of cluster and waiting a few days in the queue to run a 32 core job...
Even worse than that, it was only 5 or 6 years ago that you couldn't have this many cores in a quad socket system.
We could stack Xeons in DELL servers, we did 32 Cores max on one system.
running VM's, Oracle
Yes. And 30 years ago many PCs still ran on MS-DOS. I guess that's how technology works hey?
@@funbucket09. Did you see that….. it was the point going over your head.
@@robertt9342people like them can't understand what a KB even truley meant. How large a system like these would have been 10 yet alone 30 years ago. 30 years ago half a GB of storage cost ~300$ That now would get you over 20tb of storage. That's roughly 12 million dollars worth of storage in 1993. Not counting for inflation which make it 25.5 million worth of storage. 🤯
I remember how when I was a kid everyone had 128MB or 256MB of ram and when someone had 512MB it was like, whoah what do you need that much for. And once 512MB became normal but 1GB was still kinda extravagant, people would buy a 512MB stick and then wouldn't know what to do with the old 256 stick, and so they'd put both and run 768MB in single channel.
This computer has 768GB.
Similarly, when I was a kid a 1GB disk was considered a big one. Now we have disks that can have several TB each.
It's like, in some 25-ish? years we got to a point when 1GB nowadays feels like 1MB back then, whether storage or memory, and 1TB today feels like 1GB back then. And it's messing with my head now lol
Well, you gotta factor in that eventually adcvancements will slow down. At some point we will reach hard physical boundaries.
This computer supports way more than 768GB, it's just infeasible to go higher unless you have a reason to spend the money. 256GB single dimms can be had for $3k each.
What's truly crazy is that the 768MB of memory you're talking about is now how much on-die cache these chips have, or a little over 1.1GiB for the X3D Genoa variants.
As a server technician that works on these daily, I'm happy you mentioned the motherboard CPU pins and what problems just one can cause.
some days, it makes me miss PGA.
some days.
@@chrisbaker8533Imagine 6000 tiny pins
Maybe pseudo BGA is on the books. Something a bit less delicate than pins
Linus the way Maxons bucket rendering works the larger memory you have the larger bucket it has. Bucket rendering with small cells was designed to prevent out of meory errors or slow disk swaps on systems with little memory. The new version automatically optimises bucket size, which you can manually do on say Arnold or Vray.
this was one of the few recent videos I have enjoyed thoroughly from LTT. It has that classic vibe to it :D
Genoa and bergamo r italian cities, as an italian im so proud of amd rn
I would love to see you attempt some software rendering on one or more of these chips, we are approaching GPU levels of core count here.
Crysis on CPU only
@@PhyrexJI'd love to see that
@@PhyrexJthat's been a thing for a while.
Yeah, a CPU port of DirectX!
they did a while back with Crysis
What happened to the blowiematrons? This would have been a perfect scenario for one or 2 of them.
Two super fans on XE04-SP5 cooler was doable. But better would be water cooling with ThermoFlex 5000 Chiller and water block taken from XE360-SP5 😁
To linus's point about F1 tech eventually making it into our daily drivers, there's actually a fantastic BBC documentary from 1984/85 that shows the entire process that went into the creation of the Ford Cosworth GBA 1.5L Turbo V6 that went into the 1986 Beaatrice/Lola-Haas/Ford (Carl not Gene).
At the end of the first part and beginning of the second it shows the development process of the ECU and they show the electronics engineers from ford motorsports europe working well into the night chasing down problems in the circuitry before the "big box" (the ECU was the size of a toaster oven) went into the car for its first track tests.
At one point they realized that there was a huge issue with detonation that was being caused by electromagnetic interference from the combustion chambers interfering with the ECU's operation, so they had to change the design placement from on top of the engine to inside the tub.
They even showed the IBM 286 desktop that the engineers in europe used to communicate with the head of ford motorsports over in detroit and explained how the multi-layer cryptographic encryption system it used to prevent competitors (like say Bosch) from getting into their system to steal proprietary information worked.
glad to see AMD crushing the competition my 3800X is still killin it till this day.
You guys should try running a super massive factorio megabase on it. I wanna see how big one can be too bring that CPU to its knees.
Factorio is limited by cache-, ram speed and timings followed by clockspeed for its ups calculations. Those cores might only be usefull for speeding up map generation
I'm always astonished how quickly and how far technology has advanced. The first PC I built back in 2003 had 256MB of RAM. This PC has 768GB. Granted, this is not a home PC and it's likely nobody here will ever be running this setup at home, but it's still crazy to me that my first PC, which was only twenty years ago, has 0.3% of the memory that this one has.
You have the decimal point at wrong place. Your first PC had 0.03 % percent of memory.
I was talking to a coworker the other day about my first USB thumb drive. A whopping 128MB that probably cost in the neighborhood of $40-$50. A full gig was way out of the question for me at that time. They're sold in packs of 5 for about the same as cigarettes now.
I think some Ivy-bridge-EP processors already support 768GB RAM, those were released back in 2013
Consumer hardware takes 128GB of DDR4 or 192GB of DDR5, but that could go to 256GB if they end up making 64GB udimm sticks (which would already be 1000 times more than your first computer, still on consumer hardware)
@@albertlong3492 yes i remember people buying HP Z 80something workstations with 1.5 TB of ram around 2014, however that is much slower memory than what's available now
Got to play with engineering samples of these when I was working with an electronics recycler. They let me build a server with 2 of these, with 256 GB dimms in every slot. They wouldn’t let me run anything but cinebench on it (for some reason), and wouldn’t let me publish any of the results, but it blew everything else out of the water, even the quad socket 4th gen Xeon platinum servers they had.
Ended up turning them all into dual-socket RAM testing machines.
12:50 It explains the best what monster of the chip this is.
"But who's gonna spend 12.000$ on a cpu?"
Data centers
Many many company's will buy hundreds of them not just one ...but I get what your saying
They missed the sarcasm
People who make more money from having more CPU power.
Intel
I'm never going to get over how big the die is on EPYC.
“When your socket is almost as big as your memory slot” #justepycthings
There's 9 dies and they're not that big.
It's the same as Threadripper, in fact Threadripper are just consumer versions of EPYC
Compared to all other CPUs, it is GIGANTIC.@@jfolz
One day we're gonna have Epycs that are gonna be the size of a 2.5" drive :D
I literally won't ever use or touch most of, if any, of the stuff reviewed in LTT videos - I mainly watch for the sheer excitement and human that is Linus. You, fun sir, are a treasure ❤️ and are cherished as one, thank you for the joy you bring and share in each video and thing you do ❤️
Editing for this video was amazing! Really seems like that new work schedule got everyone more relaxed, which in turn makes far better videos. I'm glad you guys were transparent with your viewers. 😍
I used to have a Opteron X2 170 with a 1Ghz overclock (on stock cooling!) for a gaming rig. Older CPU's of that type had a lot more cache and could have similar clock speeds to their Athlong 64 counterparts, and it meant a lot more performance back then.
Worth noting that we may yet have an interesting tech development in the future. 16 core complexes plus some form of Vcache might not be completely off the table! :D
I don't know if ARM options will ever catch up in I/O. it is an area where they are constantly behind equivalent x86 chips
7:12 -- only 768 GB of RAM. I remember way back around 2003, when building my pc with the (at the time) awesome Abit NF-7 motherboard and getting it up to 768 MB of memory, and that was amazing!
Pathetic. That is only 16 GB more than I have HDD space.
I remember my first PC in 2005 with only 1 gb ram anda a 16gb hard disk. I feel so superior at that time
I can see this being VERY popular in the HPC industry
I suspect most end-users of this monstrous Epyc CPU will be running Linux, so it's sad to see LTT yet again put Windows on their test bench for a server CPU. Phoronix Test Suite is probably something LTT should have looked at, because that has quite a few server-related tests in it.
Especially the gaming benchmarks as always. Yes, those CPUs suck at them, because of the low clock speeds. Just in the last video about a server CPU and the one before it and the one before that.
Would be interesting to go through some real workloads for that, even if they would have to introduce most viewers to some other benchmarks for that.
The plurality will probably be ESXi followed by Linux and Windows. These really aren't the current best option for Cloud data centers currently, so for right now you would be looking at in house clusters or specialized systems. That means ESXi followed by Windows followed by Linux. And before anyone jumps on me, I do prefer KVM over HyperV, but Windows also has RDS virtualization which helps give them implementation numbers.
Thanks for confirming Linux users are the vegans of the PC community. We get it you like Linux.
they said at the end of the video none of these benchmarks are real tests of what they are for, and that the people buying this sort of stuff would either optimise their systems for it or let the customers who are renting the servers to figure it out themselves, i seriously doubt the real end users of this cpu would actually be getting data from ltt in help with their purchase
The point of running Windows is so that it's a like-for-like comparison. To use Linux, they'd need to go back and test all the others on Linux. And any viewer would need to run Linux to be able to compare it with their own system.
Special Thanks to @wolfmanmods1428 for the use of the case! www.youtube.com/@wolfmanmods1428
*How many Litres thermal paste does it takes?*
how about a phone buying guide next
cant this umm you know be in a 2P system?
WORST.
SEGUE.
of.
2023.
@@SimanSlivaras long as the sku doesn't end with "p", you should be able to run them in a dual socket set up
Do a full build in the Opteron case, PLEASE.
1:56 The WinRAR reference is not lost here! Epic!
Our render farm back in 2003 had 100 3ghz single core INTELs. This one damn chip has 128.
can't wait to get my hands on this...
in 20 years time when im ready to build a retro PC
lol
i run the 3995WX and i use arnold renderer almost daily for my freelance 3d artist stuff. this epyc would definitley speed things up even more. my cinebench with r24 is ~3618 so around x1.7 with an epyc :O
The M1 Ultra comparison is pretty interesting when you consider it’s a 20 core/20 thread chip vs a 128 core/256 thread chip. I know Apple’s cores are pretty great in terms of IPC but I would have expected more than a 4x difference (and this is as an M1 Ultra owner). I wonder if there’s some other bottleneck in the system or in Cinebench r24 that’s limiting the performance
What is the TDP of M1 Ultra? 50-60 W? Let use 60. So it has 20 cores. That means, 1 core has 3 W TDP. So 128 cores should have 384 W TDP. But it only has 250/300W? That mena, that it is about for 100 cores the same but it alsi has multithreads (2/core), which makes it a bit more difficult.
waiting for a chiller cooling setup with this processor
He could at least grab some delta server fans for it like it is supposed to have. He is so cringe I can't stand him. Seriously I threw up a bit when he went to squirt it with water.
Take a look at GPU and cores affinity; in a worst-case scenario, you could potentially reduce GPU performance by a factor of 4. Only a few cores have direct access to the full PCI bandwidth. If the software doesn't manage this properly, it might need to go through another core, causing latency issues that could impact performance significantly. I'm familiar with these kinds of problems as I work with computing clusters.
Not much of a PC guy but, can it run Crysis?
8:33 - roooooofl...that was hilarious.
Cloud Native, I understand as containerized systems, predominantly isolated, where communication between them is done at network layers and not CPU hardware.
Virtual machines, containers or lambdas, mainly Web APIs or database systems (in several different flavors and concepts)
In other words, the final program is not the most important, but how the infrastructure around it is built.
You should definitely put the giant overkill chiller on the CPU to cool it
As a 3970X (32c/64t) owner I’ve been waiting a long time for these replacements. I’d be interested to know how reliable they are at hitting their max boost clock, because mine rarely did, even on a single core
Water cool it, bro
@@user-dv7hq2rh4g What about undervolting a Threadripper?
@@user-dv7hq2rh4g Tried that, also tried the IceGiant ProSiphon, in the end none of them allowed it to clock appreciably faster so I've stuck with a NH-U14S. I've tried undervolting too, but it wasn't stable.
Steven Chow movies are legends in my childhood. This relates me back when watching Gintama in my teens. Too bad it's hard to find anything likely in these days.
60 million dollar man, fight back to school, cj7, KFH and etc. are also best watch.
It's full of parodies sourcing from anything anyone might encounters in life. This is why I like his movies.
I had one of those AMD R2K8 on rollerblade wheels in my office while working on the C++ compiler bring up at Microsoft! So much nicer than the Itanic vaccuum cleaner cases!
too bad Linus didn't remember the windows WARP thingy that runs DX11 in software mode, he did bench that in the past with a threadripper on crysis 1 iirc... would love to see it on this CPU
I disagree with the notion that high end data center chips are likely to eventually make their way to desktops anymore, nor do I think they necessarily _should._
I'm not so sure that such a unified architecture across server, HEDT, desktops, and laptops is really a good idea. It sounds good on paper, but we're increasingly seeing more and more per-device specialization, and I'm not sure just throwing the latest Zen cores into everything is that efficient.
Considering they build these cores on the latest and greatest TSMC node, you'd kinda expect them to be a lot more competitive vs chips built in older ones.
...this Epyc chip is super cool though, I admit it.
Been waiting for this for awhile glad to see insane cpus
Should've tried out software rendered Crysis. There's a video floating around of someone trying it on an Epyc a few generations ago and getting a frame every few seconds.
Maybe this chip could be fast enough for 1fps? :p
Would love to see what something like this would do encoding x264, x265, AV1, etc.
This is without question my favorite LTT series. Love looking at things I will never afford
I am a bit disappointed you didn't run the Crysis software mode. That was the big thing about the Threadrippers (and you did it multiple times!): it was somewhat running. I fully expected you to show it to us and it would have been a tremendous uplift.
Awesome to see LTT could use could so heavily upgrade the rare Opteron Cabinet I had on the 20th anniversary of the Opteron Launch!!
The result is truly EPYC 😁
I loved my Opteron 190. A duel core unlocked CPU on AMD's desktop Socket 939 was amazing in its day.
A 190 was super rare! I’ve still got my 185 which was the equivalent of an FX-60. Good times
I'm going to absolutely spec these for my next vcenter cluster.
Ran CS2 on my Dual 2697v2 setup, FPS was allover the place with my 2080. Upgraded to a 3900XT instead.
Many thanks for the amazing video and review. In your opinion would a system like this be an overkill for VFX work, especially FX simulation using Houdini? And if one would buy like this would it make sense to invest into a good GPU also, or not necessarily, assuming one would be using Karma XPU for rendering.
Many thanks for any info :)
I checked my AMD CPU and found out that they use SI units on the spec sheet on their website to represent IEC units for L3 (and other) cache. Please start using IEC/binary units where applicable!
This is iconic for me. I remember watching similar videos on early intels from you and it’s nostalgic.
Can we get some guides for a few pc builds that would be great for different budgets this black friday? I'm looking to build a high end system that'll last 7-10years, with hopefully just a gpu upgrade in that time. I was thinking of keeping my 2080ti & upgrading that a couple of years down the line & then maybe again before the whole pc needs updating again. Are boards with pcie 5.0 worth an invest? there's quite a few questions i imagine
just get a top of the line processor, those tend to last 10+ years easily, paired with a beefy feature rich mobo, i did that when the first i7 ever was launched i bought the extreme edition top of the line one, back in 2008, my wife STILL uses that system as her main PC (she loves the case for some reason) (15 years old rig)
At 7:45 there is a strange audio issue. I thought LTT checked their own videos now!
Now we just need a new Linus personal server update with this bad boy
What would be interesting is somehow do some waterblock on the vrm and the cpu and let it rip. Wonder if you could get a custom bios to allow overclocking?
Weirdly I saw this in person when I visited the Lawrence Livermore labs for their new super computer.
Commercial software from VMWare, RedHat, and others often have billing models based on the number of servers or number or physical CPUs. So if you have a billing model that charges based on CPU count or Server count, and you can cram 128 cores into a single CPU / Server, you can save money on licensing fees. It's not unusual to have license fees around $10K/CPU/year, so a $12K CPU would save quite a bit of money over 5 years of licensing.
4:25 no love for LTT screwdriver anymore? 😢
IIrc you ran crisis on a cpu once. Please do that with this cpu too. I would love to see if the performance improved
I'd love to see you run multiple virtual machines on this, with multiplw GPUs. See how many CS2 instances you can use at once.
X gamers, one CPU needs to try this.
I’d love to see a follow up showing games running just on the cpu, like with the threadripper video a few years ago. Wonder if it can handle more modern games than crysis 1 XD
6000 points in CB2024 is 6x that of my 5900x, but its also only 60% of my 4060 that can break 10k points at 100w. I think the biggest thing CB2024 taught us is that CPUs need to leave the rendering to GPUs.
Less that and more that GPU architecture is highly optimized for rendering.
…unless you want to render a real scene for a big budget movie, in which case the textures alone might be in the range of 100 GB - good luck fitting that into any GPU memory.
A bit more than the 822 points my i9-10900X gets lol. My GPU, GTX 1080, scores 3993 points
till you realize that GPU's with a ton of memory cost a whole alot more than this CPU decked out
24GB VRAM costs you 2 grand USD and that translates in roughly 144GB VRAM worth of cards while this CPU can do well over 1TB
for smaller scale GPU might be fine but for 100+GB projects CPU's start to be a king due to capacity unless you get a board which can support that many cards
@@mephistoxd2627 Nvidia H100 says hi
You should have tried the crysis CPU renderer you showed off with the last high core count amd cpu
i wish they would have done the running crysis on the CPU render like they did with that one 64 core render like a year ago to see how it would run on a 128 core cpu...
Holy shit, I used to have one of those cases. I got it from a pc recycling place and made my own motherboard tray and psu mount for it.
Honestly never thought I'd see another one. I had no idea what it was or that it was rare.
I can already see the budget builds 5 years down the road that utilize these monsters. I am running a 11 year old Xeon as my chip in large part due to being broke as hell but also since it is still working quite well for me. I upgraded the gpu last year since my 4gb 680 was still working but 4gb video ram is no longer overkill now it is often a joke.
I've got a handful of dual 64-core machines I'm responsible for. They crunch a large C++ codebase into software all day every day. We can always, always, ALWAYS use more cores. I don't care if they're 2ghz or 3ghz, we will use them all. Looking forward to our preferred vendors to start offering 2P systems.
Just a friendly advice from a "thumbnail maker" and someone who loves looking at them., I know this is irrelevant but the shadow of the CPU is way different than the "drop shadow" on Linus. Anyway, I am a long-time fan and I appreciate how your thumbnails evolved and how "catchy" they are now.
Linus is making me feel old.. i had an opteron and a 939 mobo, we OC'd the heck out of it, even had a friend break and keep the world record for OC on it on air. twas quite the time to be alive. technology was literally leaping ahead in terms of pc components.
Fun fact! They used a miniature version of the CPU for this entire video, as to show it's size against a normal person.
The real one can be seen in the thumbnail, with linus standing next to it - Yes, he's short.
I love this kind of LTT content. Stuff I could never afford jankily tested
I love how the wheels on that case are splayed out: It's just like it's an old HotWheels car that needs its axles replaced.
I like David’s audio being included it made the video more entertaining.
hardware in another ~5 or so years is gonna be wild, with AI in rapid development we are probably going to start seeing a lot more consumer AI tools which need powerful hardware to run
maybe in 10 years or so something like this will even be commonplace
If Linus dropped this, he would have to sell the lab to pay it off
This cpu isn't multiple 100k
Its only 12k. Linus could afford it. But he will cry over it for years.
13:55 this just made me appreciate modern desktop CPUs even more. The 14900k (a 32T CPU) can hit over 43k points in the same test, which is almost half the score as this 256T CPU! (8 times the threads!!!)
And remember, this is a test that can actually use all of those threads. Just insane how far technology has come.
Don't. That cinebench test scene wasn't anywhere near heavy enough for the cpu to shine. The gap is huge.
Im surprised that the p/o pins on the 24 pin connector are only 5V until now, If you think about it, P=VI where V equals voltage and I = current, so to increase the amount of power you have to either increase (V) or Increase (I). The Problem is however that when you increase (I), you are increasing losses which equals increased heat, so to increase the amount of power delivered to the chip you have to increase (V). The only problem with increasing V, is that you have to make sure that the dialectric strength of the insulators on the board can withstand the extra potential difference (P.D) between 12V rails on the board and earth. As they are moving away from 5 to 12V, the chip designers have clearly already done this. Luv ya work
OZ
And if you do need more cache, Genoa has 3D V-cache CPUs too
This would make an insanely good cloud gaming server or multi-user gaming rig for a lan party, would love to see that!
untill the game DRm or anticheat realises it doesn't like to be virtualized
128 "execution units", 400W power draw, eye-watering amounts of RAM support, decent rendering capacity, ~$8000 MSRP... this is just a modern-price GPU that goes in a processor socket :P
you NEED to put all this in a retro box for a full stealth build! That board screems early 2000's school computer!