$90000 NVIDIA A100 GPU Server
ฝัง
- เผยแพร่เมื่อ 16 ม.ค. 2024
- #ai #gpu #workstations
CPU: Intel Xeon Scalable 5220 (2EA)
M/B: ASUS WS C621E SAGE
RAM: SAMSUNG DDR4-3200 ECC/REG 256GB(32Gx8)
SSD: SK Hynix PLATINUM P41 M.2 NVMe 2TB
VGA: NVIDIA A100 80GB (4EA)
CASE: 4U RACK
POWER: SuperFlower SF-2000F14HP LEADEX PLATINUM
FAN: Phanteks PH-F120T30 (9EA)
CUSTOM PARTS: Alphacool 3647 (2EA), Alphacool A100 Carbon (4EA), Alphacool 360mm 60T (2EA),
Alphacool PUMP, Manifold 7Port, Quick Disconnect 6Set, Black PVC
Yangcom Home Page
www.yangcom.co.kr
Yangcom Instagram
/ yangcom_official
Yangcom Facebook
/ yangcompc
Yangcom Blog
blog.naver.com/combox0 - วิทยาศาสตร์และเทคโนโลยี
You know shit gonna be real expensive when you don't even recognize half of the hardware's names.
Could not be for cheap one
But all of them are easily recognizable?
tell them that you get nvidia A100 to some average gamer and see their reaction@@BlackJobZ
We r talking about kinda above average pc user, not tech professionals@@BlackJobZ
Jelous 😂😂😂😂
Finally a build that can run Crysis in 1080p 30fps,nice 👍🏼
640p 20 fps Maximum
@@Porsche_x my results are using Frame Generation and low settings
@@des7royerz So yes, I said 640p at 20 fps using graphics very low without dlss and without frame generator
LTT ran Crysis on AMD Server CPU with software rendering and got like 10 or so
with dlss 3, fsr 3 and low seting 🤣
This PC consumed more power than my entire house electronics combined
about 2kw when all processores is max-loaded
Your water kettle would easily consume more power than this machine.
@@NowhereNear42 we talking about electricity, not heat
@@thenasiudk1337 You talking about power. This PC uses electricity to produce heat. So does your water kettle.
Doesn't use more than 2kw.
Finally, a server for running Latest version of minecraft in the future.
😂😂😂😂😂 Minecraft
Tetris
still only get 45fps in vanilla MC
Vastly underrated comment. 😂
А ты в теме😎
would not like a coolant leak in that
I can't imagine how satisfying it must be to train LLM´s on that thing.
you can easily rent set up like this for around $4 per hour
@@user-vp2tv8ff8j Renting is not satisfying as owing and running and training LLM's locallly
@@rd_626what the hell are you talking about?.The satisfying OP said isn't about “owning and training”...its about how fast it will train LLMs.
Try renting tpuv4 or even the new ones tpuv5s....smooth as butter. you will never ever run anything on gpus again lol
@@sohailmd123 Just FYI..... I wasn't saying that to the op
@@rd_626 “satisfying” is literally OPs point of contention. you can't take it out of OPs context....any ML engineer only gets satisfied/orgasms on how fast his large data is being trained before his eyes....not by owning costly shit just to see it train mid compared to tpus
finnaly a pc to compile gentoo
You would have the fastest emerge times in the world
my i5 13600kf took 4h to emerge -avq
this thing would do that in 10 sec xD
-Для чего тебе такая сборка.
-Чтобы Excel работал без лагов.
Наконец-то я смогу открыть 4 вкладки в хроме))
В перерыве можно и пасьянс разложить по-человечески.
I'm afraid to ask this question and rather just look at this beauty but "Does it even run..?"
Crysis....
Used for AI backend stuff. Mostly for training. Runs only on linux
It must be so scary to work on gpu's that expensive
Love to see the performance stats on it once it's powered up.
I am not a fan of liquid cooled servers, but we have air cooled units with similar specs (mainly Supermicro) and they are way more crowded and noisy as hell. That one looks really nice and neat, and you should be able to sit next to it without going deaf. Also, in the long run it won't end so full of dust and crap. This one of yours is a custom unit though, so the client probably had certain requirements in mind, but not others. I see he/she decided to skip things like plug and play redundant PSUs, for example. Also, any leak could cause catastrophic failure and down time, which is not always acceptable. Anyway, very nice.
I completely agree, liquid cooling in the server environment is a complete nonsense. It doesn't matter how qualitative is the cooling system, it will leak sooner or lately.
@@noJobProgrammer I know some servers use liquid cooling but it's probably more like AC, with heat exchanger close to the server racks rather than using water blocks directly on components
In high density applications such as HPC or AI training liquid to chip can be used, particularly in the 80kW/rack+ range
IBM Mainframe can be liquid cooled. Since its reputation for reliability, I’m sure reliability isn’t an issue if do it correctly.
@@noJobProgrammerif it leaks, you haven't done it right. Does your house plumbing leak every few years for example? If you do it correctly, there is absolutely no problem to be had there
Is that 2kw PSU enough to run two Xeons and 4 A100s?
Yes
If you assume 500W per component at full power (it could happen), then it's 1000W short.
@@NegativeROGA100's are 250 W.
@@Mr.Not_Sure lul
@@Mr.Not_Sure A100 on AWS can use upto 450W. Still, in most local setups people will limit its usage to 350-ish because even a good liquid cooling won't cut it.
Fyi, the instance i use is p4d.24xlarge so they are 40Gb versions. not 80Gb. i don't know if 80Gb ones work in lower watt or not.
interesting setup. is 2kw power supply enough to fuel system like this? and what about temperatures with closed cover?
Why don't you do an actual review of the power it has? Some benchmarks. It would be awesome.
Kinda want to see the thermal performance of this build. The fans don’t seem like powerful enough.
Its not about the fans. Its about shitty MX-4 that he put on the everything
Yeah, the most overrated thermal compound. Noctua NT-H2 is way better for example.
@@Turboriderthermal compound isn't making or breaking this build lol. Maybe the most unimportant part of cooling as long as it's applied right.
@@MustafaKhan-hg8lu I have my own experience that I have made over the last decade on many different computers and laptops. But I'm not going to argue just do whatever you think is right.
@@Turboriderthen you should use Kryonaut Extreme or a Kryosheet. I myself work on a lot of stuff and MX-4 is completely fine for everything you could want as a "normal" person.
It also really depends on what you want to do with it. For example I've had a bunch of issues with NT-H2 squishing away from my GPU die due pump out caused by the extreme heat and power I was pushing through that card (3090 with an XOC BIOS).
On my 7900X, its another story. No direct die setup. NT-H2 was fine and pretty okay, one of the better pastes that I used. But with Kryonaut Extreme, I got way more stable clock speeds while pushing the same amount of power and thermals. Heat transfer is simply just better with this one.
However, I would not recommend it to anyone that doesn't want to push for the absolute best results. It's simply too expensive. But for everything I use personally, I use not much else anymore.
i guess a single cooling fan is worth my entire house but okok 👍
Watching that cloth glove get close to the socket in the first 5 seconds was nerv racking
I can't imagine how satisfying is disassembly and repaste all again in the correct way.
Where are your CPU heat sink clips? Or do those water blocks not allow them?
Any reason it should be mounted this orientation? Why not upside down, so leaking coolant will not damage the mobo?
Bro build his own personal super computer 😮
guys thats pure power, nothing else
It's crazy how much tech goes into pumping around less than 2 volts through a few chips, and then we need a hoover dam to keep it all cool.
Thanks, amazing, will be nice if you power on the server. Windows? Linux?
Why you didn't put ram in all slots? I think you crippled the memory speed quite a bit. 🤷♂️
How long will game streamers have to play before you get your money back, including the energy bill.
How it felt to work on the big box palsma tvs back in the day.
All zero maintenance tubing too. Very nice.
Hmm, this build needs a bigger acrylic case, awesome setup!
Just one A100 would be my dream frfr
why would you need one ? It's mostly for data centers and stuff, unless you're doing something to use that 80gb of vram, because for gaming it would be pretty uderwhelming, as the driver suport wouldn't be the best.
@@cooooooooooooooool3 because ai applications in general, aswell as LLMs run like shit on the RTX 4070. Training obj detection nets also take quite a while even with pytorch+cuda :(
@reapiu8316 That makes sense, you have pretty vram intensive workloads. My dayjob is video editing, so I never exceed 4gb of vram use even with 4k editing
@@cooooooooooooooool3my Firefox uses 11 gb vram :(
Depending on the task. Nvidia Tesla P40 is not a bad entry for 24gb of vram in the used market. Runs RVC smooth as butter in my experience
Props to the guy building it, has to be the first person I have seen who isn't deathly afraid of a little extra thermal paste.
i bet this rig can finish the f@h workloads my rig does in a week, in like an hour
It sounds like a jet engine while its running and needs cooling made for a small office to keep it running. Unless you are 100% gpu and 100% ram usage, it won't hit near its total wattage consumption. In comparison to a dgx1, it can do 40% more work while consuming 20% less power doing a task that would max out a dgx1.
2 questions: 1- Why not fill the remaining memory slots with 4x32GB?
2- Would custom length cables have removed some clutter and added to the airflow in the U4 chassis?
Nice job, I've already got a perfect spot picked out for it.
What the hell IS bro cooking
His CPU's most likely with that thermal paste application.
Bro gonna create another dimension
what are those holes on the IHS?
Are the Xeon’s thermo-electrically cooled? Is condensation still a problem? 😔
There are no Peltier cells there. These are ordinary water blocks.
I'm waiting for the benchmark test, do you have it? how long does it takes to train nanoGPT medium size model?
He just wanted to show off and prove he could afford one.
@@shidongxu3410 They are an actual computer shop! This is for their client
@@shidongxu3410 This is probably his job and he's just showing the process
@@shidongxu3410 no way someone can own 4 A100's and use it for personal usage
@@rd_626 a lot of people can but why would these people do it is the proper question.
amazing how they could get the cooling plate of the gpu on the market..
"bro the servers are bad im lagging"
The servers in question:
What's performance can you show any performance.
Is it necessary to have two cpu?
now im ready to play minecraft
Ready to open google chrome with 10 tabs)))
엔비디아 폼 지린다
Это для 4ой вкладки в хром? Или для 20 ФПС в киберпанке с пастрэйсингом?:)
That's progress. In the 90's we would pay this voor a DEC VAX 128MB memory expansion.
Nice boiler!
I would’ve mounted this in an enthoo pro 2 server case😊
Bros getting ready for gta 7
what gpu server used for? first time i see this monster
I actually have 2 of those SK hynix M.2 2tb for my pc
no ram, vrm, eth cooling, different length of tubes lead to uneven water flow, correct me if I'm wrong
i need this for my school works
What's the reservoir with many tubes?
Can anyone tell me what model these frosted hoses are?
What is this server for?
This PC goes into the category of:"Nasa Super Computer" 😅
Which quick disconnects are these?
Insane.
Where I can buy this water cooling for A100 ?
hola esa super pc sirve para minar alguna cosa?
no threadripper or epyc?
Question? Can it run ARK Survival Ascended without using console commands?
One can dream.. but never have.
Diesen Arbeitsplatz würde ich auch gerne haben. Den ganzen Tag mit Teurer Hardware basteln .
Ok I can build my setup I have the Alphacool A100 Carbon, now I need a A100 80GB.
BGM kinda reminds me of Dr. Driving..btw the build is
wooo why ont use a better quality of thermal paste?
MX-4? Seriously???? Why didnt you use Noctua NT-H2 thermal paste? Or Thermal Grizzly Kryonaut Extreme?
Y'all have been marketed to too hard. The thermal paste is maybe the least important part of cooling this over here as long as the paste is applied evenly. You don't actually need thermal grizzly unless you wanna overclock or if you just really like TH-cam sponsors
@@MustafaKhan-hg8lu you know its A100 we are talking about, right?.. its not your average 4060
там и GD900 справится
Such beauty.
I never heard of leamax poeer supply
Question, why Xeon and not Epyc platform? If i recognize correctly, Epyc is made for servers, and its powerful
It doesn't matter (whatever was available/affordable in terms of CPU+mobo). Its a GPU node , the CPUs are only there to provide the PCI lanes, run the OS and handle the IO. Everything else will be handled by the GPUs on application level. That is why he didn't put much RAM in it because , it doesn't need it.
Very nice build, but this watercooling loop seems underpowered
Why use a football field to replace a CPU socket?
Everyone talked shit until the snow part of crysis then parts started to melt
Almost got to wormhole phase 😂😂
Q: What does this computer do?!
A: yes.
What are you using this server for?
А где тесты?
What case is this?
you can have the best waifu simulator on this thing
only fittingsa and tubes cost are more than my desktop's
Why are you wearing gardening gloves? 😂😂
oh so that is why we have a pc part shortage
Finally, something adequate to run Tetris
thats cute but tiny setup probobly order for some small Ai research shop, not many if any institutions will go go for liquid cooling on large scale in data center for 4 GPUs
Let's see on Facebook marketplace 10 years later
Why not samsung ssd?
Скажите пожалуйста , эта сборка потянет MARIO или TETRIS ?
What is it good for?
Min specs for video playback on Adobe After Effects 2023
Refilling water is gonna be nightmare better use mineral oil
❤❤
Cyberpunk cam runit
?
A *0.00000000000000000041%* of Quantum computer's power 💀
C'est Gleen qui monte le pc 😮Omg
Il lui ressemble sur les reflets x)
someone gonna make some real money with this monster
Watercooling A100s is brazy.
Why no NVLink though?