- 69
- 531 735
AveryPlays757
เข้าร่วมเมื่อ 29 มิ.ย. 2016
AI Server Series: Pt.1 Build a Server for LLMs and Inference Training + Benchmarks
Parts Used:
DL380 Gen 10 SFF (Barebones, will need heatsinks, and PSUs)
2x Xeon Gold 6132 2.6GHz 14-Core CPUs
128GB DDR4-2400 ECC
1TB NVMe
2x Nvidia Tesla 12G HBM2Cards (Supposed to be the 16G HBM2cards)
DL380 Gen 10 SFF (Barebones, will need heatsinks, and PSUs)
2x Xeon Gold 6132 2.6GHz 14-Core CPUs
128GB DDR4-2400 ECC
1TB NVMe
2x Nvidia Tesla 12G HBM2Cards (Supposed to be the 16G HBM2cards)
มุมมอง: 5 905
วีดีโอ
Building a Apple Xserve Rack for Xsan! Pt.1
มุมมอง 9893 หลายเดือนก่อน
Cool Xsan project coming up, alongside the other rack builds :)
2024 Homelab Build Part 6: Working On The AI Rack! (Mini Rack)
มุมมอง 3.6K7 หลายเดือนก่อน
Exciting Times! just re-arranging networking stuff in this vid.
2024 Homelab Build: Part 5: Quick Lab Recap / Progress Report
มุมมอง 3K7 หลายเดือนก่อน
Quick Progress report
2024 Homelab Build Part 4: 40Gb pfSense Router!
มุมมอง 3.7K8 หลายเดือนก่อน
Heres the new overkill router!!
2024 Homelab Build Part 3: The Great Rack Migration
มุมมอง 2.3K8 หลายเดือนก่อน
2024 Homelab Build Part 3: The Great Rack Migration
2024 Homelab Build: Pt.1.5-Hardware and Software Reconsiderations
มุมมอง 4.8K9 หลายเดือนก่อน
2024 Homelab Build: Pt.1.5-Hardware and Software Reconsiderations
2024 Homelab Build: Pt.1-Hardware Overview & Assembly
มุมมอง 26K11 หลายเดือนก่อน
Homelab Build for 2024!
32-Core Hackintosh Pt.2
มุมมอง 1.6Kปีที่แล้ว
Well, well, well, after much let down here is part 2... Part 3 where we test out ACTUAL dual 16 core CPUs coming soon,
Building a 32-Core Hackintosh!
มุมมอง 6Kปีที่แล้ว
Pt.2 of the build! Yes, I did end up using a RX6800XT in the system after testing (you'll see this in Pt. 3/the install) Tags Dual Xeon Hackintosh,Apple Silicon vs Hackintosh,M1 Max compare,M1 vs Intel 2022,64GB MacBook Pro,hackintosh,hp z840 hackintosh,Intel 16 core xeon hackintosh,cheap hackintosh,Lab,Homelab,Xeon,R740XD LFF 12 bay,R740 16 bay,M2 Compare,HP Z840,Network admin,Kali,Server rack...
HP Z840 Unboxing (32 Core Hackintosh Pt.1)
มุมมอง 1.7Kปีที่แล้ว
Unboxing the base of the new Hackintosh project!! TAGS MacBook Pro, i9 MacBook Pro, M1 Max compare, M1 vs Intel 2022, 64GB MacBook Pro,hackintosh,hp z440 hackintosh, Intel 18 core xeon hackintosh,cheap hackintosh,Lab, Homelab,Xeon,R720XD LFF 12 bay,R740 16 bay,CCNA,Switch port access VLAN,Network admin,Kali,Server rack lab,home lab,AD DNS,active 2019 directory windows server,dns,dhcp,bootp,link...
2019 16 Inch MacBook Pro in 2022 - 6 Month Review!
มุมมอง 6K2 ปีที่แล้ว
2019 16 Inch MacBook Pro in 2022 - 6 Month Review!
2019 16 inch Macbook Pro in 2022? (16 Inch 2019 Macbook Pro Unboxing and Review)
มุมมอง 49K2 ปีที่แล้ว
2019 16 inch Macbook Pro in 2022? (16 Inch 2019 Macbook Pro Unboxing and Review)
Building a 18-core Hackintosh! (HP Z440)
มุมมอง 18K2 ปีที่แล้ว
Building a 18-core Hackintosh! (HP Z440)
Unboxing My New Backup/File Server! (R720XD 12-Bay)
มุมมอง 1.5K2 ปีที่แล้ว
Unboxing My New Backup/File Server! (R720XD 12-Bay)
Ubiquiti Switch Aggregation (USW):Quick Unboxing and Overview
มุมมอง 1.7K3 ปีที่แล้ว
Ubiquiti Switch Aggregation (USW):Quick Unboxing and Overview
Dell EMC PowerEdge R740 Unboxing/Overview
มุมมอง 1.9K3 ปีที่แล้ว
Dell EMC PowerEdge R740 Unboxing/Overview
Homelab VLOG: New Servers, FreeNAS, Hackintosh??
มุมมอง 4.2K4 ปีที่แล้ว
Homelab VLOG: New Servers, FreeNAS, Hackintosh??
Major Homelab Updates + 500 Subscriber Thank You !
มุมมอง 10K4 ปีที่แล้ว
Major Homelab Updates 500 Subscriber Thank You !
Taking a look at another cheap Mac Pro!
มุมมอง 6504 ปีที่แล้ว
Taking a look at another cheap Mac Pro!
My 10 Gigabit Fiber Network Upgrade (overview) + Mac Pro 10Gb Upgrade
มุมมอง 4.8K4 ปีที่แล้ว
My 10 Gigabit Fiber Network Upgrade (overview) Mac Pro 10Gb Upgrade
Home Lab VLOG: Deploying The new File Server!
มุมมอง 10K4 ปีที่แล้ว
Home Lab VLOG: Deploying The new File Server!
Could you please guide me through the steps or the patching and configuration process to enable the OS to support dual CPUs?
I have installed MacOS 15.0(Sequoia) on my Z440. 😀
5th one you said 😂, btw I just got mine with a 20 Core Xeon E5-2698 v4 and 64 GB RAM
I have received and installed a Xeon E5-2697 V4 (18 core CPU) in Z440 Hackintosh. 😀 GPU: Amd RX580 8Gb.
How does it compare in speed to it running under El Capitan?
I have changed my GPU to a RX 580 8Gb.
I have ordered a Xeon E5-2697 V4 (18 core CPU) for my Z440 Mackintosh run MacOS 14.3.1(Sonoma).
I bought the same core i9, 1 TB, 8 GB Radeon, but with 16gb of RAM, 307 charge cycles, for 100 USD at the flea market. and it is spectacular 😍✨
I have bought a Z440 (700W PSU) for 1100 DKK($160) CPU: E5-1620 V4 @ 3.5Ghz, Ram: 32 Gb DDR4, 256 Gb NVMe, GPU: Quadro P2000. Windows 11 Pro.
Lucky find!
I want to circle back on cooling those P100's - if you get into training, they will overheat in this setup. They are passive cooled and require quite a bit of air through them, usually involving some kind of guide. That's why those terrible end-blower coolers exist. To add insult to it, you blocked off the end flow with the power cables, which restricts what little air they are getting already. Believe me, I've been down this road and wound up going with consumer GPU's because they have active cooling. And worse, overheating might result in something not obvious, from throttling to outright malfunctions or data errors. Ghetto setups and these GPU's don't work well - and I'm as janky as you are, it seems! Good luck, it's a fun project, and I'm only a few steps ahead of you on the same journey. Just FYI I bought a used Supermicro server set up for AI cards, and STILL didn't get the datacenter cards. I've got 4 x 4060 TI 16GB cards - not the fastest, but budget friendly.
Thanks for the input! Monitoring with nvtop, with a 4 hour session the GPUs never really got that hot, the fan logic in iLO spins the fans up and down based on a thermal threshold. I will 100% keep an eye on it!! Also sweet setup, you should make a video :)
I like this! You have it figured out!
Pairing that CPU with 40Gb interface does indeed seem like an overkill. Is there any scenario that doesn't involve RDMA where that CPU can max out the bandwidth?
@@ruojautuma1 The 40GBe aspect of it is mainly for future proof and enhanced routing of data from vlan to vlan as the switches aren’t great at it. And the CPU will likely need to be upgraded
Hey ! Im since couple months now in they server rack & i woud like to put my computer in a 1u Rack and ive got a hard time trying to find 1u power-supply with atx connector & gpu does anyone know any website or brand & stuffs with pretty good deals ?
@@Wolf_Fr you’re better off using a 2u case, 1u stuff is pretty difficult to find, also I would check out SuperMicro
Seems like you might be a little better off stretching that excess power cabling over to the empty space above the PSUs, you have less cable blocking airflow to the gpus. Just my 2 cents.
Absolutely
Was there something that pushed you towards the P100s as opposed to a something like the V100s, besides just price, which is nothing to sneeze at for a home lab?
@@sevilnatas Just price to be honest
.@@averyplays7576 Totally Understandable. I have been looking at the 16gb V100 cards. At the end of the day, it's about finding the best deal you can for the most vram and cuda cores that you can afford. I got an EOL Epyc dual socket system w/ 256gb of RAM. I prefer AMD because the Epyc cards come with so many PCIe lanes. I love that data centers EOL their equipment so early for us home users. I have my setup running in an open frame for now, so I will need to figure out added cooling for the gpus.
@@averyplays7576 I really wanna figure out how to run the SXM2 Tesla cards. The are SO cheap. I can't find a motherboard or daughter board the run them though.
You gotta water-cool your camera lol
@@Mack_Dingo seriously haha
beautiful. Good luck on your projects!
Thank you!
it appears that only one card being used at time.
It uses both, but sparingly, I will have to look into it
Hey man, love so much your videos, great job!!!
Thank you so much!!
Do you have any issues with cooling on the P100's - I've seen various 3d-printed fan add-ons, do you think they're needed (I have an almost identical setup that I am just building out with dual p40s, so I'll be following the series along -- thanks for sharing, and for showing the raw issues like the nvme drive, it's all really instructive)
Temps are towards the end, no issues, however I am using rack mount server. If its going in a desktop than yes you will need supplemental cooling (like the 3d printed fan addons) If its in a rackmount server than you're fine. And good luck, let us know how it goes!!
Welcome back!! Your videos are awesome, keep it up!
Thanks!!, will do!
Awesome, would love to see more of the software side of everything you have going on.
100%, haven't forgot about the main lab (yet) haha. Problem is I keep on adding and changing stuff a lot ( its used a lot off camera). I will finish it up once I'm back home.
Love your setup, server go brrrrrrrr.
Thanks!!! Brrrrrrrr
Hello, Great Video. Do you by chance have a parts list for this server that you are building? I am inspired in seeing if I can duplicate what you are doing to also advance my AI knowledge.
Added to the description!
Running the 22 core xeon in mine ,
These videos are 10/10. Good focus, not trying to sell anything, using hardware available to the consumer. Inspiriy me to finish building my lab.
Appreciate it!!
nice Casio, dork
Can’t wait to order my MacBook Pro this finna be fun and lit
Iphone 16 new lab
Anybody have any links to the drivers
Anybody have any links to the drivers
Jealousy is an understatement.....
bro what's the music in the intro?
awesome
Just my 2 cents: Seems you have the normal heatsink (up to 120W), this Xeons (150W) need the high perf ones (777291-001) and also the high power fans (I can't see the fans you have in the video). Still working but not the HPE recommended configuration.
M1 air 8gb or i9 16 inches 2019
Hey I know this is a little late but I wanted to ask if you maybe could be doing a Cinebench 2024 run on this machine :D ? I use a 9700k hackintosh for Music Production right now but I wanted to upgrade to a dual CPU Xeon setup.
Still a great design this was the last Macbook I had before I upgraded to the 14" Macbook Pro M3 18GB, huge trackpad amazing speakers and dont jump on me but I loved the touch bar haha, it was ahead of its time, if they kept it with the F" keys it would made the current Silicon Macbooks amazing.
Surprised it worked at all with the main power to the motherboard not seated correctly 15:45
It was re-seated after the clip, it actually popped out
Mmm socks + carpet + hardware build...yummy ESD ;-)
Touching the metal on the leg of my desk with my leg usually dissipates the ESD, which I do out of habit before touching any internals , but yes a ESD strap would be the best
Excellent video! Looking forward to my own Hackintosh build. What size Asus Monitor is that?
32! Its a Asus PB328Q
this guy got his arm in way half video, totally useless video can not see what going on. Redo your video delete this desaster
Thanks for the feedback Roger
whoa that doesn't look like an X thermal paste looks more like he put a hex on that poor cpu, get a spatula and make it smooth like a cake iced fool
Is that a cat?
You heard the fans because you were obstructing the airflow keeping it on the comforter... not very wise
What rails did you end up going with? I've seen a few on Amazon but they pretty much all either get returned or have no reviews. Would be a huge help to know your recommendations and where you got yours. Also to know how have they been working out for you.
I bought the actual rails for each of the servers
@@averyplays7576 As in the OEM rails for each individual device or just rails from Amazon or where ever? I am looking to pick some up for my rack and I am looking for recommendations if you have any! 🤗
@@JeromeLove OEM rails all the way! Made my life so much easier 🤗
Hello I have z440 and i installed hackintosh sonoma successfully, but i wanna ask if i buy bluetooth usb and a wifi usb would i enable airdrop ? Or it’s hard for z440 to have airdrop on hackintosh ??