Running out of things to die - TrueNAS Motherboard Replacement
ฝัง
- เผยแพร่เมื่อ 7 มิ.ย. 2021
- Thanks to Linode for sponsoring this video. Visit linode.com/CraftComputing to get a $100 60-Day credit just for signing up for a new account!
Failure comes in 3s.... or is it in 17s, after the 16 drives I replaced earlier in the week. Either way, my TrueNAS server has been through its own version of 2020 recently. Time to make everything right.
But first... What am I drinking???
From Surly Brewing, it's the Dumpster Fire 2020, a 9.7% Hazy IPA that is now my favorite Hazy of all time. Fite me.
Links to items below may be affiliate links for which I may be compensated
Check out the Supermicro X9ADI on eBay: ebay.to/2Sn5PwL
HGST 7K4000 4TB SAS Drives: amzn.to/3g6MysB
HGST He8 Helium Enterprise 8TB SAS Drives: amzn.to/3ctb9Wa
Intel Xeon E5-2667v2 8-Core 3.3GHz: amzn.to/3ioIXaR ebay.to/3x7qxQ2
Supermicro 846 24-Disk Chassis: Supermicro 846 Chassis: ebay.to/3pAilW1
Find the parts I recommend on my Amazon store: www.amazon.com/shop/craftcomp...
Follow me on Twitter @CraftComputing
Support me on Patreon or Floatplane and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
/ craftcomputing
www.floatplane.com/channel/Cr...
Bossa Antigua by Kevin MacLeod
Link: incompetech.filmmusic.io/song...
License: filmmusic.io/standard-license - วิทยาศาสตร์และเทคโนโลยี
![[TH] Esports World Cup : Knockout Stage Day 2](http://i.ytimg.com/vi/xz3TW-k9HV0/mqdefault.jpg)
Next up, your case is going to randomly fall out of the rack. Might as well have a spare ready to go!
Completely underrated comment🤣
After all this, did it fall, or was it pushed?
Hey Jeff, great videos from yourself as well, keep up the good work!
Yo Jeff
You mean a spare identical second rack all set up right?
Pour one out for the dead motherboard, may it rest in peace.
😗🥃 Cheers
F
Or rust in peace
*cheers*
When the beer comes before the briefing you know it's gonna be a Linode sponsorship
I just zonen out, what is linode, ovh?
But it is Li'nowd or 'Linnut?
When people ask me what I run, I simply say "Old high end enterprise parts tied into a cheap Huananzhi motherboard. Pray for me"
same here!
F8 or TF?
I just spun up an F8 myself. And I'm actually keeping it. (Set the other ones up for other people)
@@Prophes0r F8
@@TheFlatronify is it still alive?
@@CYYB3RMISTER Of course! Currently rocking three of these boards :)
i always enjoy seeing these server type of videos
Great video, Jeff.
This style of homelab video concerning hardware/software topics are my absolute favourite.
I hope the upgrade itch isn't contagious 😉 My r5 3600, 32gigs of ECC RAM, Asrock X470D4U and 2x LSI 9207-8i are serving me very well.
First off Dont Judge! I am currently running a dell poweredge 2950 with xpenology running on it. Basic server running all my dockers, home assistant on a vm, backing up all my google drive files and computers to it. But thanks to you and all these TrueNAS videos I am taking a serious look at the chenbro and I currently have a TrueNAS running in a vm to play with and get the hang of before I make the big change. Thank you for your videos and damn you because now I got the itch as well.
really enjoy your channel!, its so nice to see someone just like me. keep up the good work!
I started watching your channel when your video appeared about your first Supermicro 846 chassis install because I was about to build out an 846 as a test unit. My first 846 was a hodge podge of storage for TrueNAS w/Supermicro X9DRH-7F motherboard, dual Ivybridge 2653v2, the onboard LSI 2308, an HP H240 SAS3, a Dell VGXKD LSI 9207 SAS-2, a Supermicro 24 drive SAS2 expander, 10 SATA 5 TB drives (refurbished, $40 each), 4 SATA 3 TB Drives (pulled out of a failing QNAP box), 2 SAS3 1gbps SSDs ripped out of a dead EMC server and inserted in the SAS3 2.5" rear hot swap option, an NVMe add-on card, and 10 SAS2 SSD pulled from a failing EMC server. Oh ... and a 64 GB Supermicro SATA DOM plugged into SATA Port 0 and 256 GB of RAM. The solution was my first attempt at hyperconverged feature engineering for machine learning with "longer term" backup on spinning media in the same box. It's since been supplemented by all SAS3 and NVMe replacements with more horsepower, including multiple Nvidia GPUs, in the 846 form factor. The 846A backplane was a better replacement backplane for the original SAS2 EL1, but it was short-lived in the first 846 chassis because it had a better home in a higher throughput motherboard w/3 SAS3 controllers. ... Look at what you've done to me.
Best way to spend the morning coffee break at work. Watch and people think I'm doing a training course. Love your vids :-)
I upgraded my NAS in December from a pentium g3258 to 1st gen Threadripper 1920x in the mATX asrock taichai combo i got for 400 on reddit. Currently has 4 x 8TB shucked WD easy store white label, and 256GB NVME cache disk.
I'm currently set for a while as I work to upgrade my horde of Linux ISO to the 1080p versions.
I couldn't have done it without your guides. Thanks for sharing the journey.
I just upgraded my TrueNas server from a Tyan S7012 w/ dual X5650 Xeon's to a Supermicro X9DRI-LNF4 w/ Dual E5-2530v2 Xeons. First SM board, absolutely love it.
You are pouring your beer right over top of the Supermicro motherboard at the end of the video! Now it will die in a few weeks! Just kidding! 😄
Hey Jeff (I hope I got the right one?), I don't usually comment, but I wanted to today. I'm a somewhat recent subscriber (in the last few months or so), and wanted to thank you. Your content is something I quite enjoy watching, and having started a job as a data center technician, it's great learning about different things that can be done with the hardware even in different settings.
It's also inspired me to start dabbling in my own home labbing, even if I'm not going to be jumping straight to server hardware for it initially, and I'm looking forward to getting the gear so I can jump in.
Once again, thank you for making such great content, and I look forward to your next video...and the next one...and the one after that...and, well, you know, all of them.
Hope your luck wth hardware returns!
Before I started watching Craft Computing, I had a 10yo Alienware laptop...... 1 year later, I now have a home built Ryzen3600/GTX1660Super gaming desktop, a DELL R710 w/ 2x X5670s running TrueNAS, an Intel SR1695GPRX (X3450) running Proxmox for Home Assistant, Pihole, etc..., an Intel S3420GPRX mobo (X3430) in a generic rack case as a network DVR and a 36U server rack in my garage.
You sir.... are a bad influence!!! :D
Thank you! I enjoy the fact that you present a verbose video. I use and have 12 yr old equipment to one gen back. I have enjoyed fine craft beer - some 10% stuff. I enjoy the dark flavors. But I also enjoy whiskey. 1792 - single batch - is a smooth - forget the water and enjoy the flavors. Like you - I am suspect of drives. I had a few DeathStars of 20 yrs ago. Mine and customers machines. So now I run 24 months and then they get pulled. Cheers Sir!
Because of you and Techno Tim, I'm running an HP Z800 with a pair of 5650's and 48GB of memory. I found a computer in the trash, i3, 8GB with a sata card so I threw freenas on that. I liked it so much better than my synologies, that I'm currently building out a new Freenas box and a extra Ryzen 7 3700XT I had. I'm using one of your workstation builds as a guide for the sata card.
I'm really appreciating the MN beer scene slowly infiltrating your channel
Just out of an upgrade of my home lab, something new and something old. I replaced my main server altogether from an HP DL380 G6 to a Dell Poweredge R720, from 128 GB RAM and 4 TB of storage to 256 GB RAM and 8 TB of storage and faster CPUs. My storage-server got a new case Fractal Design Meshify 2. Also in the Dell server, I had an H710 RAID card and I started with Seagate drives. Had the same issue as you with that brand, bought new HGST drives and an HBA H710 from Artofserver. That card is the best thing I bought for this setup.
Glad you liked the Surly Dumpster Fire 2020. Hopefully you get over the hump now of your hardware failures.
It definitely took the edge off :-)
At this rate Jeff's next video is gonna show all of this infrastructure in the bin after taking out a Linode subscription
Before you throw out that dead motherboard, check all the voltages. If you can get into the OOB management (IPMI) you should be able to see the sensor readings. In particular, look at the standby voltage. Also, check the CMOS battery... probably a 2032 and see if it is below 3v. Just in case it helps you prevent that board from going to e-waste...
Another Great Video, Keep it up Jeff :D
These SuperMicro cases are next to impossible to find now. Thanks Chai Coin
Planning my home network and watching your videos to get some ideas....
Dang, I feel this one. Recently had two HBAs partially fail on me after years of use, they'll be missed.
Dual 2630v2, X9 board, 128GB ECC, x540 nic, 9211 HBAs.
Waiting to see what the upcoming DDR5 platforms look like. Hopefully the current rig will do for another couple years while DDR5 matures
the dell hba's with recent firmware will act up when connected to non Dell drives. Checkout art of server and get a 330 re flashed to IT mode...eliminates this issue..:)
Ah dell
I've been very happy with my Dell PowerEdge T140. Upgraded it from a 4c/4t to a 6c/12t Xeon E2136, 48GB of RAM. Runs VMware very well. Quadro P620 passed through for Plex, Dell Perc H330 controller (it's not an HBA, actually. Dell firmware is RAID mode by default), 256GB NVMe card. Light services run on my Synology RS815+ nowadays, with 16GB RAM and 4 4TB WD Red Pro drives.
Subscribed for the Video card. Virtualising a standard 1660 Super would be amazing.
That brewery deserves big thumbs up! :)
Shame we can't get that here on the other side of the spheroid
Currently Running HP Z Series Dual XEON Boxes on ESXi and a TrueNas Xeon box.
Just about to consolidate all of this and move to a Proxmox box running BlueIris in a VM. Lots of PCIe Storage and a new case.
Also just built a 4 RasPi 4 8GB rack mount for the home rack to handle the PiHole and some other monitoring things...
Great video!
Currently running TrueNAS inside of Proxmox with 8 3TB Seagate Constellation in the System, passed through with a LSI 2008 HBA and 1 drive in the shelf.
Upgrade to my setup... Nice and easy. I bought a Synology ds1621+ bare 4gb Nas. I backed up my rs812 and swapped out the 4 by 4tb red hddi to the DS1621+. One OS update later and it is up and running. Because I had a couple of spare 2tb HDD laying around, I dropped them into the DS, as hot swap spares.
I had 4 500gb HDD laying around, and have put them in the rs812 as raid 5, with one drive set as hot swap spare (this will soon be put on eBay for sale on there). Once I have that done, I have a ds620 which currently has 500gb drives inside, and I have purchased 6 by 1tb SSD to upgrade later this week.
I have an older Netgear nvx which has been my goto server for many years, is being retired, because windows 10, doesn't like it. So busy days ahead, moving my stuff around between old stuff and new. Then once all that is done, I need to reconfigure my home security to use the new gear .. such fun... As for the NVX once I have cleared it down... Maybe use it with a Linux pc setup, or just pass it on to someone who needs it... I don't know yet
Great video, but two technical notes: Likely, the camcontrol problem can be resolved by adding a delay in the kernel boot params. Basically, you need to wait extra long if you have a lot of disks attached. It's quite a vexing issue to debug though... Ask me how I know... 😉
You can disable pcie boot roms in the SuperMicro bios config, and I'd strongly recommend it for any card that doesn't actually have a boot device on it. There's A LOT of very obscure config in the X9/X10/X11 bioses for the record... But it's worth reading carefully through the manual at least once as some of the defaults can bite you in the butt.
Since you did the video showing how to get FreeNAS running under Proxmox I figured you were still running that setup after upgrading to TrueNas. I probably skipped a video or two since then ;-)
I had a spare Z97 ITX board with a 4790K in it that I decided to setup following that video, so I grabbed a cheap m.2 to use as a boot drive and went at it. Popped Win10 on there as well (following that video) and planned on playing around with PiHole and some other bits and pieces.
The hitch right now is that all my storage drives are in a USB3 enclosure, so it's slow as hell and noisy. Next step is to get them connected up internally, though I have more disks than 3.5" bays and SATA ports, so I'm either going to have to pick up an HBA or move it all over to an even older system (X58 & i7-920) which has plenty of bays and just enough ports.
My homelab consists of purely just a small whitebox NAS. Ali Express special with a Machinist X79 MB, Xeon E5-2640 (yes, V1), 32GB ECC RAM. Added an Avago RAID controller for hardware RAID 5. Icy Dock cage for 5x 2TB 3.5" drives mated to an ARK 4U chassis. Just running a bare metal install of WS2016 for Plex and a shared drive for backups of all my local gaming machines. For how "cheap" it was altogether that thing is rock solid.
the anxiety you have given me... flailing ur hands around next to that cold brewski every couple seconds is mind blowing.
Full water-cooling setup for the whole rack. I can't have my rack hidden away so I want to make it quite.
whole house watercooling with a freezer in the basement
@@majstealth Something something something Linus Tech Tips. Something something something something will go wrong.
quiet ( quite a common error )
@AstroCat not quite there are you , have a quiet moment and think ...
Tough luck with that Gigabyte board. Fingers crossed your good hardware luck returns soon.
I just upgraded my single-server homelab from a Xeon E3-1240 v2 (Ivy Bridge, four cores) with 32GB DDR3 and four data disks to a Xeon E5-2680 v4 (Broadwell, 14 cores) with 128GB DDR4 and 16 data disks (plus hot spares and SSDs for special and slog devices). It's been quite an upgrade and I'm doing a lot more virtualization (similar to what you were trying to do with Proxmox and TrueNAS). I also added a Quadro P620 for hardware transcoding and 10GbE links to my two main workstations.
I'm happy with the platform (Supermicro X10SRH with an onboard SAS3008 controller) but I kind of wish I'd gone with a dual-socket board and an Intel RES3 expander (instead of a RES2). I should have jumped straight to 25 or 40GbE so that's probably next. I am also regretting putting all these disks in a Fractal tower, lol... next time I will suck it up and do a shelf!
P.S. I have HBA330s in my two R630s at work and they're all flashed and working perfectly with zfs. Let me know how I can help.
Virtualizing TrueNAS in Proxmox...this is the way. Mine is running in my (only) EPYC home server and I love it.
Edit: I spoke too soon lol
If I didn't have so many cache disks and controllers to passthrough, I likely would have stuck with it in a VM. But this time round, it was just more headache than necessary.
My TrueNas box is a Dell R820 I found in the disposal pile at work. 64 cpu threads and 320GB RAM. Slapped in a second internal 8 bay SFF cage, some IT mode flashed PERCs with external SAS ports, and some disposed ES30, SC220, and SC200 disk shelves. Way overkill but going to try running some k8s node virtual machines on the truenas box to see how that performs and maybe use the extra performance.
Cheers Jeff!
finally a beer i can actually get here in MN
I've actually scaled back in recent times for my home server. I run consumer hardware now. i7 10700 for intel quicksync (Plex), 64 gigs of ram, bunch of hard drives in a tiny itx box.
Yeah. Running 3600x here, and it's faster, quieter, and easier to maintain than the rack full of sh*tboxes i used to have, haha!
I'm planning do downsize my 24/7 powered box as well... 60W permanent power draw is not that nice (at least better than most dual socket boards).
I will have to use something like unraid with Cache storage so I can spin down my disk array. It is needed maybe 1 hour per day.
However the server does need to run 24/7 for web server purposes.
My plan is to have it still powerful, but in Idle it should not draw more than 30W. Is something like that managable with an underclocked/undervolted Ryzen or am I unrealistic here? The current build (socket 1156 Xeon) uses around 60W with ~5-10% load and four disks spun up
Currently running an X99-WS/IPMI with an e5-2676v4 (used to be a e5-2683v3). Alongside it is 4x16gb (64gb total) 2133mhz ECC RDIMMs, Quadro P4000, LSI 9211 HBA, and hopefully by the weekend, a Mellanox SFP+ NIC. Current storage is a 1TB 970 Evo, 2x2tb WD Red Plus and a random 850 evo m.2. ESXi is my hypervisor of choice. Next upgrade incoming is two more 2x2tb and hopefully a rackmount chassis.
Were the CPUs you chose just really cheap? Curious as to why you went with a 4 socket capable xeon in a 2 socket system when fast dual socket Xeons like the E5-2667v2 would give you twice as many threads at similar frequencies. Either way, great vid!
My favorite hazy ever is from Wild Barrel brewing co. It's called Mozzacca. If you ever come across it, get it.
“I have really good luck with hardware”
I feel your pain, my cache pool I have set up in my unbraid server finally just had one of the drives die and since it was originally set up in raid0, I’m pretty sure I lost all the data on those solid state drives. 😭😓
Time to do a reflow on the board!
Nice video Jeff.👍 Could you do a detailed video about ML/AI workstation build?
My homeserver runs on a XEON E5-2650L V2 / Dell H200 / Quadro P400 and 128 GB of RAM with TrueNas and Plex virtualized in Proxmox (with PCIe passthrough to both VMs). First i had a dual Xeon setup in mind but decided against it due to the cost of electricity and a more realistic view of my needs.
your videos are seriously helpful, running unraid Acer Gateway GT350 F1 - dual Xeon X5670 + 96GB ram + 12x 4TB Toshiba X300s + 2x 1TB Seagate SSDs
During the sponsor spot, you've shown the Server location for Germany would bei Frankfurt (more or less the home of every bank in Germany), and my first thoughts were "Yeah, where else would you build your data center, other than Frankfurt? Thats the only place with usable Broadband infrastructure here" xD
My setup isn't nearly as sophisticated as yours but it works quite well for my needs. My truenas server is running a gigabyte z77 chipset board with the old i7-2600k from my high end workstation build in 2011 (that thing is a workhorse and for storage, plex (no real-time transcoding), transmission-daemon with quite a few various linux distribution iso's, and a very small totally unprivliged ubuntu vm that i use for accessing my internal network from external networks via ssh (I use rdp over ssh pretty often). the machine has 24gb of ddr3 and 8x shucked 10tb western digital easystore drives. I have to power them with molex to sata adapters because the 3.3v pin triggers these drives to reset so if i plug them into sata power directly they just reset constantly instead of operating. because molex only has 5v and 12v, no molex to sata power adapter has a populated 3.3v pin. i'm using the onboard gigabit ethernet that goes to my privliged vlan and I also have an intel 10g base-t card which has a 100' cat6 cable plugged into it that goes up the stairs over a few doorways and into my home office to be plugged DIRECTLY into my primary workstation ( pcpartpicker.com/user/cpgeek/saved/RxfdHx ) I currently have the server set up in a 2010 vintage cooler master desktop case. I would very much like to upgrade to an enclosure that can hold more drives, but that can function on a normal atx power supply (for quiet and inexpensive replacement). every single server enclosure i've ever seen has been SUPER noisy (typically for no good reason) due to the fact that they use really tiny power supplies with really tiny fans that need to spin super fast to have any hope of getting air through them. I live in a smallish house and the multipurpose room that my server currently sits in is just across a very small hallway from my 2 childrens' bedrooms and if i put it in MY home office, it would A. be too noisy to work around, and B right next to the bedroom my wife and I share... either way my family would hate me... - if anyone has any solid leads on either rack or tower enclosures that can comfortably store 16 drives or more while being no louder than a common desktop gaming computer, please let me know.
I started with a basic Synology 2 bay NAS, then built a small Atom C2000 Proxmox server. I replaced the Synology with a 5 bay newer model with dual gigabit. Then I had a saga where I changed a few motherboards before I got a Xeon E-2278G with a Supermicro X11-SCL-F and 8 cores running Proxmox and having a Quadro P600. That took me up to 10GbE so I wanted my storage to be 10G ready as well.
I replaced the spinning disks in my server with 3.5TB of enterprise SAS SSDs which I got for a steal. Then I foolishly decided to go 10GbE with my NAS, so I got an 8-bay QNAP NAS with PCIe slots which got a Mellanox 10GbE card, and two SATA M.2 NAS SSDs.
I'm currently shuffling data around to free up HDD drives to migrate them to the new 10GbE NAS.
My current issue is that the Xeon server occasionally fails, seemingly at random. Hearing your woes with your board has me concerned, but I am also suspicious of Proxmox because I am using PCIe pass-through of the GPU. I've seen my network stack on Proxmox failing and I think the PCIe bus virtualisation causes issues.
Next I need to justify to myself why I have 25TB of storage... I am planning on playing with LizardFS to consolidate my spare storage for the hell of it.
wow, i got first view :P *watches video* As for the next planned upgrade to my own home server, my current setup is a Ryzen 3 1200, 16GB DDR4-3200 on a B450 mini-itx motherboard. The system serves as a home NAS with four 4TB Seagate Ironwolf drives maintaining a weekly backup of both my and my spouse's desktop computer. It also occasionally serves as a Minecraft SMP server for a few friends via VPN.
Ideally i'd like to move it, and my desktop, into a rackmount solution, but such a significant physical overhaul does come with a significant price tag, and so is on hold until later this fall.
That beer looks very good. But are you sure you should be working on computer parts while drinking a 9%? I usually reserve those for after I'm finished.
Hi Jeff. The motherboard is Supermicro X9DAi, not X9ADI :D.
I use for my NAS a ASUS Z10PE-D8 WS motherboard with 2 Intel Xeons E5-2630L V3 with 64GB ECC RAM DDR4, 1 NVME Samsung 970 EVO PLUS for a cash drive, one HDD Seagate Exos 6TB. And 1 Samsung 870 EVO 1TB SATA for the virtualizations. Operating system i use is UNRAID. Some old videocards for virtualisation (exchange and domain servers). And a Corsair RMx 750 Gold for power.
I've just finished replacing my twin homelab Dell R730xd (one w/12 8TB HGST drives in Raid 6 and one with 12 6TB HGST drives). Both had 128 GB of DDR4 ECC ram and dual 10C/20T Xeon E5-2660 v3 CPUs at 2.6Ghz. I LOVED the iDRAC function. Nobody does it better. But since these lived in the second bedroom they were just WAY too loud. So what did I replace them with?
I brought out a couple old cases I had from recently retired servers. One is a Norco 20 bay 6gbs backplane case, one is a Supermicro 8 bay tower/rack case that has a 5 bay expander for a total of 13 hot swap 6Gbs bays. Both now have Supermicro X10DRH-IT motherboards. The CPUs and RAM were swapped over from the Dells. Both cases have had ALL the internal fans replaced with Noctua fans so they stay cool and quiet. Oh, the 20 bay unit now rocks 9 Seagate Exos 16TB drives in Raid 6. These were purchased pre-Chia. Each drive was somewhere between $275 and $350. Supermicro's IPMI is ok but a very poor replacement for Dell's iDRAC. It works though. OS is Win2019 on both. Many VMs underneath. Plex runs on the host one one machine so there is no need to worry about sharing PCIe with the Nvidia Quadro P2000. Transcoding galore at full speed while the infrastructure VM's plod along. Similar story on the other server. Blueiris runs on the host to use the Nvidia GTX-750 for transcoding while the VM's underneath do their jobs.
I now have a stack of HGST 8 and 6TB drives to sell, 2 bare Dell R730xd's to sell although I have been thinking about setting up the drives to mine Chia. Although with the price of drives today it might make sense to just sell them and not worry about having to replace SSDs on a continuing basis.
Jeff, great video as usual, I want to transfer my old pc into a rackmpount case for true nas.
any opinion on this case ( i need a compact one for my mini rack)
Monoprice 3U Compact Rackmount 3x5.25" MicroATX/PS2 - Monoprice.com
coupled with my old pc, i7-2600k with 16gb ddr3,
i need to get some kind of video card for output
do you think that would work?
The upgrade itch is real, I have a Xeon e5 2650 v3, 64 gb ecc ram, as rock x99, gtx1050 all running a nas, pled and internal surveillance camera system. Think I’ll need a 10gb nic so that I can isolate the camera system and have better through put for the nas and plex server!
Currently working on migrating my servers and desktops to a single box for simplicity. Currently waiting for more reviews of Threadripper Pro MoBos before deciding if I go Pro or wait for Zen3 later this year. Do have a question that you might be able to answer. How would you cool a Threadripper in a Chenbro SR107? It is a 5U chassis that make me really want to attempt watercooling using 3 120mm Rads... But not really sure it will work.
Nice looking TrueNAS box now :)
This is my setup:
Storageserver: Supermicro H8SML with AMD Opteron 3350 HEL, 16Gig ram, 3x8TB HDD, 2TB SSD for ESXi ISCSI (running Fedora Core 32)
EXSi server: Supermicro X10SDV-4c-TLN4F, Xeon-D 1581, 64Gb ram - running about 15 VMs (ESXi 7.0)
Rest of my network is 10Gb NetGear switch and Unifi switch/UDM PRO
This is more or less what i am allowed by the wife to run :D
My next thing to get, is new HDDS.... but as it looks rigth now, it sucks to buy 14+ TB drives
Hope that HBA 330 can be flashed, Jeff. I had to flash the Dell 310 HBA that was given to me. I'm running a x570/3700x/32GB Proxmox system for TrueNAS (4x2TB) and a Manjaro VM for ripping/converting movies, music, and more. I hope to do a RAM upgrade once prices aren't insane for more VMs. Also I'm running an x79/4820K/64GB Proxmox system for Pfsense and Pi-Hole to start. Pfsense has been a PITA, might be switch to opensense or the like. I'm looking at upgrading one of my 8 port switches to a 16-24 port switch soon.
I'm running Proxmox on a Gigabyte BRIX 4105R with a 1TB SSD and 8GB DDR4. I've named it "Proxmini" and I've got about a dozen LXC containers for MariaDB, Postgres, Pihole, Nextcloud, Bitwarden, Mattermost, Paperless, Omada, and a few others. My next "upgrade" is probably going to just be getting an identical unit to put beside the first and set up a cluster so I can migrate live containers and balance resource usage. I'm backing up using Proxmox Backup Server to NFS storage on my old Synology DS212, which has two shucked WD Elements 8TB drives in RAID1.
My TruNAS box is in a CoolerMaster Cosmos II case. 1600watt Corsair power supply. I’m using a old Gaming motherboard with an i7 4770 in it. 64gb of ram, it’s where all my old DDR3 went when I upgraded to DDR 4. Heh. I bought used HGST enterprise drives. Ive got 6 SATA 3tb drives on the motherboard SATA controller, 10 SAS 4tb drives on two Dell SAS controllers. Ive had the 3tb drives for about 5 years now without a single failure, and the 4tb drives have been in there a year with no failures.
Where exactly do you find these amazing looking beers? I'm in a small town, and have you "trade" with friends in order to get anything worth drinking.
Is it some old mobo?
Have you tried re-flashing the BIOS in case it's just bit rot of the BIOS' EEPROM?
helloo.. im currently running a dual xeon e5 2620 v3... what do u think is a good cpu to upgrade to later on ? the 4627 v2 looks good
Currently running Unraid on an old i7-3770 in a Z77X-UD3H with 16GB DDR3. Previously that was an AMD A8-3820 with 8GB DDR3. About to upgrade to a couple of dual E5-2690s in a chinese 'X79' dual socket motherboard with 128GB DDR3-1600 ECC RAM and a HP H220. Partly experimenting with it all. Going to try running a game server or 2 and see how that goes and try to get my other machines compiling on that. HDDs are a mix and no SSDs in the server at present, looked at the Sun F80 however shipping to down under was more than the cards themselves.
Right now I've got a Dell Poweredge R510 running proxmox pulling double duty as a NAS, I plan on installing TrueNAS on it when my USB to SATA adapter comes in. I've also got a Poweredge R610ii which is awaiting a second Xeon CPU. When that CPU comes in I'll also install a 10 gigabit NIC so that VMs on the 610 can communicate quicker with the storage on the R510.
I had a hard drive die on me. Thankfully I had a spare ready to go.
Great videos, keep it up! LGA2011 v1/v2 is still a fantasitc platform for homelabing. I recently parted out or given away my Westmere servers and gear and now am 100% sandy/ivy bridge. DDR3 ECC RAM is cheap, quite accessible to have 1TB of RAM at home for labbing. Do you think you are really hitting a bottleneck with HBA's with SAS2 interfaces? I mean, with spindles, I don't think 6Gbit X 4 lanes are a problem IMO. Nice CPUs BTW, I did not lay my eyes on any E5-4XXX CPUs at all before listening to your videos.
My home server is running a G3258/H81 with 8 GB of RAM. The upgrade is my old desktop, a 4690K/Z97 with 32 GB. Just haven't found an ATX case to throw it in yet.
Soo.... I recently bought a lto library, and I need a 2 port fiber channel adapter to talk to the lto drives. Any recommendations?
The inside of that case was filthy and you just dropped a new board in without cleaning it! WOW!
I have 8x ODroid HC2 with 4x 1GB and 4x 2GB drives. Each HC2 is runing Ubuntu 20.04 LTS with LizardFS as a distributed filesystem. Not as simple as TrueNAS but more fun.
Supermicro X9DRH, Dual 2650v2, 32gb ram.
Gentoo.
I run a dell r720 with dual e5-2680v2 and 64 GB of RAM. That's pretty much overkill for my current needs, but I need to start somewhere and have room for future needs
I use an old HP microserver for both of my TrueNAS servers which backups to cloud and then replicates to another HP microserver. Been running now for 4+ years, only thing gone wrong is the PSU died a few months ago but got hold of a cheap replacement on ebay. I know rubbish hardware but for my current needs works fine but do need to start looking into getting new hardware, need to do some ebay shopping and look to get something with 10GB network capability.
man I have 2 X9DAi both with the same symptoms with 2 Intel Xeon E5-2690 V2 unstable AF just Locking up 2 times a week. I'm giving up on it and going back to my Dual 1366 I was using for Plex thing is OLD but Rock solid.
Hopefully your new hardware holds out!
My home network has a different focus than yours. Mine is more about the networking than the of hardware. I'm running a pair of 48 port gig poe Cisco 2960's and a 48 port gig Dell switch (soon to be replaced with a 3rd 2960).
I was running an old dual Xeon IBM server, but haven't replaced my raid card after it died on me. I replaced it with a pair of raspis. One running home assistant, the other running Zabbix and docker containers.
All I run are Supermicro MB’s for my servers with older Xeon CPU’s in both single and dual configurations and Asus workstation MB’s for my PC’s. Only had one dud Serverboard out of 10 used boards and had bad luck quickly with ASRock MB’s for a PC. I also had bad luck with Seagate constellation 2TB “refurbished” drives so now I only buy NEW WD Gold drives and so far, no issues.
What hardware do I run at home? My NAS is a Dell XPS tower with an i7-6700 running Server 2019, with a flashed IBM M1015 and Quadro P400 for Plex. I've been using DrivePool for many years and just recently started adding per-folder duplication and a SSD cache. I played around with Hyper-V on there but ultimately decided to use a RPi4 for all my Docker containers.
I have my eye on a decommissioned Lenovo RD350 at work with an E5-2603v3 -- Just add 10Gbit ethernet and a matching Lenovo SA120 or two.
>what hardware do you use
I dont have a personal homelab yet but i hope whenever i get the opportunity to build a new desktop i'll turn my old one into a server. i want to put proxmox on it and run plex/jackett/sonarr/radarr/etc on it. y'know, start small and work up from there.
i currently run a rasp pi 4 and hopefully when i can actually upgrade my current desktop, i plan to reuse those old parts in a new server
I run a Chenbro NR40700 with a x79 mobo, 32gb ecc, 2687w v1.
I run unraid with dual parity, sitting at 47.2 TB right now!
I actually just built a new firewall with a super micro motherboard that has 6 10gbe, and it was only $80! Running on a e3-1220 v3.
That might be a interesting item to check out!
Love your content Jeff its always honest, informative and makes me laugh. Home lab is kinda a mix of redundant parts from work, cheap Chinese crap and retired builds. 2x Xeon e5-2660 v2, JINGSHA X79Dual S8 Dual CPU motherboard, 4x 240gb SSD's in raid 0, 1x 256gb nvme for boot, 1x 1tb sshd, 64gb ddr3 ecc 1600mhz, xfx r9 380 gpu all shoehorned into a Riotoro CR1080 case.
I've just upgraded to AMD EPYC 7551 on AsrockRack EPYCD8-2T with RTX 4000 and Quadro P4000 for all the VM, transcoding and ML needs
On the cpu front, what about the 2667 V2's? if memory serves they're the same base clock also with a turbo to 4GHz and they do 3.6GHz on all cores but they keep their hyperthreading and are still 8 cores, so 8/16 each at the same clocks, might be worth considering, I used to have a pair of these and they're damn quick
Are you using proxmox backup? just asking. I agree all the machines falling out of the rack or a switch going is belly up is in your future. LOL
Recently i ordered a 2nd dell R210 II with 32gb ram for $135 on ebay, plan to use that for truenas, connect it to my disk shelf via a PCIE HBA. it only has 2 1gb ethernet ports so i plan to link them in a lagg. i like the r210 ii because it is so quiet and low on power draw, should be great for a home nas. i dont currently have enough to need 10gb ethernet so for now this will be a good solution.
I am very interested in building a similar setup for a homelab. I was really considering proxmox with truenas as an option but I am not so sure now. However, it is unlikely that I will need to have cache drives but I don't like the lack of options. If I do this plan, I will for sure get a sas3 backplane to help. Other proxmox vms would be plex and related items and maybe opensense router. Any thoughts on homelab router vms?
My home lab set up is a 2 machine setup running vsphere7 and vSAN. Server 1 is a Chinese X79 motherbord with an Intel Xeon E5-2630L CPU, 58GB Ram and Server 2 is a Super Micro X9 DRi-F motherboard running an Intel Xeon E5-2630L with 56Gb of Ram. Servers are Virtual TrueNas with a regular SATA PCI-e adapter in passthrough, some windows Servers and some Linux Servers. Maybe adding a 3rd server later on...
I think I might have gone with one of the ITX Epyc configurations and moved to a small system and higher capacity hard drives with fewer of them..
this motherboard is insane
My TrueNas server is based on the AsRock C2550D4i... yes that infamous motherboard. I'm touching wood but I did buy it in 2015... and it never failed. But yeah, an upgrade is in the pipeline at the moment :D
My Homelab rocks a MSI X99 SLI+; Core i7 5820; 32GB RAM and some Storage. The next upgrade would be to my WKS, but this could take a while.
I'm running TrueNAS on my trusty i7 3770k with 32 GB of RAM and 8x4TB drives on a random Gigabyte board.. It was my old desktop board before I upgraded to my current AMD AM4 platform.... it's my Plex server mainly, but I have an NFS share enabled. :) I honestly don't plan on upgrades right now, though I'd like to totally rebuild with server grade hardware at some point, with a rackmount case. My current case is a rackmount, but I have no rack. lol.
Main server is a TR 1950X Unraid build with 64GB of RAM and 136TB of usable storage with 16TB for Parity and a 4TB NVME cache pool, a 2nd smaller Unraid build with a R7 3800X, 32GB of RAM, 11TB usable, 5TB Parity and 2TB NVME cache and 2 Truenas builds. One for storage (R7 2700X, 32GB RAM and 30TB usable) and one for testing (FX 8350, 32GB RAM, 12TB usable). I am working on raspberry Pi projects and network upgrades, so won't be looking at server upgrades until 2022. But i do want/need some cache drives for the Truenas servers, so that's def on the list.