INSANE Homelab Storage Server

แชร์
ฝัง
  • เผยแพร่เมื่อ 27 ธ.ค. 2024

ความคิดเห็น • 194

  • @Ottetal
    @Ottetal 2 หลายเดือนก่อน +16

    I love that you include all of your findings/failures when building - It gives great insight to your process. That being said, your issue here is the choise of case. It's simply not adequate for what you're trying to do.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Sharing the build good and bad is important for just that reason. Yeah the case presents cage addin fitting issues no doubt. I did put in a side plugged 3070fe and that looks like it would allow more of those 2.5" addin but then I lose a slot and vram. I might also be shopping cases right now....

    • @Ottetal
      @Ottetal 2 หลายเดือนก่อน +1

      @@DigitalSpaceport I think you just need something that's deeper to take all your gear.
      If 5.25" bays are a requirement, I'd take a look at In-Win IW-R400-03N.
      For maximum compatability I'd go with Logic Case LC-4650-WH. I believe they are under the "rosewill" branding in America
      If you simply want the best of the best looks, I'd highly go with the Sliger CX4200e
      Good hunting my friend.

  • @ricou5215
    @ricou5215 2 หลายเดือนก่อน +3

    Excellent. Everything is shown, detailed and measured without hiding anything. Very explicit. Nice configuration for a server. Good job.

  • @yourpcmd
    @yourpcmd 2 หลายเดือนก่อน +10

    Buy a Tesla, House, or build a server? Choices.

  • @MikeKirkReloaded
    @MikeKirkReloaded 2 หลายเดือนก่อน +4

    Hooray for finding a way to make all your smaller SSDs useful - sweet build!

  • @BlenderRookie
    @BlenderRookie 2 หลายเดือนก่อน +4

    I have my movie and TV show collection saved on a synology NAS. It has been working strong for 5 plus years and only consumes about 40 watts at idle and 60 in use. I have five 12TB ironwolf HDDs 1 drive parity.

  • @dorinxtg
    @dorinxtg 2 หลายเดือนก่อน +10

    I have such a case. It's a Chenbro OEM case, and you don't have enough space for fans, and the design is basically very bad if you want to use all your drives + some PCIe cards. I would strongly recommend to look for another 4U case

    • @KaldekBoch
      @KaldekBoch 2 หลายเดือนก่อน

      This isn't the Chenbro case it's the Silverstone. It stops use of full length PCIe cards if you put in a drive cage on the left side but that's about it.

    • @dorinxtg
      @dorinxtg 2 หลายเดือนก่อน

      @@KaldekBoch it's the same case. Even the model name implies

  • @videowatcher495
    @videowatcher495 2 หลายเดือนก่อน +3

    I would love to know what U.2 to PCIe adapter card you are using. I'm glad you used this case because I was considering buying it, but now I know I don't want to use it as it would be too cramped for my liking. I loved this video, thank you!

  • @BPTtech
    @BPTtech 2 หลายเดือนก่อน +4

    You really need 3 of these

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +2

      Yes for some of the storage arrangements we will be doing, 3 is the minimum. I do have a second sister machine that is spec'd nearly the same. The threadripper featured may also get racked up. There will be a lot of fun storage based videos happening.

  • @MarloMitchell
    @MarloMitchell 2 หลายเดือนก่อน +2

    You are a legend man, you are living my dream :) Good job :)

  • @aaron840
    @aaron840 2 หลายเดือนก่อน +3

    Have you thought of a small display in that spare area. That way at a glance you can see network info, system temps, drive usage or whatever.
    or Adding a fan in there is always good to help get the vid cards the freshest coldest air possible

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +2

      Thats a cool idea! Im checking for some now.

  • @deadlymarsupial1236
    @deadlymarsupial1236 2 หลายเดือนก่อน +3

    This Silverstone RM41-H08 case is only 446m deep compared with the Antec 4U22EPS650 (sadly discontinued) at 558 mm deep.
    Other shortfalls in this case is the waste of front panel space that could have been used for removable drive bays as demonstrated by the Antec.
    I have two of these Antec cases now 14+ years old and going strong. The only limitation is the pcie slot width is about 1mm too narrow for usb A sockets in horizontal orientation - but I'm not complaining.
    I have my cases loaded with IcyDock removable drive bays (5 x 3.5" in 3x5.25", 2x 2.5" in 1x3.5" & 2 x M.2 in 1 x 3.5" (connected to U.2 interfaces on the mainboard).
    Even the IcyDock (5 x 3.5" in 3x5.25") were a tight fit in the Antec case but I would compare specifications nonetheless.
    I would be looking at either changing the case (but I'd have to shop around to see what else is available).
    I can see how you chose Silverstone - I would have most likely done the same, as two days ago I ordered the Silverstone RM46-502I 4U for a comms server so I can have all the I/O & storage facing forwards as it will basically be a hypervisor running all network services (proxmox, pfsense, ubiquiti controller, pxe server, active directory/dhcp/dns, windows based nas for storagecraft back-ups onto NTFS hot-swap removable drive, etc...)
    I went hot-swap on the basis that as a career tech it is only a matter of time before the rather fragile sata interface connector on a drive gets damaged so even in my home lab I choose to negate that risk as much as possible and even without the hotswap bays the drives installed directly still are a tight fit in the Antec. Hot Swap with the backups mean that I can take the back-up drive and very quickly install it into the machine for maximum efficiency restore having the backups installed into the machine being restored. Consequentially I'm locked in with IcyDock.
    BTW due to the potential for security issues with virtualization of a firewall, the pfsense is cascaded behind a physical nat gateway.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      Yeah this case is about 1-2" shy for the pcie cage side to house more 2.5" caddy carriers. I did put in a side plug 3070fe and I think that would allow enough clearance for more ssds, and thats fine for this build im notball after more platters really. Have enough of those on sas. I really dont want to make compromises on the gpu and losing a slot however... Im on amazon right now looking for its replacement lol.

  • @scottywed
    @scottywed 2 หลายเดือนก่อน

    Absolutely awesome. Can't wait to see what comes next.

  • @ChrisCebelenski
    @ChrisCebelenski 2 หลายเดือนก่อน +6

    The key to a good storage server is balance - you've got a ton of storage here, but it's all over the place in terms of performance and capacity. The first bottleneck is going to be memory - you need a lot of it to do things like caching and tuning. Good start with the network too but you already pointed out the bottlenecks trying to use it. Not insane, except you got a lot of eggs in one basket here - when it fails (not if) then it's going to be a real PITA to come back up. It would be better to break this into two (three?) servers with some redundancy built in (ZFS replication? Ceph? depends) I guess insanity is in the eye of the builder - I wouldn't even blink twice to consider it, but probably not as an all-in-1 solution. Been burned too many times now.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +2

      There is another epyc server its just not in the rack yet that has similar specs. Getting high performance in my storage arrangement is going to be a seperate video that dives much further into that specifically. This video ws already long enough to tack another hour onto. Everything gets backed up to my LTO library also via PBS and I rotate to safety box. It is a major pita indeed to restore from tapes however. Much more storage content coming soon.

    • @ChrisCebelenski
      @ChrisCebelenski 2 หลายเดือนก่อน

      @@DigitalSpaceport Lovely indeed - I recently got an LTO-6 drive as they can be found for somewhat reasonable prices. (Love to have a 7 or 8, but...) I do the same thing - Backup to PBS, then monthly to tape (only most recent snapshot)

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      @@ChrisCebelenski i got lucky and found a MSL8096 locally a few years back for just a few hundred. Tape really was not good for me until PBS, such amazing open source software they produce.

    • @ewenchan1239
      @ewenchan1239 2 หลายเดือนก่อน

      @@DigitalSpaceport
      It's not too difficult to compile LTFS.
      I only JUST started using PBS maybe since the beginning of October (this month).
      But I've been using my LTO-8 tape since around the 2018-2019-ish time frame.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      LTO 8 is great, Im over here on 5 and a single drive handling 94 data cartidges. I might be able to upgrade the drives to 6 in this library but have yet to test that.

  • @Miner4Nine
    @Miner4Nine 2 หลายเดือนก่อน +1

    Toss some RTV, foam block, or other material around your caged zip tied fan. It will keep air from vacuuming back around the sides.
    Enjoyed watching the build!
    -Miner4Nine

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Good call! I actually have some of that pink insulation board laying around that will work perfect for this!

  • @kbranchjr
    @kbranchjr 2 หลายเดือนก่อน

    wow ,just wow, the hard drives alone out match my three NAS & mini cluster sever rack

  • @TazzSmk
    @TazzSmk 2 หลายเดือนก่อน

    inability to fit things into big rackmount case is a big bummer, is Silverstone planning to do revision?

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      I changed the GPU to a 3070fe and it opened up enough room I think I can squeeze in more of the 2.5 carrier cages. The 3.5 still wouldn't work but I'm going to just embrace the all flash.

    • @TazzSmk
      @TazzSmk 2 หลายเดือนก่อน

      @@DigitalSpaceport hmm that's still pity, maybe 20GB RTX 4000 Ada (SFF) would be short enough to use, but needs 2 slots height,
      that mobo you picked is regular ATX right? I'm wondering why Silverstone didn't make the rack longer, rails are way longer and could accommodate deeper rack rig

  • @cracklingice
    @cracklingice 2 หลายเดือนก่อน

    What SATA controller did you end up going with for the bluray drive passthru? I ended up with a cheap 1 lane 4 port card from Eluteng. Man these Chinese brand names. lol

  • @stevejones8711
    @stevejones8711 2 วันที่ผ่านมา

    Why would you ever need this much cpu power or storage from a plex nas? I’m a home server/nas enthusiast, just curious. Insane this is a very cool build.

  • @nadtz
    @nadtz 2 หลายเดือนก่อน +1

    I worked with a case very similar to that one with similar hardware (H12ssl-i + 7502) and we had problems with U.2 drives getting pretty hot due to lack of cooling, ended up swapping the chassis for Sliger CX4200a's and some 3d printed parts to stuff a bunch of U.2 and sata drives into them. Still that is one heck of a build, I'd personally do it differently but still a cool video.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Im on amazon checking out cases right now lol

    • @nadtz
      @nadtz 2 หลายเดือนก่อน

      @@DigitalSpaceport Yeah I don't think the Sliger 4u's would have enough space for everything you want to stuff in there, we were only doing 8 SATA SSD's + 4 U.2 in addition to the M.2 boot drives.

  • @nokken9
    @nokken9 หลายเดือนก่อน

    I really love this content.

  • @tmendoza6
    @tmendoza6 หลายเดือนก่อน

    Have you considered AMD GPU's running Linux and ROCm for tests on Ollama

    • @DigitalSpaceport
      @DigitalSpaceport  หลายเดือนก่อน

      I have but have no AMD card. What is a decent card you might recommend that is not super expensive?

  • @Kvicken223
    @Kvicken223 หลายเดือนก่อน

    Hey Digital,
    Love the video. I'm in the dilemma of trying out TrueNAS again as a VM. My problem i stumbled upon was that when i had that combined with docker services my pool kept degrading after a while. Have you ever stumbled upon that problem?

    • @DigitalSpaceport
      @DigitalSpaceport  หลายเดือนก่อน

      Explain the setup more here. You are running scale as a VM in proxmox and running docker inside scale is what im assuming you mean here but also could be wrong.

    • @Kvicken223
      @Kvicken223 หลายเดือนก่อน

      @@DigitalSpaceport Hey again,
      Sorry, I meant containers.
      I got myself a Dell PowerEdge R730 and ran Proxmox on a mirror setup ZFS (870 EVO SSDs) and 4x Exos 20TB disks for storage (SATA). The RAID card I had was an H330i, but I upgraded to an LSI 9300-8i HBA/IT. I haven’t tested TrueNAS as a VM yet (due to the issues I mentioned earlier).
      I ran TrueNAS Scale as a VM, passed the Exos disks to the VM, had the usual *arrs (including SABnzbd and Plex), and created a pool (the four Exos disks) running in a RAIDz1 setup.
      Sometimes the pool ran fine for a week or so, but then it would suddenly switch to a degraded status. Initially, I thought a disk was faulty, but when I tested it on another testbench, it worked fine. I scrubbed the pool, which resolved the degraded status temporarily, but the issue happened again.
      I started wondering if I was being too heavy on the disks since I had containers running and multiple I/O operations happening simultaneously on the pool. So, I built a new pool (with two SSDs i had laying around just to test it out) and moved the containers to run separately on that pool, keeping them off the main storage pool. That worked much better for a while, but unfortunately, the same problem reoccurred after about a month.
      Frustrated with all the fiddling, I switched to Unraid and ran it bare-metal for several months (with cache drives). However, I really miss the ability to virtualize. I know Unraid supports virtualization, but I prefer how Proxmox handles it.
      Sorry for the long read. I just really wanted to get some input from someone more experienced.

    • @Kvicken223
      @Kvicken223 หลายเดือนก่อน

      @@DigitalSpaceport Sorry, i ment containers. But you are correct! Within the truenas scale i run the usual *arrs and plex.
      I got myself a Dell poweredge r730 with the perc h330i (upgraded recently to LSI 9300-8i HBA (havent tested truenas as a VM yet with new card). Pool was built around 4x exos sata 20tb disks in a raidz1 setup. If i had the containers running on the same pool it degraded quicker, if i seperated the containers from the bigger pool to a pool that ran on SSD it worked longer (but degraded after a while).

  • @j00h
    @j00h 2 หลายเดือนก่อน +1

    Hey, I've seen you use Unraid in previous videos. Out of interest why did you opt to run TrueNAS in Proxmox? Is this just for testing and do you have plans to run more VMs running in Proxmox on the same hardware. I'm an Unraid fan and would like to try Proxmox on my next build

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      Expedience in the video. I did toy with doing a kplop unraid in proxmox but thats better as a dedicated vid I think, its on deck. Unraid in proxmox works just fine, just passthrough a dedicated hba and boot kplop which then kicks over to USB.

    • @moogs
      @moogs 2 หลายเดือนก่อน +1

      @@j00h virtualization truenas, pass hbas to the vm, run other vms on super fast hardware under separate management. Best setup I’ve had and I’ve done them all, OMV, unraid, truenas bare metal, Linux etc etc. I even have the same case and run the ROMEOD as rock 7713 EPYC chip, 512GB 2 ASUS cards, RM41 case with 15 HDDS and 2 SATA with adapter and expander.

    • @j00h
      @j00h 2 หลายเดือนก่อน

      @@moogs Thank you for the reply. I've been running Unraid on bare metal for a few years and played with Proxmox on a low powered computer while I was trying out Opensense but then deployed a simple Unifi network instead. I'm keen to try out Proxmox again for a new home server that can support a gaming VM that my kids can use. In my opinion it's better use of hardware than building a gaming PC that will be under utilised most of the time

    • @aflury
      @aflury 2 หลายเดือนก่อน +2

      The downside is that TrueNAS's ZFS ARC cache cannot utilize the hypervisor's unused RAM. You have to allocate a percentage of your system RAM to TrueNAS, which means less RAM for TrueNAS overall (#1 factor for ZFS performance). Running ZFS on Proxmox with CIFS/NFS handled by LXC containers would better utilize system resources. No TrueNAS GUI though. :(

    • @abb0tt
      @abb0tt 2 หลายเดือนก่อน

      @@aflury excellent point RE: TrueNAS ZFS ARC in a hypervisor versus bare metal.
      Add: Proxmox with a ZFS GUI is an interesting idea...

  • @meggrobi
    @meggrobi 2 หลายเดือนก่อน

    Really !!!! It's like putting a jet engine in a mini. Sound impressive, but what are you going to use it for?

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      I used proxmox for a reason and there will be much more deep diving on those use cases and setup as well. It is a close mirror in terms of specs to the other EPYC I have.

  • @camerontinker1948
    @camerontinker1948 2 หลายเดือนก่อน

    This video is great timing! It looks like I will be doing something similar with my H12SSL-i soon! I have tried to sell it, but looks like it's coming back to me! I bet I can also replace most of my homelab with this server too. I just need to get something like the Silverstone 4U chassis.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +2

      The H12 mobo is really an impressive ATX sized format platform and indeed could run a very large homelab. I moved 12 host vm/dockers onto this so far and it barely breaks a sweat.

  • @DovahDoVolom
    @DovahDoVolom 2 หลายเดือนก่อน

    This is very nitpickey but in the future id recommend tightening the cooler in an X pattern as it helps get a more even mounting pressure

  • @waynebagger643
    @waynebagger643 2 หลายเดือนก่อน

    I've got some Icy dock 5x 3.5" HDD that fit in 3x 5.25" bays. Allowing some space for cables they're 220mm deep. Approx. 8 5/8" I think.
    How does that compare to the 3.5" caddy you have?

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      @@waynebagger643 It could have worked in the mobo centered cage but then the gpu would not have fit. The rear 6pin on the A4000. It covered the ATX power on the other side so that was a non starter.

  • @CephasSamwini
    @CephasSamwini 2 หลายเดือนก่อน

    Are those ear muffs or noise cancelling headphones?

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Noise cancelling, safty rated ear protection that has bluetooth.

  • @Steve25g
    @Steve25g หลายเดือนก่อน

    The moment, you want to run gpu's, get deeper 19" cases. There is a reason, servers are deep.

  • @deadlymarsupial1236
    @deadlymarsupial1236 2 หลายเดือนก่อน

    i forgot to mention: devolutions remote desktop manager - the free ed for homelabs.

  • @brendandelear1145
    @brendandelear1145 2 หลายเดือนก่อน +1

    If the case was a bit deeper it would be perfect!!!!

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      I might be case shopping on amazon right now....

  • @Damia-cz8og
    @Damia-cz8og 2 หลายเดือนก่อน

    LANcache proxmox guide please and where firewall pleased

  • @mochalatte3547
    @mochalatte3547 2 หลายเดือนก่อน

    This is by far the most inclusive video about hardware used + TrueNAS inside Proxmox. The speeds are just eye popping (i baraly have a 10Gig switch). I wonder though if Digital Spaceport actually has all of this sweet mini-data-center at HOME?? I wonder the electric bill? the noise?

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Its in the garage which is attached to the home. The noise isnt bad aside from the 100GbE switch. Is noise can ruin a video. Electric bill is around 275-300/mo right now for the whole house. Peak in the summer can hit 500. Winter time I dont need to run the heat so that helps avg it out.

  • @renedevrind1733
    @renedevrind1733 2 หลายเดือนก่อน

    You can add on the left side a HPE StoreEver LTO-8 Ultrium 30750 - Tape-station 30TB 5.25" internal SAS-2

  • @guyfeldman4697
    @guyfeldman4697 2 หลายเดือนก่อน

    I got a silverstone rm600 which also comes in a rm61-312 variant that has 12 bays of storage. It’s expensive but maybe close to the case with the other caddies. Dual power supply also makes the case more versatile for an ai server

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Okay. That case looks great!

  • @davidl6354
    @davidl6354 2 หลายเดือนก่อน

    DO YOU KNOW ANY 100gb nics for windows 11 considering getting gen 4 drives but would be wasted potential with a 10 gb nic

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Yeah I use the MLX 100GbE CX4's in Windows 11 Workstation. geni.us/MCX455A-100GbE_UpvU They work good but you need to install the correct drivers and make sure they are properly flashed to ETH mode. They also work great in Linux of course. 100GbE is super niche but maybe I should do a video on it? Also you will want to use RDMA and that is easier if you have a Windows server on the other end also. It's complicated setup also just FTR. I have hit a sustained high 5 GB/s write speed to nvme array before and want to push it harder.

  • @ErikBussink
    @ErikBussink 2 หลายเดือนก่อน

    Which Noctua CPU Cooler is that ? Seems fatter than the NH-D9 or NH-U14 ?

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      NH-D9 but its the SP version for EPYC/Threadrippers.

  • @KaldekBoch
    @KaldekBoch 2 หลายเดือนก่อน

    I have the exact same case using a 5-bay 3.5" drive cage on the right, and a 3-bay 3.5" cage + 8-bay 2.5" cage on the left. It's a great case for stuff like unRAID.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Did you run into any clearance issues with your setup? Im thinking on how to correct mine here.

  • @Labombab
    @Labombab 2 หลายเดือนก่อน +1

    Well that's insane, love the video!
    Copnclusion for what technology can offer today, 25Gbps should be enough.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      Especially in scenarios with its one client to one server access patterns, very firm yes. If your hosting a few iSCSI vms that can be a use case for greater speeds if you can only get in one NIC. Ive hit a tad over 5GB/s in the past on a single client rdma smb access and the level of pita is simply too high to consider optimising for that. Consistantly getting into the 32Gbit single stream range on 40gbit gear with minimal tuning is also easily doable.

    • @Labombab
      @Labombab 2 หลายเดือนก่อน

      @@DigitalSpaceport Nice, what do you use to rip the blu-ray's anyway, are you using linux and if yes, what software?

    • @ewenchan1239
      @ewenchan1239 2 หลายเดือนก่อน

      It REALLY depends on what you're doing.
      I've hit 133 Gbps on my 100 Gbps IB network, doing live VM migrations between Proxmox nodes, in my cluster. (Due in a slight, small part, to compression.)

    • @nadtz
      @nadtz 2 หลายเดือนก่อน +1

      40GbE can be cheaper second hand but it really depends on what you are doing, either way once you get past 10GbE there is likely going to be more tuning involved to get best speeds like he said in the video.

  • @nicholassmerk
    @nicholassmerk 2 หลายเดือนก่อน

    I'd suggest using a different chassis. I have been eyeing up the Sliger CX4712. Your zip tied fan needs a shroud.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      The zip tie fan is some on the fly jankiness I didn't anticipate lol. I have some additional plans around changes I will be making but certainly Slieger makes a great case!

    • @nicholassmerk
      @nicholassmerk 2 หลายเดือนก่อน

      ​@@DigitalSpaceport something as simple as foam and or butyl sheets would work. I used butyl soundproofing on the front of my tower case to direct air into the fan.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Does it look crazy?

    • @nicholassmerk
      @nicholassmerk 2 หลายเดือนก่อน

      ​@@DigitalSpaceport No, it's under the front cover and is only one small piece of KILLMAT to promote airflow in the direction of the fan. The Fractal Define 7 cases are already dampened so I didn't need to treat the side panels, otherwise I probably would have gone crazy.

  • @PrimalNaCl
    @PrimalNaCl หลายเดือนก่อน

    When any of those Seagates fail, it's gonna be a sad sad day having to pull, strip, replace, reassemble, and rerack.

  • @FSK1138
    @FSK1138 2 หลายเดือนก่อน +1

    this is my dream system🥰🥰 you got ALL the drives 🥰🥰
    i am running notebook lm and as many free local a.i.s i can
    but i am using a nas and a mini pc cluster , so many bottle necks 🤓
    but i am upgrading with ever faster last gen tech . so many bit coin miners and used servers are flooding the market as the new A.I. tech hit the market

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      You can do it! We are all chasing performance levels that were unheard of 5 years ago in the open source self hosted community, especially for LLMs. The learning curve has been steep, and I have a lot left to learn, but this is a fun journey!

  • @JonatanCastro
    @JonatanCastro 2 หลายเดือนก่อน

    Absolutely incredible! I have a similar channel with similar content. If you are willing to reply, I was genuinely wondering about your decision-making process in choosing this hardware versus opting for something enterprise but used on a similar budget level. Thanks

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      I do love enterprise hardware also and I did consider that route. I had this extra H12SSL-i laying around with the CPU also. That very much dictated I should go this route as it was a large already sunk cost.

    • @JonatanCastro
      @JonatanCastro 2 หลายเดือนก่อน

      @@DigitalSpaceport Gotcha, thank you! Out of curiosity, what would you have picked enterprise-wise if you didn't have that hardware lying around?

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      @@JonatanCastro I didnt even eval what options since I knew I had it on hand but I am very partial to Dell servers. I think they are very solid performance machines and I have come to really like them over the years. Supermicro is more flexible however from a case perspective and pretty "plug in play" since it is a Supermicro mobo. A SC847 might have been a great option but pretty expensive. Plus I do not like SM rails at all. Have a nasty perm-a-scar from one failing on me.

    • @JonatanCastro
      @JonatanCastro 2 หลายเดือนก่อน

      @@DigitalSpaceport got it! Thanks!

  • @win7best
    @win7best หลายเดือนก่อน

    Did you win the lottery or how can you afford all of this hardware

    • @DigitalSpaceport
      @DigitalSpaceport  หลายเดือนก่อน

      I re-evaluated what makes me happy. I get that you don't know the in's and out's of my life, and that is a good thing, but I simply value IT stuff more then a new car. It is literally that simple. When did you buy a new car last? It was a very long time ago for me and instead of spending money on a new car I decided to put it into fun stuff that I do value, IT hardware. I think folks might consider re-evaluating their spending habits if they wonder the same as you. All this stuff cost less then a mid range car does now. I get WAY more enjoyment from this vs a new car also.

    • @win7best
      @win7best หลายเดือนก่อน

      @DigitalSpaceport I'm not old enough to drive and not everyone has just enough money lieing around for a new car

    • @DigitalSpaceport
      @DigitalSpaceport  หลายเดือนก่อน

      Starting in IT young is a good thing! It can get you far. Dream big 👍

    • @win7best
      @win7best หลายเดือนก่อน

      @DigitalSpaceport thanks. Though recently it's been more annoying due to old hardware starting to fail and my general system is usually 3 to 10 generations behind and its just becoming a real pain in the butt

  • @billygilbert7911
    @billygilbert7911 2 หลายเดือนก่อน

    Nice build.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Thanks! It isnt perfect but I wanted to show the good and bad and by the end... I just wanted to finish it lol.

  • @lifefromscratch2818
    @lifefromscratch2818 2 หลายเดือนก่อน

    That case feels like it would have a whole lot more flexibility and usefulness if it was just 2" deeper.

  • @cinemaipswich4636
    @cinemaipswich4636 2 หลายเดือนก่อน +1

    Finding a case with 8 drive bays + 8 more is expensive. We need at least 4U case height for normal ATX power and CPU cooling towers and 9 PCIe slots. No one wants the average consumer to have nice things.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      I feel this. I dont get what has happened to the case industry but it is pretty bad and unoriginal.

  • @RetroBerner
    @RetroBerner 2 หลายเดือนก่อน +2

    I really wanted to like that case, but that's too many compromises

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      Me going with the A4000 does present a lot of clearance challenges but I have been thinking I might swap in a 3070fe and pull one of the NVMe carrier cards. I have done some benchmarking on ZFS arrangements and with 8 NVMe for just metadata, they will likely be underutilized for their intended purpose and file size anticipated (large geotiffs). The SSDs are used as cache devices. This setup is pretty customized for my primary use case and may not abstract well.

    • @RetroBerner
      @RetroBerner 2 หลายเดือนก่อน

      @@DigitalSpaceport Cool, a smaller GPU would definitely improve your layout options.

  • @ewenchan1239
    @ewenchan1239 2 หลายเดือนก่อน

    Pretty standard fare.
    It has been my experience that 100 Gbps IB is a TAD easier to work with than 100 GbE (somewhat ironically enough).
    LOTS of tuning options from SMB Direct to SMB multichannel.
    I am not sure if NVMeoF is available for RoCE, but you can try and see if you can deploy that rather than going through SMB. Skip some of the layers.

  • @goodcitizen4587
    @goodcitizen4587 2 หลายเดือนก่อน

    Really cool. Thanks!

  • @gh8447
    @gh8447 2 หลายเดือนก่อน

    That's a Silverstone enclosure? I hope you didn't pay Silverstone for it. Except for the different appearance of the faceplate and handles, it looks identical to a Chenbro enclosure.

  • @ThatHz-
    @ThatHz- 2 หลายเดือนก่อน

    Great video, I can’t imagine what your electricity bill is 😂

  • @henderstech
    @henderstech 2 หลายเดือนก่อน +1

    man thats my dream server. wish i could have one.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Another 2 years and epyc rome will be very cheap I think

    • @henderstech
      @henderstech 2 หลายเดือนก่อน

      @@DigitalSpaceport Nice . 2 years is not so bad , i can be patient. My trusty hp z440 will get me by. Its old but still works great.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      I have a z440 and yes those are still great.

  • @BigBenAdv
    @BigBenAdv 2 หลายเดือนก่อน

    You'd need to tweak the buffer length and window sizes for iperf to get higher single connections performance. Possibly even adjusting the MSS for jumbo frames.
    Realistically, you'd also want to tweak the network settings in the OS as well but those generally aren't tweaks you'd apply to a virt host.
    I did do single stream sustained >90Gb/s transfers on Windows 2012 R2 servers running (Single) E5-2670v3 CPU with non-RDMA TCP & SMB file transfers testing.
    This used about 27% of the 12C/24T so your limiting factor isn't the CPU for sure. It definitely involved a lot of tweaking and tuning including affinity pinning the Starwind RAM disk and the benchmarking software etc. made worse by having to use Windows (Qlogic 100GbE controllers didn't have RDMA ready drivers for Linux at the time (2017) and would kernel panic if we tried to do IBoIP or RDMA over NFS).

    • @ewenchan1239
      @ewenchan1239 2 หลายเดือนก่อน

      I'm confused. If they're 100 GbE NICs, why would you be trying to do IBoIP??? (Or did you mean IPoIB?)

    • @BigBenAdv
      @BigBenAdv 2 หลายเดือนก่อน

      @@ewenchan1239 Brain wasn't working. It's actually OFED, which at the time required some stuff from MLNX. It's been over 7 years since then. Brain got confused with IPoIB somehow.
      But yeah, Qlogic didn't have RDMA ready drivers for Linux so I had to setup on Win Svr instead.
      couldn't get Connect-X cards since Mellanox was the key competitor (100GbE switches tender PoC). They basically told us they could provide the cards if we dropped Arista and bid with them instead.

    • @BigBenAdv
      @BigBenAdv 2 หลายเดือนก่อน

      @@ewenchan1239 It's been over 7 years since. Brain got confused - it's actually OFED that we needed and I think there were scripts/ benchmarks that we needed from MLNX IPoIB side (keep thinking it's IB transport over IP network rather than IP encap over IB somehow).
      But yeah.. Qlogic didn't have RDMA ready drivers for Linux so it'd kernel panic once you tried transporting RDMA traffic. We couldn't get Mellanox Connect-X cards since I had a $0/- budget for the PoC and Mellanox was the competitor (100GbE switching tender).
      MLNX basically told us (SI vendor) that they'd provide the cards if we dropped Arista and bid with them instead. Wasn't going to happen so I had to make do with Win SVR instead.
      Out of the box, Win Svr would do 47~50Gbps with a single stream file transfer (SMB-Direct) but after ~2 weeks of tweaking & tuning (DCB, Offloads, PFC, Affinity pinning etc.), I managed to get it up to ~93Gbps file transfer excluding overheads - including overheads (TCP/IP & SMB etc.), it was about 97Gbps at the switch port. Crazy times but it was a fun learning experience for me.

  • @userou-ig1ze
    @userou-ig1ze 2 หลายเดือนก่อน

    Uhm... but how much did that cost omg

  • @chase11119
    @chase11119 2 หลายเดือนก่อน

    Love your content

  • @DavidVincentSSM
    @DavidVincentSSM 2 หลายเดือนก่อน

    love teh content, keep up the awesome videos!

  • @McCuneWindandSolar
    @McCuneWindandSolar 2 หลายเดือนก่อน

    I would have went with a rosewell case.

  • @FakeName39
    @FakeName39 2 หลายเดือนก่อน

    time for some custom 3d printed drive cages

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      I do need a 3D printer. Great point.

  • @nikolasadair
    @nikolasadair 2 หลายเดือนก่อน +1

    Great video. However, I'm going to write a Chrome extension that finds the word "INSANE" in any video title and changes it to "Moderately Interesting".

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Point taken but what would you need to see to be fully onboard with insane in the title?

    • @nikolasadair
      @nikolasadair 2 หลายเดือนก่อน

      @@DigitalSpaceport A video documenting the lives of patients in a 19th century asylum.

  • @visghost
    @visghost 2 หลายเดือนก่อน

    it is better to install a radiator on nvme, I have two nvme disks installed without radiators in the slot in PCIE-x16 it is heated 55 degrees

  • @atracamoniusvlogs
    @atracamoniusvlogs 2 หลายเดือนก่อน +1

    Homelab server's in emaar dubai hills estate sidra 1

  • @alexrambolton
    @alexrambolton 2 หลายเดือนก่อน

    I would of gone with the Rosewill RSV-L4500U. Has all the space and fan install points you would need.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      I might yet end up in that case. Thanks for dropping a model, doing some shopping

  • @dawn1berlitz
    @dawn1berlitz 2 หลายเดือนก่อน +1

    my server looks like like a gaming pc i used a intel cu but its just a sotrage and ackup server i have 4 2tb drives for storage each one is decicated to something while the boot drive is a old 500gb samsung 980 ssd

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Nothing wrong with that at all! My Unraid home server is a mini quad core all flash setup but any desktop PC could fit the role pretty well.

    • @dawn1berlitz
      @dawn1berlitz 2 หลายเดือนก่อน

      @@DigitalSpaceport im obsessdd with RGB im not sure if its because im autistic and i did have a ctual server once but it startedf having problems with the x16 slot so i had to stop using that and go backt ot a regular pc but that did save me some money

    • @dawn1berlitz
      @dawn1berlitz 2 หลายเดือนก่อน

      @@DigitalSpaceport i was using a old build that had a core i5-4590 now it has a 12th gen core i7 the new board i got from microcenter but its a ddr4 board which is perfectly fine

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Oh ddr4/pcie4 systems a nice perfirmance boost. Im trying to move all my gear onto gen 4 hardware and its happening slowly. The performance uplift for nvme is a huge diffeence Ive seen so far

    • @dawn1berlitz
      @dawn1berlitz 2 หลายเดือนก่อน

      @@DigitalSpaceport if i remember correctly this board does have one pci gen 5 slot (Msi z790-p pro wifi DDR4) it ironically replaced a older MSI board (Z97S SLI Krait Edition) the z790 was the 1st board ive purchased brand new

  • @johnyferreira8733
    @johnyferreira8733 6 วันที่ผ่านมา

    Bro is careless about his electric bill 😅 a mini data center in the basement.

  • @computersales
    @computersales 2 หลายเดือนก่อน

    Interesting build. I may know a guy with a GPU ready T640 for sale. 😜 Too big of a pain to ship though.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      Im not suprised Onyx has a T640, he has good instincts 🐈‍⬛

  • @PeterBuffon
    @PeterBuffon 2 หลายเดือนก่อน

    I want one of those to run my solo minecraft server.

  • @Jamesaepp
    @Jamesaepp 2 หลายเดือนก่อน

    Bro how the hell do you afford this hobby, are you an NVidia employee holding stock options or something?

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      I should ask for nvda stock, excellent point there! Seriously though it likely looks more expensive then it is. A wise person once told me to be a specialist in a niche that is not huge and consult in that. It was good advice.

  • @Rindhalu
    @Rindhalu 2 หลายเดือนก่อน

    I have the ICY DOCK Full Metal 8 x 2.5 SAS/SATA HDD/SSD Moblie Rack Enclosure for 5.25" Bay | ToughArmor MB998SP-B and I started with the RackChoice enslosure you have there. Atleast for me, ithe ICY worked out way more perfectly.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Great username! So far I have not had any issues but its very flimsy. Im in no touch mode for it.

    • @Rindhalu
      @Rindhalu 2 หลายเดือนก่อน

      @@DigitalSpaceport oh dont tell me you know the spiders too and the rotten kitties

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Oh yeah!

  • @tobasama
    @tobasama หลายเดือนก่อน +1

    That's not a homelab. That's a home data farm.

    • @DigitalSpaceport
      @DigitalSpaceport  หลายเดือนก่อน

      Im now referring to it as my nerdy midlife crisis.

    • @tobasama
      @tobasama หลายเดือนก่อน

      @DigitalSpaceport You're way passed that point buddy 😂

  • @husratmehmood2629
    @husratmehmood2629 2 หลายเดือนก่อน

    Hi dear , good work , can we use liquid immersion cooling to cool down our gpu like rtx 4090 ? is it possible to use liquid immersion cooling for motherboard like asus wrx90e sage pro and AMD threadripper Pro processors? Anyone who has knowledge to answer my question please answer.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      IDK but if you find out LMK! That sounds cool but I bet there is special prep work that would have to be done?

  • @lyth1um
    @lyth1um 2 หลายเดือนก่อน

    this is everything else, except home. :D

  • @faultyclean
    @faultyclean 2 หลายเดือนก่อน +14

    Had to have been the most annoying video to watch with the million ads that were included every couple of minutes.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +10

      Ill review the placements. I just have it set for YT to auto place them. Thanks for bringing this up, I wouldn't want one shown more then every 12 mins or so.

    • @faultyclean
      @faultyclean 2 หลายเดือนก่อน +1

      @@DigitalSpaceport just to clarify I didn't think it was you doing it on purpose but when trying to keep up with everything moving fast in the video then an ad pops up it's discouraging to keep watching if you know what I mean. They had to have shown at least 20 ads in the video and that is not an exaggeration. Maybe because it's a longer video but usually a 10min video is 1 or 2 ad placements max

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +9

      Just reviewed that and yes they had placed ine every 4 ish mins. I adjusted that down to 1 per 10 minute thanks again for letting me know. Ill manually check those in the future now I guess. They used to not do it this much.

    • @faultyclean
      @faultyclean 2 หลายเดือนก่อน +2

      @@DigitalSpaceport I think they released an update to the ads since the interface on the ad screen is different now. Now why would they think every 4 minutes is okay, I don't know but glad we're able to change it. Especially with other interested enthusiasts who are learning going to have the same trouble with trying to follow along but ads creating a problem.

    • @shadowunifer
      @shadowunifer 2 หลายเดือนก่อน

      There were ads?

  • @robatkinson8581
    @robatkinson8581 2 หลายเดือนก่อน

    Punch out retainer? You mean Motherboard IO shield.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      YEP! Sometimes when you are shooting a video you just say something oddball.

    • @robatkinson8581
      @robatkinson8581 2 หลายเดือนก่อน

      @DigitalSpaceport well it made me laugh anyway

  • @TheSasquatchjones
    @TheSasquatchjones 2 หลายเดือนก่อน

    Loving the build porn

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      Thanks I hope it is useful to see the issue I run into along the way. I dont see a lot of that out there so I try to bring a bit of it to videos when I can. I get miffed when I watch a video and it looks super easy and when doing it in real life myself it is the opposite.

  • @petruiacob5818
    @petruiacob5818 28 วันที่ผ่านมา

    This is some server p*rn lol. For some reason I watched this entire thing.

    • @DigitalSpaceport
      @DigitalSpaceport  28 วันที่ผ่านมา +1

      Bow chica bow wow th-cam.com/users/shorts3S8cZQbGpz0

    • @petruiacob5818
      @petruiacob5818 28 วันที่ผ่านมา

      @@DigitalSpaceport hahahaha don't tell me you posted this right now

  • @OfficialMikeJ
    @OfficialMikeJ 2 หลายเดือนก่อน

    The ram installation was super hard to watch just letting them sit in each slot "Lose" proceeds to click them in one at a time. super cringe. Yikes. install one at a time and click them into place one at a time. if something were to be dropped or fall on the sticks of ram they could become faulty and also damage the pins in the motherboard. That's a really expensive replacement or RMA.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      I dont get this comment at all. There was nothing that could fall on the ram sticks and nothing nearby even.

  • @autohmae
    @autohmae 2 หลายเดือนก่อน

    "homelab" 🙂

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      I agree but it is in my home. Things are a bit weird.

  • @tetnia
    @tetnia 2 หลายเดือนก่อน

    The choice of case is not correct to my opinion.....

  • @stoneobscurity
    @stoneobscurity 2 หลายเดือนก่อน

    send me the r720xd.

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      What city you in?

    • @stoneobscurity
      @stoneobscurity 2 หลายเดือนก่อน

      @@DigitalSpaceport Austin (Buda), Texas

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน

      Email me at social@digitalspaceport.com if you want an R520. I'm gonna hold onto the R720xd as a backup.

  • @Ncky
    @Ncky 2 หลายเดือนก่อน

    People should stop classifying projects that literally eat energy and heat up whole house as homelab grade project..... Better call it amateur lab setup, not homelab setup

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +1

      I'm making this topic into a video soon. See if we can get some cohesion and precision around the terminology.

  • @doradeutsch2340
    @doradeutsch2340 2 หลายเดือนก่อน

    A typical "Homelab" server - nothing special.

  • @tomo8224
    @tomo8224 2 หลายเดือนก่อน +2

    INSANE?! That's very clickbaity. I saw nothing INSANE in this video. Really no reason to put that in the title - I would've watched it away 👍 Good content!

    • @arigornstrider
      @arigornstrider 2 หลายเดือนก่อน +4

      Did you not see him set up striped disk arrays? That alone is insane 😂

    • @DigitalSpaceport
      @DigitalSpaceport  2 หลายเดือนก่อน +2

      @arigornstrider 110 disk stripe is indeed insane. Single SAS 2 port did limit that speed a lot and like 10 multiplexers on those trays.

    • @brendandelear1145
      @brendandelear1145 2 หลายเดือนก่อน

      Dream server is insane