Cable trays are critical to having a safety.. Haters would just put the cables on the ground then destroy um or trip and hurt themselves. Good on you for keeping cables safe and out of the way!
I hope you are not having to drill out lots of rack screws, that is no fun. I need to remember this when I pickup the impact driver when racking gear...
Would love for you to do a basic guide on that brocade switch! I got a couple myself and would LOVE a simple guide on some basic ways to configure them, love your videos man!
Im conflicted on these switches. Mine is hitting 220W which is more then double what the other 2 switches hit, but these things are great also for packing in so much capability. Ill see if I can work in a basic config and setup guide for doing CLI tasks before I pull mine out here. I wont be able to do any failover stuff however as I only have 1.
I have a 42U rack that is full, and I used ball bearing extension rails so I can slide out the 4U server cases, some filled with 18tb hard drives. But I never thought of using zip ties, not even for the 1U switches. I'm always dropping the screws and then have to get down on my hands and knees to try and find them. I use a hard drive magnet at the end of a dowl for that.
I would not use zip ties for my servers personally, they all have the nice slide out rails but I do feel you on dropping server rack parts inside the rack lol. I need to get my magnet on a stick!
Nice setup... All switches are usually installed facing the hot aisle, so you don't need to run all those cables from the front and save RU. Label all the cables to save time and hair pulling later. All power cables should be tucked on the side so there are as little cables as possible in the back for server air flow.
All my switches have front to back airflow and it's quieter this way also. Ideally I would rear mount um but noise is a huge concern in this setup and reverse direction fans are crazy prices for these switches
Use about 4 bottle caps between each of those switches and that Dell R210 for airflow and to help avoid high thermal build up/sharing. The bottle caps work perfectly.
I have an older APC Netshelter that I got used. Unfortunately, the back, of it doesn't have much depth beyond the rack posts. There's no room inside the rack to mount a power strip behind the servers, so I screwed a board to the ceiling and floor behind the server and mounted two 6-foot power strips. I have 2 older APC UPSs each on their own 20 amp circuit. My main servers right now are an R720 running Truenas, 2 R730s running Proxmox. and a smaller Supermicro running pfsense.
The dell racks arent that short as seen, your netapp shelves do not stick out past the PDUs. The 900mm deep APC racks however has this issue opposed to the 1200mm deep version. One thing I learned is if you have the room, the APC AR3350 - 42U NetShelter SX Rack - Extra Wide/Deep - 750mm Wide x 1200mm Deep rack is king!!
I had 3 of the AR3350s in the past, way before all of this and you are so right. That is why suffering with these is such a pita. I know how good it can be, and I sold them for 250/ea 😭
"Do you also like label makers?" i am quite literally obsessed with them and have been holding myself back from buying one because i know i would just go absolutely nuts and label absolutely everything and anything.
Not to urge temptation, but having a nice label maker can help organize a life for sure. If you are going to label the light switches yeah maybe thats too far haha. Stuff in cabinets however...
that whirring sound is his external power meter spinning at 6k rpm......(lol) nice video, but I think I'll keep my home rack to 20U with a combination of S5212 (3X100g, 12X25g) PC8164 (2X40g, 48X10g) and N2024 (1g switch). I use my high speed connections for server 2 server (storage/file) and mid speed for inside the computer room. the basic dell hardware is also my choice as well, I just use less of it with some higher end newer R series components. fun view just the same....
Yes I have 2 epyc systems that will be replacing some of the older gear, but I like to have failover in a lot of my systems with proxmox (aside from the storage on TrueNAS for unimportant data) as I use this also for work. Its not as bad as you might expect on the electric as I dont use the quad socket servers very often, and when I do they payback the electric for the hour in under a minute.
Nice indeed. I have 25G/10G on my home network (with few 40G ports), and might be exploring 100G soon. But tham, I only have like 22U rack, plus a cluster, and few switches here and there. Would kill for 2 real full sized racks, but I cannot fit them, nor do I have power for them.
if you like improvising, tig welding is 10x faster and 10x stronger than zip ties if you don't polish every tack. less flexible to fudge, but just layout each tray segment, fixture, level, tack, repeat.
Drill - Those damn screws were stripped Scissors - Im looking for side cutters now Servers - I process GIS data by the planetload for my business (not a small part of the storage either) 140w being an issue - you have a point but now I have a SN2700 so I dont know what to say.... I have a need 4 speed?
Seeing you use dymo labels on cables is triggering my OCD. I am forever picking them up off the ground after the exhaust heat peels them off when other techs use them. Please invest in a Panduit wrap around labeller (LS8E or newer one if your a mad lad), it will change your life if you label cable frequently. It wraps around and then self laminates over the text with a clear section. You can thank me later. ;-) P.S. great work with the build. Love the video.
This appears to be an install in a garage. Beware of the Firecodes of opening the garage to the home. There's fire and explosion ratings for everything on the firewall(garage to house) Essentially the vehicles in the garage are a high fire/explosion risk so there's minimum ratings for any wall surfaces and penetrations.
I just have to ask because I'm just now looking to build a small (especially compared to this) NAS/server setup for my home..... What are you doing that actually requires all of this equipment? Is this for personal use or do you lease out your servers? It's just insane to think that this is a personal home server - even as a hobby, I see all the money that goes into setups like this and my mind is blown.
Insanely valuable video! Sorry for the noob question, but where is the router? Or is one of these switches acting as a router? I'm taking baby steps in this area so I'm confused when I see such a huge setup. My basic question is how does this rack connect to the internet.. Thank you!
Thanks! I try to add value to existing content out in the tubes. The router is in a seperate closet and is a PFsense box. There is a video coming on that (and a network overview) very soon.
@@DigitalSpaceport Thank you for your response and can't wait to see the new video! Another noob question, is one router enough to cover low latency / high bandwith data for all these devices?
@@pictzoneI believe you can only really have one router. But I'm also pretty new to all of this. I suppose you could have a internet facing router and then have vlans on managed switches.
@@dominick253 Yep, that seems to be the answer. As soon as you introduce another router or a VLAN, you're creating a subnet. But you usually don't need such a setup.
You only have 1 L3 router. Switches (L2) are fine to have multiple. Yes I could run thousands of devices off a simple PFsense box and that video IS SOON I just ran the final 40Gbit cable in the attic.
I'm not sure what bothers me more. The zipties, the drilling in the rack, or the hassle of a patch panel. My cable management really could use some work though. Honestly my biggest regret with my current rack setup is not having the front posts far enough back for some of the stiffer cables. Although not having 208V for my 3000VA UPS bothers me even more when I think of it.
The zip ties do concern me a little. I got a rack nut tool and it helps a ton with square hole racks. Rack studs and speed nuts (the ones with the long spring clips in the back) are also good options for load bearing 1u gear. But as long as you have the rail ears far enough under the switches, the zip ties should do great for keeping the switches in place. Not a trick I have seen before.
Yeah I wanted to use the rail and keep the support rigid under the base unit as much as possible. The 6036 and r210ii don't have ears that attach at all properly so they end up relying on the unit under them to support their weight. That's a decent amount of sag they get as a result so I reused a md1000 rail for the base. That rail didn't have proper front drilled spots for any but the base switch. I did drill out for the 6610 but it was a major pita. I should slide it out and nut and screw it in to give better "oops" support mid stack.
Loved watching this. Have a question. What exactly do you do with your setup? I love Dell servers, and I have 5 R710s and 1 R720. Only ONE of the R710s is currently running ESXi 6.5 with VMs for Windows 2016 Server web hosting and SQL Server databases. It will be interesting to see what you do with all your equipment. (If you have a video talking about it, that would be great to see.) Take care and continue doing what you do and love. Very fascinating. Wayne
Thanks some of it is business stuff,so proper production at a fraction of cloud costs for GIS related work. It's a LOT of data to move and process. I do have a lot of homelabservices running and want to get more of those videos out also.
If 40gbit is esoteric, what will you say when I roll the 100gbit switch in 😉 Single primary with a cell failover, but this is not for being the neighborhoods ISP (yet) rather its so I can move a lot of data to 3-4 array pools at a time. Not uncommon to hit 300Gbits lan transit. 10c per KW. The ICX6610 has been retired and the SX6036 is about to get the 🪓 for a SN2700 which will be the new backbone switch. 5548P needs to be replaced. ICX6610 consumed an ungodly amount of watts but it was a rather versatile AIO switch.
The cable management aspects of home networking I am pretty good at. Now when I need to get into a network switch CLI and do anything... things get bad.
@@DigitalSpaceporthen I ran my cat 5e/6 cables. I use blue for data, orange for backup data, Black for management ports, red for do not touch this ever after installing and purple for internet.
It's about 150/mo extra at my rates. I use this for storing and processing business data that would have a 5 digit a month bill in "cloud" so it's for sure a savings. It's not just a lab, It's my internal production systems.
@@DigitalSpaceport I am surprised at the cost that's lower than I thought for monthly. but yeah that definitely makes sense compared to the cloud sure saving money there. dope setup
It is a nice home net, However. I recommend buying Cisco networking equipment since that name alone on your resume will open doors. Use Dell or HP servers using VMware running windows and Linux servers.
Backing up the internet, Providing Cloudflare their infra, Running the networking for a small city, Solving protein folding, Rendering Hollywood's latest.... Okay so maybe its not all that glamorous but I will have a big video on this topic exactly as I get this question A LOT. SOON!
My homelab doesnt get a free ride. I provided services for data generation to disks at scale and prefer to have a storage network vs direct attached as it allows more machines to participate and schedule work delivery to jbods via a truenas headend. Archiving important data, OCR extraction for training models on old newpaper clippings, Generating plot files for sale to chia farmers are all workloads, vm distribution for HA are all things that this works well for.
@@paul68kdmd Yeah so the stored plots only need to be read after creation so the energy to do that off a platter HDD is low, so its not really POW they call it Proof of Space and Time, PoST. HA is High Availability, so if I need to take a machine offline I can move and keep all the VMs/Dockers running by migrating them to a different machine, seemlessly. No downtime.
I run a small business and do GIS data processing so I have large datasets and need lots of compute. Moving things around taking a day is not uncommon even at these speeds.
I use parts for home services, parts for work which involves rendering large projects, and part for Chia which makes me more then enough to cover the electric each month.
Glad this video showed up. Sub'd !! People say I am nutz because of my home lab racks. Now I can say hold my beer and show them this vid. Just received 4 more cm arms today and I know exactly how I will be spending this weekend.
To think it all grew out of that first SC846 I got 10 years ago. I mean I had a rack at work in 2012 but bringing things home starts ya on a different path.
I'm not criticizing you because you surely know what you're doing, but wouldn't it be cooler to replicate an actual datacenter setup with Top-of-Rack switches and a dedicated interconnect rack?
I wanna go and snip those fasteners so bad, shake a little the rack. Is it that difficult to make it like it is intended? having proper mounting rails. That is just lazy and insane... och it's insane already to have it in house. LEt plastic straps hold it toogether. I think Vecro wil work better. Reusable 🤣😋💖 Also what foot size are the cables? 🤣 (U said half a foot but not what shoe size 😊) All cables up to spec with all the guide rails up to fire code except plasstic holding it there and there 😋 not like is is going to combust in house. Pretty neat just too much cable ties. I want to come and snip them all. Screws seem a better option for me. I would feel more secure. Also this is crazy thing. I wish I could xchange my laptopo for that and get neighbour to pay my bill. 🤣 I like your methodical Labeling of cables.
There are reasons it went this direction. They may not be the best reasons, but they are reasons. I didnt have proper ears for the 6036 or the r210ii so they needed support. I also hate switch sag SO MUCH. In a combo problem solve moment of cheapness, I reused a md1000 rail kit for the base. I had planned to drill out all the screw holes but the the Dell rail front is crazy hard metal and I broke all the right drill bits trying. Plan B zip ties 😄 but I did know it was going to trigger some people. It's less insane as it's in the garage. Inside a house would for sure be noise you wouldn't want to live with.
Holy Smokes.... I just have SO Many questions.... some related to your mental state and others related to your marriage stability and many other questions of a "Why" based nature....
My electric bill isnt that bad as I have 10c per KWh rate. Usually in the 250-325 range monthly depending on usage. If I need to run a lot of the quad socket servers, it can hit 800 pretty fast. Will be doing a whole video on the home datacenter and modernization things I have going on. Just started getting into AMD EPYC processors and can see them taking a much larger role in my home server setups
Hello. Since I don't know your channel, without watching a bunch of videos beforehand, I'm wondering, what do you need your own little data center in your basement for? At least it looks like the basement in the house to me.
Will have a homelab tour video out soon and explain that all. It is my garage but I use the mini DC for work, homelab, and then a part generates off storage some extra for me to cover electric bills and such.
I hate punch down! I also don't trust them! 2 years from now you could move something back there and pull on one of the wires just a little to hard and pull a wire out without knowing it. I have completely switched to keystone jacks on the front and the back of all my patch panels! All wires are terminated in RJ45 and plugged in where they need to be. This also has the benefit of ease of making changes in the future!
The good news is I'm consolidating to a sn2700 for the backbone. The bad news is I could for sure use a CCNP review. Seriously however I do think the 40gb option offers a lot of performance packed into (used) pricing that is really cheap right now. It also hits pcie3 speeds to near max. I should do a video on why I need really fast networking in the house sometime. My peak aggregate measured pushing real data was in the low 400gbit range for a few days sustained.
Great video, thanks. Don't take this the wrong way but has anyone ever tell you that your energy is equivalent to Richard Dreyfuss in the movie Close Encounters? I do secretly wait for a video of you shoveling dirt into your living room window while narrating proper stance and shovel grip. Of course you'll have a bath robe on and your children will be crying in the background, like in the movie. Just a thought. Have a good day Jared.
@@DigitalSpaceport I mean it in the most highest complementary way. BTW your setup looks really good. I respect a residential cable tray any day. Great job
I filmed this video in January so it already needs an update lol. That network cable management tray has a lot more CAT 1Gbit and Fiber 10Gbit in it now. Taken as the complement it was 😁
@@DigitalSpaceport I thought about it but it will kill the design I was going for so logically I decided to design my own thing. Thankfully my hardware needs aren't much so I can actually come up with a costume case concentrating on use of space and best cooling for all drives at lowest noise possible. For now is just a full tower PC case like a decade old and another matx case for the pfsense.
Digital why did you we need some serious networking, with the right tools and equipment and budget of course I can build the best network home lab ever.
I got a good laugh out of this. I thought I was the only one doing silly stuff like this. Mellanox + 2* 10Gbe + Epyc_Rome_or_Better + Nvidia + Sound Card = God_Mode_Homelab (really business...). What on god's earth are you using all this for? Voip services, Video editing, Stock market HPC stuff, or cluster farm - I just need to know. You can replace alot of that stuff with Epyc boxes and VMs.
I do have 2 EPYC systems that will be pulling up a lot of the weight moving forward. Im glad to find another adventurer of the arts of home datacentering haha. I use it for a lot of purposes. The massive quad sockets are for doing lightmass in Unreal (becoming less of a thing) and processing certain cpu types of datasets you find on huggingface (that site is crack, you are warned)
Punch Down Patch Panels dont make sense to me, never have... the RJ45 back panel connectors have the same spacing and you can just pull out and replace easily punch down panels completely make that spot unusable if the cable goes dead
Yes, that is the exact reason servers have those fans... what's your point? The datacenter versions of Nvidia's GPUs don't even have fans and rely entirely on the cases airflow.
In the video you asked if the zip ties are upsetting me. Well the answer is hell yes! LMAO I'm not gonna lie it kinda triggered me BIG TIME! Get some cage nuts you wacko! All this money spent on gear and you cant buy cage nuts?!?!
There is a weird reason for things to have gone like this. Let me explain. I have tons of cage nuts, however I dont have rails for any of these switches. I HATE the saggie switch syndrome also but its even worse. I dont have proper ears for a few of these so they have to piggyback on top of the second switch. Solution was to reuse a rail pair from a long gone MD1000. However this presented issues as it has an incredibly drill bit resistant front plate. I broke all the proper sized drill bits I had trying to drill it out. I did get enough for the bottom switch to have the screws thread in properly. and the rails support it very well from the bottom. However I needed a plan B vs buy ears and wait for video, Zip Ties! I knew it was going to trigger folks so decided to turn it into a joke in the video (edits are not linear) However now that they are in there I am not sure I will spend the money on the ears. They really are held in place well.
Bro also has cable trays at home... They tought I was crazy when installed those on my apartment. But, those are the coolest toys available!!
Cable trays are critical to having a safety.. Haters would just put the cables on the ground then destroy um or trip and hurt themselves. Good on you for keeping cables safe and out of the way!
Dude, the magnet to catch shavings was brilliant. I feel like a pleb drilling without one now.
I hope you are not having to drill out lots of rack screws, that is no fun. I need to remember this when I pickup the impact driver when racking gear...
This is by far my favorite networking video as of today. I just love this level of attention to detail. You sir just gained a new subscriber.
Ive been working on the next followup for over a month. The 100Gbit switch is complicated is putting it nice lol.
I loved the time to apreciate all the suff powering up, so satisfying, amazing video!
I was more excited to get a new label maker at work than I was a laptop.
#workgoals that matter right here
Would love for you to do a basic guide on that brocade switch! I got a couple myself and would LOVE a simple guide on some basic ways to configure them, love your videos man!
Im conflicted on these switches. Mine is hitting 220W which is more then double what the other 2 switches hit, but these things are great also for packing in so much capability. Ill see if I can work in a basic config and setup guide for doing CLI tasks before I pull mine out here. I wont be able to do any failover stuff however as I only have 1.
brocade cli is so easy to learn man, is like the cisco cli but a bit better in my opinion
I have a 42U rack that is full, and I used ball bearing extension rails so I can slide out the 4U server cases, some filled with 18tb hard drives. But I never thought of using zip ties, not even for the 1U switches. I'm always dropping the screws and then have to get down on my hands and knees to try and find them. I use a hard drive magnet at the end of a dowl for that.
I would not use zip ties for my servers personally, they all have the nice slide out rails but I do feel you on dropping server rack parts inside the rack lol. I need to get my magnet on a stick!
That's why you have a tub of spares 🙂
That networking deserves a sub. Keep it up!
Thanks for the sub!
Nice setup... All switches are usually installed facing the hot aisle, so you don't need to run all those cables from the front and save RU. Label all the cables to save time and hair pulling later. All power cables should be tucked on the side so there are as little cables as possible in the back for server air flow.
All my switches have front to back airflow and it's quieter this way also. Ideally I would rear mount um but noise is a huge concern in this setup and reverse direction fans are crazy prices for these switches
@@DigitalSpaceport You could just unscrew the housing of the switch and rotate the fan orientation. . .
Very nice!
An inspiration to all homelabers :)
Welding with cable ties 😅 Love it!
😁😁😁
what do you need this for? what do you work on?
Talking about being careful with fiber, put the protective cover on the ferrule and clean the ferrule before connecting with an SFP module etc.
The lengths we go to for a nice plex server
Use about 4 bottle caps between each of those switches and that Dell R210 for airflow and to help avoid high thermal build up/sharing. The bottle caps work perfectly.
this is the most interesting suggestion I have seen in a while + I get to drink 4 beers now. 🍾THANKS!
I have an older APC Netshelter that I got used. Unfortunately, the back, of it doesn't have much depth beyond the rack posts. There's no room inside the rack to mount a power strip behind the servers, so I screwed a board to the ceiling and floor behind the server and mounted two 6-foot power strips. I have 2 older APC UPSs each on their own 20 amp circuit. My main servers right now are an R720 running Truenas, 2 R730s running Proxmox. and a smaller Supermicro running pfsense.
The dell racks arent that short as seen, your netapp shelves do not stick out past the PDUs. The 900mm deep APC racks however has this issue opposed to the 1200mm deep version. One thing I learned is if you have the room, the APC AR3350 - 42U NetShelter SX Rack - Extra Wide/Deep - 750mm Wide x 1200mm Deep rack is king!!
I had 3 of the AR3350s in the past, way before all of this and you are so right. That is why suffering with these is such a pita. I know how good it can be, and I sold them for 250/ea 😭
"Do you also like label makers?" i am quite literally obsessed with them and have been holding myself back from buying one because i know i would just go absolutely nuts and label absolutely everything and anything.
Not to urge temptation, but having a nice label maker can help organize a life for sure. If you are going to label the light switches yeah maybe thats too far haha. Stuff in cabinets however...
that whirring sound is his external power meter spinning at 6k rpm......(lol) nice video, but I think I'll keep my home rack to 20U with a combination of S5212 (3X100g, 12X25g) PC8164 (2X40g, 48X10g) and N2024 (1g switch). I use my high speed connections for server 2 server (storage/file) and mid speed for inside the computer room. the basic dell hardware is also my choice as well, I just use less of it with some higher end newer R series components. fun view just the same....
Yes I have 2 epyc systems that will be replacing some of the older gear, but I like to have failover in a lot of my systems with proxmox (aside from the storage on TrueNAS for unimportant data) as I use this also for work. Its not as bad as you might expect on the electric as I dont use the quad socket servers very often, and when I do they payback the electric for the hour in under a minute.
What exactly do you use all those computers for?
Nice indeed. I have 25G/10G on my home network (with few 40G ports), and might be exploring 100G soon. But tham, I only have like 22U rack, plus a cluster, and few switches here and there. Would kill for 2 real full sized racks, but I cannot fit them, nor do I have power for them.
100Gbit still has a lot of edges I am finding. Expensive edges. CX-4 edges lol.
Hello, I have a question why you need so many servers that each one does and for what so many tera bits of storage thanks
this home setup is sick...i need to watch more of this channel... 😄
He's the Nerd Final Boss
if you like improvising, tig welding is 10x faster and 10x stronger than zip ties if you don't polish every tack. less flexible to fudge, but just layout each tray segment, fixture, level, tack, repeat.
I have a couple of powerconnect 5524p and both of them are unable to export the config via usb or http/s. Does your 5548p have the same problem?
Few things confusing me:
Drill, scissors, the amount of servers for a home lab, 140W being an issue in your situation.
This is a huge setup!!
Drill - Those damn screws were stripped
Scissors - Im looking for side cutters now
Servers - I process GIS data by the planetload for my business (not a small part of the storage either)
140w being an issue - you have a point but now I have a SN2700 so I dont know what to say.... I have a need 4 speed?
Instantly subscribed! 😮🎉
Your electric bill must be outrageous. The slim lines are excellent. I use them when ever i can.
Seeing you use dymo labels on cables is triggering my OCD. I am forever picking them up off the ground after the exhaust heat peels them off when other techs use them. Please invest in a Panduit wrap around labeller (LS8E or newer one if your a mad lad), it will change your life if you label cable frequently. It wraps around and then self laminates over the text with a clear section. You can thank me later. ;-) P.S. great work with the build. Love the video.
SO ABOUT THAT.... My floor is littered with these bastards now! 100% spot on.
46:26 horrible sound🤭🤭
As a phone man I never underestimate the power of zip ties. 👍
That micro-clicky sound there is something about it.
Nice setup
what are you running on this server? who need so much power at home?
This appears to be an install in a garage. Beware of the Firecodes of opening the garage to the home. There's fire and explosion ratings for everything on the firewall(garage to house) Essentially the vehicles in the garage are a high fire/explosion risk so there's minimum ratings for any wall surfaces and penetrations.
I perfume Velcro, but when in Rome...... and the start-up sounds like the sirens from Silent Hill
Sir what is the use of this network at home?
I just have to ask because I'm just now looking to build a small (especially compared to this) NAS/server setup for my home..... What are you doing that actually requires all of this equipment? Is this for personal use or do you lease out your servers? It's just insane to think that this is a personal home server - even as a hobby, I see all the money that goes into setups like this and my mind is blown.
is it a Proof-of-space setup?
Insanely valuable video! Sorry for the noob question, but where is the router? Or is one of these switches acting as a router? I'm taking baby steps in this area so I'm confused when I see such a huge setup. My basic question is how does this rack connect to the internet.. Thank you!
Thanks! I try to add value to existing content out in the tubes. The router is in a seperate closet and is a PFsense box. There is a video coming on that (and a network overview) very soon.
@@DigitalSpaceport Thank you for your response and can't wait to see the new video! Another noob question, is one router enough to cover low latency / high bandwith data for all these devices?
@@pictzoneI believe you can only really have one router. But I'm also pretty new to all of this. I suppose you could have a internet facing router and then have vlans on managed switches.
@@dominick253 Yep, that seems to be the answer. As soon as you introduce another router or a VLAN, you're creating a subnet. But you usually don't need such a setup.
You only have 1 L3 router. Switches (L2) are fine to have multiple. Yes I could run thousands of devices off a simple PFsense box and that video IS SOON I just ran the final 40Gbit cable in the attic.
I'm not sure what bothers me more. The zipties, the drilling in the rack, or the hassle of a patch panel.
My cable management really could use some work though. Honestly my biggest regret with my current rack setup is not having the front posts far enough back for some of the stiffer cables. Although not having 208V for my 3000VA UPS bothers me even more when I think of it.
This whole thing was triggering folks for engagement farming. Guilty as charged.
@@DigitalSpaceport I mean I've done worse. 🤪
The zip ties do concern me a little. I got a rack nut tool and it helps a ton with square hole racks. Rack studs and speed nuts (the ones with the long spring clips in the back) are also good options for load bearing 1u gear. But as long as you have the rail ears far enough under the switches, the zip ties should do great for keeping the switches in place. Not a trick I have seen before.
Yeah I wanted to use the rail and keep the support rigid under the base unit as much as possible. The 6036 and r210ii don't have ears that attach at all properly so they end up relying on the unit under them to support their weight. That's a decent amount of sag they get as a result so I reused a md1000 rail for the base. That rail didn't have proper front drilled spots for any but the base switch. I did drill out for the 6610 but it was a major pita. I should slide it out and nut and screw it in to give better "oops" support mid stack.
Just like a mechanic will always have a broken car, a tech guy will always have a petabyte rack setup but no rack nuts.
Loved watching this.
Have a question.
What exactly do you do with your setup?
I love Dell servers, and I have 5 R710s and 1 R720.
Only ONE of the R710s is currently running ESXi 6.5 with VMs for Windows 2016 Server web hosting and SQL Server databases.
It will be interesting to see what you do with all your equipment.
(If you have a video talking about it, that would be great to see.)
Take care and continue doing what you do and love. Very fascinating.
Wayne
Thanks some of it is business stuff,so proper production at a fraction of cloud costs for GIS related work. It's a LOT of data to move and process. I do have a lot of homelabservices running and want to get more of those videos out also.
Electricity kWh price in your location and consumption for this esoteric setup, single link out ?
If 40gbit is esoteric, what will you say when I roll the 100gbit switch in 😉 Single primary with a cell failover, but this is not for being the neighborhoods ISP (yet) rather its so I can move a lot of data to 3-4 array pools at a time. Not uncommon to hit 300Gbits lan transit. 10c per KW. The ICX6610 has been retired and the SX6036 is about to get the 🪓 for a SN2700 which will be the new backbone switch. 5548P needs to be replaced. ICX6610 consumed an ungodly amount of watts but it was a rather versatile AIO switch.
@@DigitalSpaceport .86per Kw here! move data, what data , TH-cam videos ?
Why are you using a patch panel vs a blank panel with keystone
Free. I got them with a bunch of other gear but no doubt keystones are much much easier.
I wonder how much is your monthly power bill ?
You must be new here 😁
THIS IS AWESOME
Sweet glad you enjoyed the video, appreciate the feedback.
One of my server is an R910, and it sounds just like that!
Nice video Jared. Clear and concise. Great way for someone to find the equipment they need and get it up and running.
The cable management aspects of home networking I am pretty good at. Now when I need to get into a network switch CLI and do anything... things get bad.
@@DigitalSpaceporthen I ran my cat 5e/6 cables. I use blue for data, orange for backup data, Black for management ports, red for do not touch this ever after installing and purple for internet.
Purple would be the internet ingress for WAN? I like this layout you have for color coding.
Thank you buddy! That’s a good video. I’m going to buy the kit.
What do you use so many servers for?😄
super cool but like how do you afford the power bro that got to be a few grand pre year minimum
It's about 150/mo extra at my rates. I use this for storing and processing business data that would have a 5 digit a month bill in "cloud" so it's for sure a savings. It's not just a lab, It's my internal production systems.
@@DigitalSpaceport I am surprised at the cost that's lower than I thought for monthly. but yeah that definitely makes sense compared to the cloud sure saving money there. dope setup
Looks like the networks we have in the FB group Extreme Home Networks
Im aging back into FB soon will check it out!
It is a nice home net, However. I recommend buying Cisco networking equipment since that name alone on your resume will open doors. Use Dell or HP servers using VMware running windows and Linux servers.
I think the garage door opener should be connected to your UPS.
I have done something weird in my garage. I hope a future buyer has some creative vision.
My man has an entire CDN in his basement...
Just wow!
What do you even do on that hardware?
Backing up the internet, Providing Cloudflare their infra, Running the networking for a small city, Solving protein folding, Rendering Hollywood's latest.... Okay so maybe its not all that glamorous but I will have a big video on this topic exactly as I get this question A LOT. SOON!
@@DigitalSpaceport Haha great! I just saw Chia mining, that at least explains some of the many JBODs. Really excited!
Can you tell me what kind of things require a setup like this?
My homelab doesnt get a free ride. I provided services for data generation to disks at scale and prefer to have a storage network vs direct attached as it allows more machines to participate and schedule work delivery to jbods via a truenas headend. Archiving important data, OCR extraction for training models on old newpaper clippings, Generating plot files for sale to chia farmers are all workloads, vm distribution for HA are all things that this works well for.
@@DigitalSpaceport ah, very interesting. I learned that Chia uses storage as proof of work thanks to your reply. What's HA, by the way?
@@paul68kdmd Yeah so the stored plots only need to be read after creation so the energy to do that off a platter HDD is low, so its not really POW they call it Proof of Space and Time, PoST. HA is High Availability, so if I need to take a machine offline I can move and keep all the VMs/Dockers running by migrating them to a different machine, seemlessly. No downtime.
@@DigitalSpaceport ah very interesting! I learned something new today. Thanks, DS!
Where did you get the CDU from?
I have piles of them. Want 1?
How much do you pay for energy?
So why are you doing this? Personal project or aim to commercialized it?
I run a small business and do GIS data processing so I have large datasets and need lots of compute. Moving things around taking a day is not uncommon even at these speeds.
Are you using this whole server only for your own home?
I use parts for home services, parts for work which involves rendering large projects, and part for Chia which makes me more then enough to cover the electric each month.
Glad this video showed up. Sub'd !! People say I am nutz because of my home lab racks. Now I can say hold my beer and show them this vid. Just received 4 more cm arms today and I know exactly how I will be spending this weekend.
There is a pleasure with having real infra on hand that's hard to quantify.
i hate the cableties yeah :D i would just get some standard nuts and bolts or a solution like rackstuds. Now it feels like youre doing it halfway :D
You Mean Home Data Center right ?
There are lines that have been crossed I think at some point here...
How much is your power bill going to be?!
😅
Duuuudeeee holy crapppp mannnnn. I want
To think it all grew out of that first SC846 I got 10 years ago. I mean I had a rack at work in 2012 but bringing things home starts ya on a different path.
Great video keep it up
So like, what do you do though? Surely you're not running this ~$100K setup for funsies?
I'm not criticizing you because you surely know what you're doing, but wouldn't it be cooler to replicate an actual datacenter setup with Top-of-Rack switches and a dedicated interconnect rack?
Alright, all I wanna know is power stats as a whole.
Im not sure I am ready to know the power stats as a whole
I wanna go and snip those fasteners so bad, shake a little the rack. Is it that difficult to make it like it is intended? having proper mounting rails. That is just lazy and insane... och it's insane already to have it in house. LEt plastic straps hold it toogether. I think Vecro wil work better. Reusable 🤣😋💖 Also what foot size are the cables? 🤣 (U said half a foot but not what shoe size 😊) All cables up to spec with all the guide rails up to fire code except plasstic holding it there and there 😋 not like is is going to combust in house.
Pretty neat just too much cable ties. I want to come and snip them all. Screws seem a better option for me. I would feel more secure.
Also this is crazy thing. I wish I could xchange my laptopo for that and get neighbour to pay my bill. 🤣
I like your methodical Labeling of cables.
There are reasons it went this direction. They may not be the best reasons, but they are reasons. I didnt have proper ears for the 6036 or the r210ii so they needed support. I also hate switch sag SO MUCH. In a combo problem solve moment of cheapness, I reused a md1000 rail kit for the base. I had planned to drill out all the screw holes but the the Dell rail front is crazy hard metal and I broke all the right drill bits trying. Plan B zip ties 😄 but I did know it was going to trigger some people. It's less insane as it's in the garage. Inside a house would for sure be noise you wouldn't want to live with.
May I ask why punch down over keystone patch panel?
Excellent Question. It's because it was free and I had it on hand. Keystone is much easier to manage
this is isane....i love it
Holy Smokes.... I just have SO Many questions.... some related to your mental state and others related to your marriage stability and many other questions of a "Why" based nature....
Marriage stability good, wifer is the camera lady. Mental state unclear, need more hardware to sort it out.
I have 1 server rack, still setting it up. I really would hate to have to pay your electric bill. Wow dual 50 amp circuits... dang..
My electric bill isnt that bad as I have 10c per KWh rate. Usually in the 250-325 range monthly depending on usage. If I need to run a lot of the quad socket servers, it can hit 800 pretty fast. Will be doing a whole video on the home datacenter and modernization things I have going on. Just started getting into AMD EPYC processors and can see them taking a much larger role in my home server setups
Hello. Since I don't know your channel, without watching a bunch of videos beforehand, I'm wondering, what do you need your own little data center in your basement for? At least it looks like the basement in the house to me.
looked like a garage to me......
Will have a homelab tour video out soon and explain that all. It is my garage but I use the mini DC for work, homelab, and then a part generates off storage some extra for me to cover electric bills and such.
why do i feal like thsi is rage bait?
so are you velcro or zip tie?
just like i though ,well done thank you
Have to ask, what the hell do you do with all that gear? Not going to lie, I am drooling.... Lemme guess you store all your Linux ISOs?? LOL
Why?
I move and process a bleepload of data for my job job. GIS visualization. Storing a portion of the US in detail is very very data intensive.
Just remember to swap out all the zip ties in 10 years from now lol
The switches will be changed up for sure before they hit the 10 year mark. My guess (or hopium, whatever) is I go 100g/25g this year.
I hate punch down! I also don't trust them! 2 years from now you could move something back there and pull on one of the wires just a little to hard and pull a wire out without knowing it. I have completely switched to keystone jacks on the front and the back of all my patch panels! All wires are terminated in RJ45 and plugged in where they need to be. This also has the benefit of ease of making changes in the future!
You need a CCNP just to setup your home network.. might be over doing it there
The good news is I'm consolidating to a sn2700 for the backbone. The bad news is I could for sure use a CCNP review. Seriously however I do think the 40gb option offers a lot of performance packed into (used) pricing that is really cheap right now. It also hits pcie3 speeds to near max. I should do a video on why I need really fast networking in the house sometime. My peak aggregate measured pushing real data was in the low 400gbit range for a few days sustained.
Great video, thanks. Don't take this the wrong way but has anyone ever tell you that your energy is equivalent to Richard Dreyfuss in the movie Close Encounters? I do secretly wait for a video of you shoveling dirt into your living room window while narrating proper stance and shovel grip. Of course you'll have a bath robe on and your children will be crying in the background, like in the movie. Just a thought. Have a good day Jared.
I do sculpt my mashed potato's now that you mention it 🤣
@@DigitalSpaceport I mean it in the most highest complementary way. BTW your setup looks really good. I respect a residential cable tray any day. Great job
I filmed this video in January so it already needs an update lol. That network cable management tray has a lot more CAT 1Gbit and Fiber 10Gbit in it now. Taken as the complement it was 😁
if only my office closet was deep enough for a server rack :(
Had a similar closet. Turned the server lengthways 😂
@@DigitalSpaceport I thought about it but it will kill the design I was going for so logically I decided to design my own thing. Thankfully my hardware needs aren't much so I can actually come up with a costume case concentrating on use of space and best cooling for all drives at lowest noise possible. For now is just a full tower PC case like a decade old and another matx case for the pfsense.
hang em vertical off the side wall
Digital why did you we need some serious networking, with the right tools and equipment and budget of course I can build the best network home lab ever.
It was fun! < always the best answer
I got a good laugh out of this. I thought I was the only one doing silly stuff like this. Mellanox + 2* 10Gbe + Epyc_Rome_or_Better + Nvidia + Sound Card = God_Mode_Homelab (really business...). What on god's earth are you using all this for? Voip services, Video editing, Stock market HPC stuff, or cluster farm - I just need to know. You can replace alot of that stuff with Epyc boxes and VMs.
I do have 2 EPYC systems that will be pulling up a lot of the weight moving forward. Im glad to find another adventurer of the arts of home datacentering haha. I use it for a lot of purposes. The massive quad sockets are for doing lightmass in Unreal (becoming less of a thing) and processing certain cpu types of datasets you find on huggingface (that site is crack, you are warned)
his wife : Honey, the electric company called, they wonder why we need to much electricity, is there something u wanna tell me........? " HAHAHA.
Punch Down Patch Panels dont make sense to me, never have... the RJ45 back panel connectors have the same spacing and you can just pull out and replace easily
punch down panels completely make that spot unusable if the cable goes dead
I had a label maker when i was a kid. I thought it was just so you can stick your name all over the place.
Insane is correct.
"and as you can see i have a gtx(rtx) 3080ti completly choked for airflow and is only saved by server grade fans and high airflow"... nice
That GPU cranks nearly 100% and stays mid 70s for hours on end. It's happy in there.
Yes, that is the exact reason servers have those fans... what's your point? The datacenter versions of Nvidia's GPUs don't even have fans and rely entirely on the cases airflow.
I see a punch down patch panel and immediately check how old the video is.
In the video you asked if the zip ties are upsetting me. Well the answer is hell yes! LMAO I'm not gonna lie it kinda triggered me BIG TIME! Get some cage nuts you wacko! All this money spent on gear and you cant buy cage nuts?!?!
There is a weird reason for things to have gone like this. Let me explain. I have tons of cage nuts, however I dont have rails for any of these switches. I HATE the saggie switch syndrome also but its even worse. I dont have proper ears for a few of these so they have to piggyback on top of the second switch. Solution was to reuse a rail pair from a long gone MD1000. However this presented issues as it has an incredibly drill bit resistant front plate. I broke all the proper sized drill bits I had trying to drill it out. I did get enough for the bottom switch to have the screws thread in properly. and the rails support it very well from the bottom. However I needed a plan B vs buy ears and wait for video, Zip Ties! I knew it was going to trigger folks so decided to turn it into a joke in the video (edits are not linear) However now that they are in there I am not sure I will spend the money on the ears. They really are held in place well.
Bros power bill is in the thousands
I dont even want to know what your KWh rate must be but at 10c KWh here I am around 450/mo for the house + garage DC.
💪🏾💪🏾
RIP your power bill
Really taking some liberties with "homelab" I feel. I guess if it's at home it counts? lol
You should checkout the folks homelabs on Servethehome forums. Make this look like child's play.
MR. I DON'T USE ZIP TIES FOR EVERYTHING lol lol lol
Im an evolving creature. 1 hook and loop at a time lol
Using heavy duty zip ties on a racetrack is not manly enough. You should use heavy duty welding)
My man!
Sweet..
appreciate the comment! Every comment matters 🫡
@@DigitalSpaceport Keep up the good work !