i started with an old gaming laptop and an hp elite desktop that i put proxmox on. now i have a 28U rack with a dell r730 with proxmox for dns and home autmation , a SuperServer 6028U-TR4T+ with 192gb ram for proxmox with unraid (had pfsense but moved it) speaking of pfsense thats on an old sophos utm220 that i put 8gb ram and a quad core cpu in from the orginal dual core with 2gb ram... plus my gaming pc and a battery backup. with my omada POE switch for the access points and thats all in a yr?? once that ball rolls it ROLLS! also slight side effect is getting a package and your wife asking what you ordered this time lol my 8 month old liked the pretty lights from my gaming pc (yes i left the MEGA GAMER RGB cause why not lol ) anyway it grows fast lol
Awesome video! I've been a network engineer for 25 years and I've always said, "keep the ACL's to a minimum ... let the switches switch, routers route and firewalls firewall". Obviously you'll need some ACLs on layer 3 switches and routing on some firewalls but these functions should be thoughtfully implemented as to not overburden your network devices. It was good to hear you say what you said about ACLs.
I don't know how but this is exactly the homelab your I needed to get my head straight about how I should organize network topology for homelab. Your mention and reasoning of the layer 2 VLAN is a subtle nuance that's really easily missed for non networking focused people. 10/10. I don't know if you script your videos but us stats nerds would love to peer into your power usage and what not on the hardware you're using. Lots of us that are looking to buy the Broadwell power edge would like to know the month to month power consumption of something full of spinning mech drives and a nvme performance king. If it's too boring to post on video we would love just a link with a written form with some pics to please the algorithm.
Twinax as in IBM Type 1A cabling Twinax?? I had no idea that was still a thing. When I worked at Mod-Tap back in the 80s that was a thing for converting onto UTP cabling. There was also WangNet which used dual coax to which we had dual-coax baluns for but this shook me to my core the mention of Twinax.
It’s easy to get started by installing Proxmox or ESXi on an old PC. You can build at your own speed from there. It just depends what you want from a home lab. Everyone is different.
Also team 42U homelab here. I use it pretty much for the same services. Difference are, I orchestrate everything with ansible and terraform and docker host is a k8s cluster. Apart from APs I don’t use Ubiquiti but enterprise used gear only (Aruba, Arista, HPE ….) I found it was around the same prices and closer to what I use at work. But as said homelab is not about the hardware but what you are doing with it and if you enjoy it. To bad the team “low power” tends to judge all big setup and talk NUC all the time…
Do you have a tutorial on setting up your logical network for security? I am a complete novice to homelabs and the only thing holding me back is my fear of exposing everything to hackers.
You don't need enterprise hardware for a home lab esp over kill hardware for a single person. I built an ESXi server out of regular Desktop PC hardware and moved it into a 4U Server Chassis with ICY Dock swap bays. It only idles around 55Watts currently running 15 VMs. I have another 4U box for my True NAS storage.
great video. great Homelab setup. I have similar setup at home, but not as clean as you have ;) I am also using vCenter, several ESXi hosts, Mikrotik routers and switches, APs + Zyxel switches.. What I am little bit missing as I am "more" technical person are details about VM's configuration like cpu, ram, disk.. Thank you for the video. Great job.
Cool to see your setup. I'd say only thing is some things related to performance could be improved from your routing to your monitoring stuff using TIG. Maybe try some HA setup with your services? I use a HA K3S (Kubernetes) cluster for most of my mission-critical workloads personally and when possible.
Is a homelab suitable and safe for small companies hosting their own Odoo servers? Odoo is an open-source ERP where I can host my own ecommerce site and accounting system etc.
My ISP hands off my 2Gbps Internet as Ethernet. So I bring it into the Ent 24p, tag it as an internet-only VLAN, and then it's in my network. From that point I hand it off from the Pro Agg to the FW as a 10Gbps DAC connection. The reason I don't go direct into the FW using an SFP+ to Ethernet transceiver is because past experience has taught me that Ethernet transceivers can be a bit temperamental, and bringing it into my network means I could (if I wanted to) expose the Internet to a VM if I ever wanted to test or go back to a VM firewall.
I have to ask, is there some reason the switches and patch panels are in the front? After some thinking about it my guess was just ease of use and/or the back of the rack is less easy access but I've noticed this with a lot of homelab setups but don't think I've ever seen it in a datacenter (not counting racks that are all networking equipment) so it made me curious. I'm more a hardware guy than a networking guy but I've picked up enough over the years to know the networking setup on this is as nice as the hardware/software setup, nice tour.
Yes, there are reasons in my case! When you mount network switches in cabinets in a top of rack scenario, you have to take into account how the switch cools itself. Everything in my cabinet is setup to cool itself front to back, meaning the cool-side of my rack is the front of the cabinet, and the fans exhaust out the back. My switches are passively cooled, but many higher-end switches have active cooling (fans) to keep the ASICs inside cool while they do their work. When you buy switches for a specific application, you have to take into account the cooling concept for your server gear. If you put a switch in the front, you need make sure the fans in the switch pull air in from the front (cold side) and exhaust out the back to the (hot side). If you're mounting a switch in the back of your cabinet, you want to make sure the fans in your switch run in reverse to pull from the backside of the switch and exhaust out the front which is facing the rear of the cabinet. HTH!
The short answer is because I don't have the need for HA at home and for proper HA I'd need 3 public IP addresses (and I only get 2 from my ISP.) In terms of remote access, I was a big fan of OpenVPN, but recently I've been experimenting with Tailscale and I'm _kinda_ in love with it. There's a tailscale package for pfSense so I have it installed once and all my remote tailscale clients can get to anything in my network.
Like always thanks for a great video. I noticed you are running esxi/vmware ver 8. I have dual SuperMicro server with X9DRF-HF motherboard and running in compatibility issues even with esxi version 7. Do you have any advice?
Great question! At this time I'm thinking about rolling back to CE - I don't feel like the yearly cost is worth the product's features. If that price were _half_ what they're charging, I'd genuinely consider it.
@@2GuysTek just bought a house last year and will start placing Ethernet cable soon but have never set up a from start to finish network. Will have a literal home lab room but will be doing runs to every room. Thanks for the advice!
ESXi is free for a single host, so you can start using it now without having to spend a dime. VMUG Advantage allows me to get all of the enterprise licensing so I can do the really cool things like clustering, fault tolerance, and high availability.
This guy is on another level. I'm over here with my 2bay Synology nas and a PFSense fire wall thinking I'm all that lol.
Hey now, your homelab is just as great if it's serving your needs!
couldn't agree more @@2GuysTek
This is exactly how it starts 🤠🚀🎯. Just keep learning.
i started with an old gaming laptop and an hp elite desktop that i put proxmox on. now i have a 28U rack with a dell r730 with proxmox for dns and home autmation , a SuperServer 6028U-TR4T+ with 192gb ram for proxmox with unraid (had pfsense but moved it) speaking of pfsense thats on an old sophos utm220 that i put 8gb ram and a quad core cpu in from the orginal dual core with 2gb ram... plus my gaming pc and a battery backup. with my omada POE switch for the access points and thats all in a yr?? once that ball rolls it ROLLS! also slight side effect is getting a package and your wife asking what you ordered this time lol my 8 month old liked the pretty lights from my gaming pc (yes i left the MEGA GAMER RGB cause why not lol ) anyway it grows fast lol
Awesome video! I've been a network engineer for 25 years and I've always said, "keep the ACL's to a minimum ... let the switches switch, routers route and firewalls firewall". Obviously you'll need some ACLs on layer 3 switches and routing on some firewalls but these functions should be thoughtfully implemented as to not overburden your network devices. It was good to hear you say what you said about ACLs.
Yep, and use microscope instead of hammer for nailing 😁
I've gone from a full 42u rack of power hungry devices to a couple NUC's. So happy I made the switch. Looks great and happy its working for you.
I took the same journey, 100+ core monster pizza boxes. Now down to a 3 Intel NUC proxmox cluster now. It's all I need.
Excellent video, well presented!
You've just got yourself another subscriber Sir . I'm going to be taking my CCNA soon and I love watching videos like this.
Makes me nostalgic for my time working in a data center
Dont currently run a homelab but man do I enjoy watching a welll explained breakdown of there set ups. Well done .
Superb explanation and very entertaining. Impressive video!!!
This is the stand.
I haven't seen anything like this live in the last 10 years.
Looking clean ! Mines a huge mess because i keep adding / removing and testing and learning, oh wait, thats the whole purpose of the home lab !!
I don't know how but this is exactly the homelab your I needed to get my head straight about how I should organize network topology for homelab. Your mention and reasoning of the layer 2 VLAN is a subtle nuance that's really easily missed for non networking focused people. 10/10.
I don't know if you script your videos but us stats nerds would love to peer into your power usage and what not on the hardware you're using. Lots of us that are looking to buy the Broadwell power edge would like to know the month to month power consumption of something full of spinning mech drives and a nvme performance king.
If it's too boring to post on video we would love just a link with a written form with some pics to please the algorithm.
Really Great Home Lap 👌🏻
I respect home labbers. I have a large lab at work so i stay minimal at home. My 12TB freebsd server is enough for me.
Must be nice. I'd love to have my system up and running, but not having a home stops that. Anyway, I'm glad he got what he has. It's nice.
Well that was a lot more than I thought it would be. I didn't know what half that stuff is. Feel free to make a dedicated video on everything lol!
Was there anything in particular you'd like to see more info on?
Twinax as in IBM Type 1A cabling Twinax?? I had no idea that was still a thing. When I worked at Mod-Tap back in the 80s that was a thing for converting onto UTP cabling. There was also WangNet which used dual coax to which we had dual-coax baluns for but this shook me to my core the mention of Twinax.
Amazing video! You guys are the best! Cannot stop recommending you guys enough! Keep up the awesome work and content!
I have been thinking about a home lab for a very long time, but there’s a lot of stuff you need for that. Not just for the server
It’s easy to get started by installing Proxmox or ESXi on an old PC. You can build at your own speed from there. It just depends what you want from a home lab. Everyone is different.
Also team 42U homelab here.
I use it pretty much for the same services.
Difference are, I orchestrate everything with ansible and terraform and docker host is a k8s cluster.
Apart from APs I don’t use Ubiquiti but enterprise used gear only (Aruba, Arista, HPE ….) I found it was around the same prices and closer to what I use at work.
But as said homelab is not about the hardware but what you are doing with it and if you enjoy it. To bad the team “low power” tends to judge all big setup and talk NUC all the time…
GO TEAM 42U! Thanks for sharing!
Do you have a tutorial on setting up your logical network for security? I am a complete novice to homelabs and the only thing holding me back is my fear of exposing everything to hackers.
This is something we could do!
You don't need enterprise hardware for a home lab esp over kill hardware for a single person. I built an ESXi server out of regular Desktop PC hardware and moved it into a 4U Server Chassis with ICY Dock swap bays. It only idles around 55Watts currently running 15 VMs. I have another 4U box for my True NAS storage.
Im gonna copy this
great video. great Homelab setup. I have similar setup at home, but not as clean as you have ;) I am also using vCenter, several ESXi hosts, Mikrotik routers and switches, APs + Zyxel switches.. What I am little bit missing as I am "more" technical person are details about VM's configuration like cpu, ram, disk.. Thank you for the video. Great job.
Sounds like a good idea for a follow-up video!
Cool to see your setup. I'd say only thing is some things related to performance could be improved from your routing to your monitoring stuff using TIG. Maybe try some HA setup with your services? I use a HA K3S (Kubernetes) cluster for most of my mission-critical workloads personally and when possible.
I've my self a Supermicro cse826 (modded with Ryzen and my playground, since normally you would not get a BGP session there for announcing my own asn.
better than in my job
Why don't you use a unifi firewall?
I also use Pfsense and was just wondering why you never change.
Is a homelab suitable and safe for small companies hosting their own Odoo servers? Odoo is an open-source ERP where I can host my own ecommerce site and accounting system etc.
Video on self hosting Wordpress securely! Please please please 🙏
Thank you, excellent video. Any chance I could request a how to/setup video regarding your "Monitoring VM" (AKA TIG Stack)? Please 🙏🙏🙏
Great suggestion!
Sounds like my network, except I have a 40gbps switch, 10gbps access switch and 10gb next gen firewall. Cone see @ the FB page Extreme Home Networks
a lot of computing power for a handful of VMs, what else are you doing ? :)
Great video, quick question ..where does your red internet cable connect to? the one leaving your unifi usw ent 24p switch.
My ISP hands off my 2Gbps Internet as Ethernet. So I bring it into the Ent 24p, tag it as an internet-only VLAN, and then it's in my network. From that point I hand it off from the Pro Agg to the FW as a 10Gbps DAC connection. The reason I don't go direct into the FW using an SFP+ to Ethernet transceiver is because past experience has taught me that Ethernet transceivers can be a bit temperamental, and bringing it into my network means I could (if I wanted to) expose the Internet to a VM if I ever wanted to test or go back to a VM firewall.
I have to ask, is there some reason the switches and patch panels are in the front? After some thinking about it my guess was just ease of use and/or the back of the rack is less easy access but I've noticed this with a lot of homelab setups but don't think I've ever seen it in a datacenter (not counting racks that are all networking equipment) so it made me curious.
I'm more a hardware guy than a networking guy but I've picked up enough over the years to know the networking setup on this is as nice as the hardware/software setup, nice tour.
Yes, there are reasons in my case! When you mount network switches in cabinets in a top of rack scenario, you have to take into account how the switch cools itself. Everything in my cabinet is setup to cool itself front to back, meaning the cool-side of my rack is the front of the cabinet, and the fans exhaust out the back. My switches are passively cooled, but many higher-end switches have active cooling (fans) to keep the ASICs inside cool while they do their work. When you buy switches for a specific application, you have to take into account the cooling concept for your server gear. If you put a switch in the front, you need make sure the fans in the switch pull air in from the front (cold side) and exhaust out the back to the (hot side). If you're mounting a switch in the back of your cabinet, you want to make sure the fans in your switch run in reverse to pull from the backside of the switch and exhaust out the front which is facing the rear of the cabinet. HTH!
@@2GuysTekGotcha, thanks for the response.
Electricity bill ?
The whole stack adds around ~$70/mo to my electric bill, which is not for the faint of heart but pretty affordable for a passion/obsession.
Just wondering why you don't run a second pfsense in ha mode? And what you doing for remote access when your away from home?
The short answer is because I don't have the need for HA at home and for proper HA I'd need 3 public IP addresses (and I only get 2 from my ISP.) In terms of remote access, I was a big fan of OpenVPN, but recently I've been experimenting with Tailscale and I'm _kinda_ in love with it. There's a tailscale package for pfSense so I have it installed once and all my remote tailscale clients can get to anything in my network.
What's the power consumption on that setup?
Which Transmission container do you use? I love rhe interface vs. what I have running here.
I’m using an alternative UI for Transmission called Flood.
so much power draw O.o
😂
How much watts this consumes?
How does that little UPS run your rack for 60 minutes?
2200VA@50% load. Depending on what's going on, it's 45-60 minutes of runtime.
... and here my pool is taz...
Like always thanks for a great video.
I noticed you are running esxi/vmware ver 8.
I have dual SuperMicro server with X9DRF-HF motherboard and running in compatibility issues even with esxi version 7.
Do you have any advice?
What issues are you experiencing? Don't hesitate to jump on our Discord and share your experiences there and maybe we can help!
@@2GuysTekThe lsi 2008 controller is not supported from ESXi ver 7. I can install ESXi on SATA-DOM but no additional disk will be showen.
Are you planning to pay for TAC lite pfsense license with the recent licensing changes?
Great question! At this time I'm thinking about rolling back to CE - I don't feel like the yearly cost is worth the product's features. If that price were _half_ what they're charging, I'd genuinely consider it.
For… Linux ISOs 😏
What do you think of the Omada system?
I prefer Ubiquiti and UniFi over TP-Link and Omanda.
@@2GuysTek just bought a house last year and will start placing Ethernet cable soon but have never set up a from start to finish network. Will have a literal home lab room but will be doing runs to every room. Thanks for the advice!
@socwatchman join our discord and share your progress with us!
If you are stil looking for a good home for that server node. Look no further, for I am here.
How loud the UPS is?
The UPS is silent.
How come there are only 6 likes???
you pay licence costs for esxi?! holy shit u have to be rich
ESXi is free for a single host, so you can start using it now without having to spend a dime. VMUG Advantage allows me to get all of the enterprise licensing so I can do the really cool things like clustering, fault tolerance, and high availability.
That's pretty nice. Not quite on my level though. I have a mini pc plugged directly into my router. That's it 😎
If it suits your needs, then it’s perfect!
Nice video! Can you walk us through how you built your 10gb networking accross your nodes? Did you use a switch or direct attachment.
All nodes connect directly to the 10G switch as trunk ports with multiple VLANs.