Techno Tim HomeLab Services Tour (Late 2022) - What am I Self-Hosting in my HomeLab?
ฝัง
- เผยแพร่เมื่อ 26 มิ.ย. 2024
- Wow, what a year of self-hosting! After showing off my Home Lab hardware in my late 2022 tour, many of you asked what services are self-hosted in this stack. This is always a moving target so I decided it was time to share which services I am running here at home. Today, we walk through everything I am hosting including: Dashboard, Hypervisor, Virtualization, Containerization, Network Attached Storage (NAS), DNS, Network Management, Home Security, Kubernetes, Kubernetes Storage, Docker, Reverse Proxy, Certificates, Monitoring, Logging, Syncing Data, File Sharing, Link Page, Link Shortening, Home Entertainment, Home Automation, Battery / UPS Monitoring, CMS, Static Site Generators, Dynamic DNS, CI/CD, Git Ops, Dev Ops, and many, many others. Enjoy the virtual tour!
Worth mentioning, I have videos on almost every service mentioned in this video!
Be sure to check out the 2022 HomeLab Hardware Tour!
• Techno Tim HomeLab Ser...
Video Notes: technotim.live/posts/homelab-...
📦Want to see all the gear in this video? 📦
Check out the kit here:
kit.co/TechnoTim/techno-tim-h...
Support me on Patreon: / technotim
Sponsor me on GitHub: github.com/sponsors/timothyst...
Subscribe on Twitch: / technotim
Become a TH-cam member: / @technotim
Merch Shop 🛍️: l.technotim.live/shop
Gear Recommendations: l.technotim.live/gear
Get Help in Our Discord Community: l.technotim.live/discord
2nd channel: / @technotimtalks
(Affiliate links may be included in this description. I may receive a small commission at no cost to you.)
00:00 - What is Techno Tim Self-Hosting?
01:05 - Dashboard
01:36 - Hypervisor
07:09 - Network Attached Storage
09:37 - DNS
11:48 - Network Management
13:05 - Home Security
13:42 - Containers (Kubernetes & Docker)
17:59 - -Kubernetes Storage
21:04 - Git Ops
22:35 - Reverse Proxy (Internal, External, and Ingress Controller)
25:26 - Monitoring
26:10 - Metrics & Data Visualization
27:02 - Logging
28:28 - Home Automation
30:08 - Data Synchronization
30:55 - Link Page (Contact Page)
31:41 - Link Shortener
32:24 - Home Entertainment
33:00 - UPS Battery Monitoring
33:37 - CMS (Content Management System)
34:25 - Websites (Static Sites & Custom Code)
34:46 - Dynamic DNS (External DNS)
35:16 - CI/CD (Continuous Integration & Continuous Delivery)
37:04 - Everything Else
37:41 - How do I get started self-hosting?
38:30 - Thanks for Watching!
#TechnoTim #HomeLab #SelfHosted
Thank you for watching! - วิทยาศาสตร์และเทคโนโลยี
What's one thing you are self-hosting in your homelab?
Media server! Plex, *arrs on TrueNAS Scale!
NAS, PiHole + DNS and a Nextcloud is all I need.
Heimdall now. Much appreciated!
Exchange 2019
A lot. 😋 7x Proxmox Virtual Enviroment, Proxmox Backup Server, NAS, 2x redundant Firewalls + ISC-DHCP servers, Navidrome, Homer Dashboard, 3x PiHole, Syncthing, NX Witness, UniFi Controller for APs, Azuracast, Authelia, Guacamole, Home Assistant, Homebox, JDownloader2, Mealie, Nginx Proxy Manager, Node-RED, Uptime Kuma, Portainer, Vaultwarden, ISPConfig + Postfix + Dovecot + Roundcube, ...
If you need any help with your pfsense project, let me know ;) And if you want, we can make a video about it together. 😀
Thanks Tom! Sounds awesome! You are the go to for pfSense!
This is the mash up we didn’t know we wanted but absolutely need to have. How about Tim in Detroit with Lawrence setting this up remotely?
Please make this happen
I am curious about the rack you have, I am looking for a rack that I can keep in my room, stays cool and is quiet. I live in Texas.
I know I for one would love to see Tom and Tim do a pfSense video. From basic installation knowing it's going to be a large server on the storinator, to setting up the z pools and VLANs.
Tim, We need more shots of Sally giving the viewers a window into how often your internet is down :)
I have found a great deal of inspiration from this video. Learning how others have set up their homelab helps me plan mine, learn about tools I did not know about or the reasoning for choosing said tools. This channel was a great find.
Glad I found it month ago and happy to be here!
Same here! I have a long list of services I want try out now haha
Same here! Very excited to get into homelabs after checking out these style of videos.
Fantastic rundown! You kept my undivided attention throughout. I was surprised when it was over and I looked at the clock to realize how long this video was. 👏for making it NOT feel long. Very informative and motivating. Happy New Year brother; be safe!
Thank you so much! Glad you like it! HNY to you too!
Your experience (and the oceans of blood sweat and tears!) working through all these elements both individually and collectively is absolutely priceless. Every time I watch one of these videos, I always get little nuggets of inspiration.
This time around - I'm really interested in Loki. I, too, have a foot in the grafana ecosystem and injecting logs would be preferable to something like Graylog, which I found very challenging. While there is value in historical logging - not to mention compliance standards that need to be met in enterprise contexts - having a bite sized log feed at the bottom of a grafana dashboard is super appealing.
Boss vid. The Little Link server is one of my favorites for my lab.
Today I also just paid for a proxmox subscription for my three node cluster at the office.
Thank you for introducing me to so many fantastic tools.
I don't know how you do it but YOU NAIL IT every time !! Keep going sir !! Rocking this !!
In this line of work, tbh this man’s rig is way more than enough for any home user and will be sufficient enough for small business if one hates cloud. Great work and very impressive to host and maintain everything by yourself. 😂 want the same gears but not dedicated enough, nice video! Thank you!
Tim, you give off the best vibes! Thank you for sharing! ❤
Wowzers! Nice run through sir. My head is spinning a bit, but also am excited for the continual improvement you demonstrate.
“Hey is the internet down?!” 😂
I can't describe how much this video inspired me. I just discovered this "HomeLab" concept, and realized how incredibly interesting it is. Thank you!
Thank you!!! Good luck and there’s a huge community around it!
Oh man, you are my absolute Tech-Hero !!!! Big THX for your awesome work! 🙏
Thank you!
This was a fantastic video, thanks! I use my homelab to prototype a lot of the stuff I need to deploy at work. I know it would be nicer to have a work lab, but I like the control I have with owning it all, and being able to tear it down and build it back up as needed.
This is an awesome recap. I figured I couldn't be the only person going overkill with their home setup 😂
I should do one of these videos too!
2 huge things you're doing here that I would love an explanation on are your keepalived DNS setup and how you handle primary vs secondary DNS and your graceful shutdown configuration and how that works. I've been struggling with my setup to do something similar. Not even done watching and awesome video as always!
Clearly I have a lot to learn. Just subscribed recently and really appreciate the great content and the low key delivery. Keep up the fantastic work. Now to learn more about Kubernetes…
I'm a simple sys eng / homelab enthusiast; I see a technotim vid I 'like' it. Nice tour Tim, practical setup.
Very impressive...and it's starting to jumpstart my creative juices for 2023! Thanks for sharing.
You can do it!
Very useful information! Thanks a lot, and happy New Year 2023
Keep up the good work, Nothing is overkill, In this lockdown i ended up watching your videos and discovering how many services i could be using and ended up with 2 proxmox hosts in cluster, Still watching your videos and deploying new services, I have around 9 docker hosts running varied services which i now want to move to kubernetes...onwards and upwards...
Excellent tour and explanation. Thanks Tim!
Longform was absolutely the right call! Well done, sir
Thank you!
Definitely recommend Home Assistant for the automation and Homekit as the UI to interact with!
So inspiring! Thanks for sharing! 🙏
Just like to say that was awesome Tim keep it up.
I have only one thing to say: as always You are an inspiration.
Thank you so much!
Nice vid, Tim.. you've helped my lab quite a bit. The traefik video itself is worth its weight in gold.
Thank you so much!
Thanks for sharing this video. Happy New Year 2023 🎊🍷🎈
I just moved my tower servers to a new rack and have been updating my infrastructure to be all based on Kubernetes.
I decided to go with a plain Ubuntu server for each of them (because I like having direct control over the bare metal) running a Rancher RKE2 cluster. (I host my Rancher cluster on a VPS for now.)
On top of this kubernetes cluster, I run some of my services as well as Harvester as a helm chart which I use for virtualization.
Thank you so much for helping convince me to move to a rack!
Great setup thanks for sharing
Thanks for sharing! Love this!
Thanks for the great video. I get so many ideas from you. Please keep up the good work.
This video is FAN-F'N-TASTIC .
I love what you are doing. As you go through the video, at times I am thinking "oh yeah, saw that vid, did it awesome!"
Other times (kuberneties) I think "I have no idea what he is talking about and he is on such a higher level than me" other times I think "where is the video on that, I want more"
Just after the 38:00 minute mark, you flash a clip of Terraria. That is my kids "JAM!" I have to pull him off that game. Nice . Moon Lord, maybe? He will be mad at me for not knowing. ☹️
Thanks! Keep it coming!
Would love to see more of how you setup CI/CD pipeline. Been using gitea for repos, and just set up jenkins, but not really buddies with jenkins. Github actions / similar on gitlab feels more like what I need. Anyway, thanks for your amazing content as always!
Awesome video. Like the setup👍🏻🙌🏻
Techno Tim in a nutshell! 😂 Awesome vid! Happy new year 😊🎉
Wow! Great Video! This was really inspiring!
Thank you!
Very useful video!
Thanks for the demo and info, awesome setup and config, Bravo! I also use my UDM Pro as my whole network backbone/management Have a great day
Thanks for mentioning the NUT Server, I was able to setup my CyberPower UPS, and monitor it using your videos, Awesome
Awesome!
I'll be back with my pen and pad..
Thank you for the ideas, I'm slowly building out my home lab and currently hosting a qbittorrent server for linux iso's with a nas, proxmox ve with a couple of vm's and attempted single gpu passthrough, lastly looking to setup a k8s/docker environment.
That's beautiful.
Thanks Tim, always happy to pick up some tips (and from a fellow Minnesotan no less!). Love your Loki Grafana Dashboards, wouldn't mind seeing a video revolving around that!
BTW instead of HomeAssistant I use MQTT as the "backbone" for all non-HomeKit devices, and NodeRed for custom automations and passing data into InfluxDB. Then you can use Grafana to do HA dashboards. Homebridge happily connects between MQTT and HomeKit. Homebridge also can connect Unifi Protect into HomeKit, and I use people detection as trigger in HomeKit. (Alternatively some folks use Scrypted to connect the cameras to HomeKit).
Great work Techno Tim, nice to see a new perspective on home labs. With recent security breaches any plans on doing something with something like Vaultwarden on docker kubernetes rancher for local password security.
Hey Tim! Love your homelab content. Would love to see an Argo video!
Thanks!
what a great video
Thank you!
Tim, you seem to be addicted to running hypervisors lol, I vote leave the storinator a dedicated NAS, you've got plenty of other Proxmoxx nodes
Honestly? aweome video Happy New Year
I seen this video come out and i waited to watch it so i could enjoy it and take everything in.
Questions from video
Benefits of HA services vs HA hypervisors?
I am looking forward to seeing where all your though process go in the future and i think i am going to have to go back and look at your previous services video to see what has changed from that one
nice video thanks
Good video.
Hi, Tim love your videos.
Please do a video on automatically storing Proxmox Backups to any cloud provider.
I got a lil excited when you mentioned Quasar was a DNS VM or container. Was hoping you might be running some else along with using PiHole. Interesting enough though!
Amazing
Hi @TechnoTim, love your videos, great job as always!
Quick one if I may, from your video, I seem to gather that your hosts run Proxmox on a single SSD (aka, one disk per OS, no redundancy).
Is it just me misunderstanding it, or do you actually run it like so? If that's the case, how do you deal with a possible disk failure, and your whole Hypervisor going down?
Cheers :)
Hello Tim, Thank you for your excellent videos. I believe the most crucial question for anyone just starting to deploy their own infrastructure is if you had to start deploying all of your lab services from scratch, in what sequence will you do so? Thanks!
So cool. I gotta work on a router and ZFS storage next.
Hi, Tim. Awesome content. I think you are that type of guy who everyone wants to be friend with. You told us about your homelab, but what about your home office? What PC, monitors, OS, etc are you using? What type of job are you doing and which of your homelab skills help with it?
Thank you! I talk about this quite a bit on my live stream! Hop in sometime!
I'm about to build my own home lab, from stratch... This video was inspiring, overvelming and a tiny bit comfusing. I have a lot to learn.. :/ I have UDM se, Aruba switch + bulding a server, for TrueNAS, PiHole, Plex and Home assistant. Server rack is going on the wall shortly :P
You can do it!
great vid, watched 1/3 for now but already can say 100% thanks for sharing this! I'm setting up my personal homelab (1 vertical server + network stuff + ups) and have some questions re storage. will probably have more once I finish watching :)
1. your worker nodes are more or less similar and equipped with 4x1tb SSDs. I assume they are enterprise or prosumer class NVMEs and you run them in ZFS parallel mirrors. my research shows that ZFS is kind of slow with NVMEs (especially IOPS), even without parity. have you thought abt going in hyperconverged style with some parallel (cluster) filesystem? I am personally searching for something like weka-fs but free for my local NVMEs, and have no luck yet. I have only 1 server so all my storage is local, so any good SPDK-enabled FS will work - would love to get any advice here.
2. you mention you run TrueNAS as a linux VM under Proxmox. probably stupid question: what are the downsides of linux TrueNAS vs BSD TrueNas? for example, I heard linux version lacks command-line tools needed to troubleshoot broken / problematic ZFS, i.e. BSD wins when something goes wrong. But I don't know much about TrueNAS so maybe they mitigate it with their tools or UI.
@TechnoTim - you said you use Rancher effectively as dashboard for your downstream k3s clusters. Do you deploy Rancher also to a HA cluster as per your ansible/k3s playbook? Thanks for the amazing content!
i just have watched this entire video and have no idea what all of this even is. the only concepts i know from this entire video was DNS, a NAS and time machine lol I am so intrigued to learn what all this is to i can understand wtf your talking about and why ur using it. lol cheers
Check out my video on "what is a homelab" ?
Ladies and Gentleman, this is what we call actual 10x developer
I'm really fascinated by your wall-mounting solution. Could you explain in more detail how you mounted your devices on it, please? Especially the Raspberry devices would be interesting to me.
Nice, Tim! How much power are you using ?
plex and home-assistant!
Dude you need to try Dashy. It is absolutely fantastic. Heimdall doesn't have enough spatial customization for me.
By the way, I just did that yesterday: You probably know this already, but before you update to Kubernetes 1.25, make sure you update Longhorn to 1.4.0 first, because that release gets rid of PSPs in favor of PSAs which are the default in Kubernetes 1.25 now. Can confirm it works without a hintch.
Oh ... please make a series on the CI/CD. Perhaps with an easier service, like the LinkPage app or some ReactJS app on your local gitlab ... would be so awesome.
You should do a video on the essentials for homelab, an intermediate video, and an expert video
Hey, I like the wallpaper youŕe using for Heimdall, where can I find similar ones? Does this type of artwork has a name? Thanks for all your content, really interesting!
This is my first TH-cam Video in 2023 - best Choice beside Shrek Videos :)
I just love you content.
Personally I'm more on the hardware/networking side as opposed to the software/code, but I really like that you incorporate both.
Sometimes, when I'm working on some stuff on my homelab, in my head I'm writing a script as if I'm going to make a video about how I've acomplished this and that... Although it very much helps me remember later on how I've solved things, I can't bring myself to actually make a video. Too much work, and I don't have the time. Or at lesat that is what I tell myself. Seeing you videos and learning that you have a job a aside from making videos, and taking into consideration how complex your lab is, just makes me appreciate your content even more.
I was pretty sure I was subscribed, but I discovered I wasn't? I guess I didn't have to sub as TH-cam simply pushed your videos my way according you my interests, often enough for me not to have to sub. Regardless, I amended that and slapped the button.
Keep up the good work, many-a-geek have to thank you for doing this tedious solid favor for us.
Really wanting to get Shlink up and running! I attempted it a while back but hit some issues for some reason. Time to try again! Do you happen to have a video on shlink?
Impressive!
I am wondering how much power kw/h does this system consume, could you please share some figures?
Can you please make videos on CI/CD and how do deploy any of your new docker images
Hi Tim, very good job, you have a fantastic home network. But I have a question. Instead of using grafana why you don't use elastic? I open source and they have a most component for increase yours internal security.
Little late here but Lumia (stream elements alternative) hooks into IOT devices and you can directly connect alerts to lights /home assistant. Sounds right up your alley if you aren’t using it already.
Nice! I write the code myself but I will check it out! Also, you're never late!
Maybe it's outside the scope of this channel, but a video on GitLab and how you use it would be cool
Could you do a tutorial on setting up TimeMachine on TrueNAS? I've never been able to get TimeMachine to work reliably over the network. Thanks!
i use democratic-csi as storage class for my kubernetes (truenas scale has storage). it works great i can dynamically create and delete pvc
Also do you have a go-to setup for deploying serverless functions locally? Just deploying to containers?
Not sure if you are taking request for 2023, but I would love to see a series done. setting up the bare metal with Proxmox (or preferably an HCI like harvester) repeat (replay) 1,2,3 times to get to HA, then installing Rancher either via docker or in Helm for HA. Then installing Traefik. I know you have videos on this but a series of videos each that come in order I think would paint a clearer picture (plus Rancher has changed a lot). Heck even add the gitops for each step in the video. (not sure if you can IaC the hypervisor itself? iDRAC maybe?
Thank you! I do have plans for a series but a slightly different architecture! Stay tuned!
I am looking to move several docker image deployments over to kubernetes as you did to get on one system as well. Do you have a video or guide for translating a docker image + settings (env vars, volumes, etc.) to kubernetes config files or another tool/process? In fact I was looking specifically at heimdall as one of the first to move. Thanks for the videos!
Curious to know your toughts on using caddy instead of traefik. Apparently the syntax is cleaner and probably litgher to run as well.
Tim! Can you please do a video on CI/CD pipeline implementation for self hosted use?
There are several programs out there like Drone, Agola, or Woodpecker that I've seen which can be self-hosted.
Also, if you still want to use GitHub actions, you can use the program Act to run GitHub actions (with most necessary compatibility) locally.
@@filiecs3 I was thinking basics.. What is CI/CD? Why do you need it? His use case for CI/CD and what he uses for his runner. I guess I wasn't clear on what could be taught. I like the way Tim lays everything out foundationally and the documentation he provides. I'll def look into those programs you mentioned as well as Github actions.
Tim, just taking the time to say thanks for your videos,
this is my second one, and the clarity of your explanations,
helped me connect tons of knowledge i have studied for a year.
Thanks alot for sharing and making it easy to digest,
rather than making it super complicated just to sound like a pro.
God Bless
Thank you so much!
This is great stuff, right up until I try to figure out how it would make my own life better if I did some of it. Meaning that I have things like QNAP NAS devices for backups and my Plex server and I SnapSync those backups. Other than that I simply don’t need to run a lot of services or load balance anything. The most I can think of would be pihole and something to run VMs to test Linux distros before installing on bare metal if desired.
Hey Amazing Video!. How would one go about setting up a self hosted kubeanettes cluster when you're stuck behind a NAT'ed netowrk. i have been using Tailscale then expossed my docker containers through Nginx Proxy Manager. but would love to be able to use k3s instead of docker/docker compose
How high is your power bill??? LOL very impressive setup.
2 minutes into the video. I gotta say it's amazing to be on the same page with someone in tech for once.
I've been wanting to create a video for my job titled, "Is High Availability Wrong For You?" I have been working IT for 20+ years at this point. I have seen a lot of HA implementations, and very, very few of them actually achieve HA. Achieving HA at the hardware level is for the major cloud and SaaS providers. For most people, focusing on time and ease of recovery will require far fewer dollars when all is said and done, and they'll actually have a chance at achieving their availability goals. Availability goals being one of those things people, quite oddly, never think about when shelling out tens of thousands of dollars for an HA setup.
Anyway. The other thing I wanted to mention was that you have Proxmox in a clustered setup. Watch out for this. If you haven't run in to it yet, there's an issue where if you don't have enough Proxmox machines to achieve quorum, you can't even start VMs. There are ways to get around it in the short term, but for the long term, the only way I've found of fixing the problem is to nuke and pave.
And that's not a criticism of Proxmox. All software has its warts. Personally I would gladly deal with the few, minor irritations that Proxmox gives me, rather than ever go back to VMWare.
Oh, about 6 minutes in. You're waffling about TrueNAS on the bare metal vs using Proxmox on your Storinator. I have 2x 60 bay Storinators at work. I made the decision to run TrueNAS on them since they were primarily going to be file servers.
WORST. DECISION. EVER.
I am like 6 different kinds of done with TrueNAS. TrueNAS is to ZFS what Cpanel is to Linux servers. It just makes shit 10x harder than it really needs to be. And it's buggy as fuck. Like, not OS breaking buggy, but they finally added pull replication, and as far as I can tell, they just haven't tested that feature at all. Because while you can pull snapshots, NOTHING about auto managing those snapshots on the receiving side seems to work. Virtualize TrueNAS, and call it a day.
If I could go back and install Proxmox on those systems, I would. Really the only thing TrueNAS is good for at this point is easily configuring CIFS shares. And honestly, people should just stop using CIFS. NTLMv2 tokens are awful, and Kerberos tickets aren't a whole lot better. SFTP everything you need, and call it a day.
I just pulled pfSense (Netgate 4100) back into my setup. Unifi firewall isn't great but is nice if you like zero-touch. What's your take on ditching Proxmox for Harvester? I might use a new (refurbished) r620 to see how far I can push it.
That "Hey is the internet down?" interjection just triggered some flashbacks.
I have seen you use ansible to provision Kubernetes. Do you use IaC also for proxmox with ansible or terraform. I personally use Ansible to configure all my Linux VMs and manage Docker Container and/or Docker Swarm Services. And Terraform to manage VMs at my XCP-NG cluster, all my domains manged at cloudflare and as Backup my Grafana dashboards. And I run my playbooks regularly with a cron job in drone.
Interesting that you went the "easy" way with home security (unifi) rather than going frigate and double-take ;)
I'd love to see you try to migrate to openstack. That would be badass.
One of my disappointment of ProXmox is I can't get the TEMPERATURE monitoring.
I know, I'm lazy, maybe I'm not trying to dig it deep enough.
But, overall, I'm impressed and satisfied with ProXmox. It's free, it has fast and simple installation, it has a simple intuitive GUI to me, and it works. I have an Intel 2th gen server as host, it's been running for more than a year now.
Links to the Blogs in the CMS example? Would like to see the ghost portfolio and share with a friend. The tech blog might also be a fun read.