What's On My Home Server? Storage, OS, Media, Provisioning, Automation
ฝัง
- เผยแพร่เมื่อ 2 มิ.ย. 2024
- - What applications do I run on my home server?
- What OS am I using?
- How do I automate deploying and provisioning?
- How do I secure my services from unauthorized access?
...and many other questions, answered in this video 😊
Links:
My Ansible Playbook: github.com/notthebee/infra
My Ubuntu Autoinstall Role: github.com/notthebee/ansible-...
"Ansible for Devops" by Jeff Geerling: www.ansiblefordevops.com/
"Ansible 101" Series by Jeff Geerling: • Ansible 101 - Episode ...
Awesome Selfhosted Github: github.com/awesome-selfhosted...
Follow me:
Twitter / notthebeeee
GitHub github.com/notthebee
Twitch twitch.com/notthebeee
Support the channel:
Patreon / wolfgangschannel
PayPal (one time donation) www.paypal.com/donate/?hosted...
Music:
Jalowo - Luminism (ft. Yonderling)
Hale - Moment
Tru Genesis - Burned
King Pong - Game Recognize
Videos are edited with Davinci Resolve Studio. I use Affinity Photo for thumbnails and Ableton Live for audio editing.
Video gear:
Camera geni.us/K8OOyKV (Amazon)
Main lens geni.us/jnnElY4 (Amazon)
Microphone geni.us/tgiSqL (Amazon)
Key light geni.us/Gi1zE2 (Amazon)
Softbox geni.us/F86pM (Amazon)
Secondary light geni.us/aciv (Amazon)
Other stuff that I use:
Monitor geni.us/KUzcmcP (Amazon)
Monitor arm geni.us/5RXu (Amazon)
Laptop stand geni.us/X5vx9Af (Amazon)
Keyboard www.amazon.de/HHKB-PD-KB401W-...
Mouse geni.us/KB7h (Amazon)
Audio interface geni.us/sdhWsC (Amazon)
As an Amazon Associate, I earn from qualifying purchases
Timestamps:
00:00 Intro
00:29 The dashboard and media applications
02:21 Nextcloud
03:20 PhotoPrism
04:15 Bitwarden/Vaultwarden
05:30 System applications
06:35 PiKVM
07:48 PiHole & Unbound
09:07 Home Automation
11:36 Other stuff
12:15 The OS
13:05 Storage and filesystems
14:38 Security
16:57 Dynamic DNS
17:59 Provisioning and deploying
19:09 IaC (Infrastracture as Code)
20:00 Why not just use shell scripts?
22:14 Ansible playbook walkthrough
23:50 Yeeting my bootdrive and reinstalling from scratch
25:48 Thoughts and considerations
26:38 Special thanks and outro - วิทยาศาสตร์และเทคโนโลยี
Links in order of appearance:
Homer github.com/bastienwirtz/homer
My custom CSS for Homer github.com/notthebee/infra/blob/ca87f0daf211919ff19ce678523f48f2a6d25ed7/roles/homer/files/custom.css
Nord colors for Homer pastebin.com/AH9NWmSL
Jellyfin github.com/linuxserver/docker-jellyfin
arch-delugevpn github.com/binhex/arch-delugevpn
Radarr hub.docker.com/r/linuxserver/radarr
Sonarr hub.docker.com/r/linuxserver/sonarr
OpenBooks github.com/evan-buss/openbooks
Nextcloud hub.docker.com/_/nextcloud
PhotoPrism hub.docker.com/r/photoprism/photoprism
Vaultwarden github.com/dani-garcia/vaultwarden
UniFi Controller hub.docker.com/r/linuxserver/unifi-controller
Jackett hub.docker.com/r/linuxserver/jackett
PiKVM github.com/pikvm/pikvm
PiHole + Unbound github.com/chriscrowe/docker-pihole-unbound
Deconz github.com/deconz-community/deconz-docker
Home Assistant hub.docker.com/r/linuxserver/homeassistant
Do you maybe have a link for the nextcloud image? Looks damn nice!
@Mrbarb Sure thing i.imgur.com/4Pp7dRg.jpg
Pin this comment !
Great work! Is ansible needed if most of you stuff is in dockers anyway? Should this not make you environments be hw independent already as long those are backed up or in some version control? Also does anyone know if ansibel can be used on a running system, like detecting current config for later deployment?
Hi great video and v similar apps/setup to mine. I've just installed the homer portal and downloaded your custom css file. As this is configured via yaml, please could you tell me where the css file needs to be saved and if it needs to be linked in the config yaml? Thanks
You have so much legally obtained content. You're an example to the community.
💀
I just want to let my FBI agent know that I am legally watching this video from my legally purchased device that is connected to a legally purchased network connection that only transmits legal things.
DEFINITELY do a Step by Step.
I'm just getting into server stuff and would love to learn from you mate.
totaly agree
@@juliantorres957 I think you can follow the ansible portion and spin up a clone of his setup. I believe. I am new as well lol
juniper certs have topics on certs
Step by step would be really useful!
Each and every time you used the phrase, "...you already know..." I actually hadn't a clue. I too am eager to build my home server as my IoT is getting out of hand.
The amount of work put in this video and in the setup itself flies through the roof. I got really inspired to lift up my tiny Raspberry pi server to something much greater!
I love how much information is in this video without over doing it on any one topic. Tips, why you chose it, how you use it, and clear explanation of what it does and it’s application. Definitely saving this video to refer back to. Thank you!
Thanks for making this! I'm making a home server for my family to use for plex and a google drive alternative. Your vids are in-depth yet digestible and you know how to edit so what you're looking at is clean and interesting. Thanks for all that you do
I've been debating learning Ansible for a while. Recently got my DCV-VCP 2021 and I kinda of want to learn Ansible + Vagrant to see what all cool stuff can be done. Your playbook is a goal, from zero config to fully functional in one playbook. Very nice.
Never thought that IaC would be brought to this channel, and I'm all for the detailed Ansible guide.
Merry Christmas to you and everyone watching.
I’ve watched this video several times since it was uploaded, most times only getting about half way until I had to tap out from confusion. Not your fault, I just didn’t have the prerequisite knowledge before diving in. It’s been over a year since this video was uploaded, and I have finally gotten to the end. I just wanted to share this small achievement of mine, and also commend you: it takes balls to demo an ansible playbook on a production machine with all your data on it. Fair play, and great video.
The amount of useful information in this video is just insane. Thank you SO much and please make more videos like this!!!
The video was packed full of great things. I can hardly wait for more videos, especially HomeAssistant, you bring things across in such a calm and structured way, it's fun to watch the videos.
I am planning to set up my home server on an old laptop and it's been weeks of searching and reading through random articles, forums, yt videos etc to create a list of links for reference but when I stumbled on your video I was mindblown by how well made this was. Watched it fully in one go because of how useful it is and packed with so much usable info. From infra to services to security to deplyment to networking, just absolutely insane. Thank you so much for this.
And the ansible playbook service was a really useful cherry on top to anyone who doesn't want to dip their hands in infinitely complicated minor tweaks that takes months to set up successfully!
Super long video but…
Super packed with info!
Bizarrely I know all the Ansible automation stuff you covered later but really want to deep dive into almost everything you covered earlier.
Great video 👍 really enjoyed it 👍
I just found this and I want to give it 10.000 thumbs up. Especially the parts about using a Reverse Proxy for your webservices, proxying connections via Cloudflare, Authelia and reinstalling your Linux system because after a while they feel "dirty" were so good!
I'm an SRE and thankful you're out here providing all of this great institutional knowledge for those who wanna get into this this stuff.
Densely packed. Elegant. And immediately practical. Thanks!
Not sure I can pull off a whole ansiblized server configuration, but now I’ll look at it carefully.
Thank you so much for this great content!! That must have been a GREAT deal of work, and we, the community, really apreciate it! Hope I can contribute as much as you guys do someday! Anyways, merry xmas and a great new year y'all!
Let’s gooo
I'd love to see a deep dive into your IaC setup. I've been planning to remake my Home Assistant supervisor plugin-based server into a proper easily reconstructible setup with something like Docker Compose or NixOS, and your Ansible demonstration has blown me away!
This video alone has also been incredibly inspiring. Thank you!
+1
Would also love to see a deep dive. Looking at getting my home server setup with ansible.
+1
Yeah I think I would look to do it with guix :)
I would imagine it to be much more maintainable if done with a tool like guix that can probably do most of the setup by itself from a couple scheme files, and brings easy rollbacks and upgrades, etc. but it’s probably not optimized for the use case yet and lacks packages/services.
As someone just starting to learn about self hosting, I think this video is packed with great tips. Thanks for taking the time to explain your setup!
Nice video, the IaC part was an unexpected goody. Working as a DevOps engineer I can highly recommend learning this. I even have a playbook to setup my laptop with all the config, software and tools I prefer. Might be a good start for everyone who doesn't have a home server.
Do you have any recommended sources to learn it?
@@maciejrolecki55 check out this playlist: th-cam.com/play/PL2_OBreMn7FqZkvMYt6ATmgC0KAGGJNAN.html
@@Doninhas thank you very much, will check it out
This is an incredible video. Very well done. Way beyond my capacity but great to see what can be done!
it's not a long video if the content is super interesting and conveyed in a very accessible, user friendly manner. great work as always!
Thanks for making this video, this was super helpful!
I was able to fork and run your playbook after some trial and error, using it as a jumping off point for a similar setup, adding things I want to host from repos like docker-selfhosted-apps. Having the setup defined with IaC makes me a lot more willing to spend some time and do it properly instead of hacking together something and having to redo/forget parts later.
lot of valuable info here, just got my own 42U Server Rack setup and there are some services you listed that I'm absolutely going to look into more, great video man!
Interesting to see your server running on 6100. Mine runs on 4570T, I have few of the programs like yourself, however I run emby instead of jellyfin. And instead of pihole, I have OpenWRT running on my router and I block DNS ads on there.
I am always happy to see things like these :)
Been waiting for this! Thanks.
Thanks for showing so many self hosted alternatives. This video is gold. Great job!!!
After watching this I might just end up getting a Synology. I have Home Assistant and other various servers running. I don't know if I have time for another one but I'm very impressed with what you have accomplished. Very nice.
Hey mate, would love to see a video about debloating Windows 11. To everyone watching Merry Christmas and a happy new year.
Afaik Chris Titus already has some videos about that.
@@WolfgangsChannel doing that with Ansible would be fun XD
Maybe run OOShutUp10 first and then those PowerShell scripts :D Both can easily run unattended!
@@WolfgangsChannel Chris Titus also said that Linux is an operating system, so we're taking his word with a grain of salt these days.
@@dial2616 Yeah I don't know why creators are so afraid of covering a topic after someone else has already done it. Usually the first video on a topic is lacking certain tips or other info
@@davisssamuel same spyware, different label
btw for keepass you can sync the kbdx file using syncthing between mobile and laptop/computers. it gets updated everytime you make an entry or an edit on any device. works for me up until now. give it a try maybe.
edit: sucha lovely video! happy holidays!
No Synching on iOS, unfortunately
You’re an OG. So much to learn from you. I am finishing my cs degree and took a networking course and got interested in home setup/networking/ etc and find your videos to be really cool and informative.
So much work went into this. Absolutely crazy. Great vid
Hey Wolfgang, nice to see your home setup! Question: what brand of smart thermostate are you using?
Danfoss Ally
For new homelab builders as option consider proxmox as base system instead of ubuntu server for learning purposes also.
"I use proxmox btw"
Watching this video alone I learned the basics & nuts n bolts of cloud computing!!!
Thank you very much!
Herzlichen Glückwunsch zu den tollen Videos und zum Channel. Deine Videos finde ich richtig gut, ruhig, sachlich, informativ.
Interesting. Although, the big problem is when you set something for the first time: you often don't know exactly what the right commands are, you have to experiment a bit, test stuff out etc. And with some things, setting them up is such a long and tedious process, that you have no incentive to start doing it all over again. Take for example hosting your own mail server. That takes ages to properly set it up and have it support all the scenarios. By the time you are done, you won't be wanting to do it all over again, and rather resort to patching what you have and keeping it running. Doing things right takes a whole lot of time on top of a whole lot more time for the initial setup and figuring things out.
Ansible
Okay, wow. That was a lot of stuff I'm certainly going to slowly chew on over the next months lol. Sadly I can't really reproduce everything because I don't even have a dedicated server or any RPis, but this is right up my alley. Viele danke for the amazing presentation!
One question though, is this approach (mostly Ansible and hosting Docker conts on Linux) feasible with a desktop machine as server, especially without using tons of storage devices?
Thank you!
Ansible can definitely be used to set up a desktop machine. Haven't tried that myself (maybe an idea for a video?) but I don't see why it wouldn't work.
@@WolfgangsChannel Some guys use ansible to setup MacBooks in mass, it's really amazing. Fully development ready machine in 15 minutes, from 0.
Yeah using it for desktops works great as well! If you use Windows then you can install packages with chocolatey, which is such an improvement... Also windows Updates are a breeze! For work I had to create a Window Update Playbook and tried it on a fresh 2012R2 with no Updates and surprisingly it worked great. I almost thought that it stopped at some point, but no it just needed to install a lot of updates... When I had to cancel it, it was at Update 110 XD
There is a video which can be used for inspiration. th-cam.com/video/1VhPVu5EK5o/w-d-xo.html
@@WolfgangsChannel Thanks for the great video. Just a smal question, how can you use homer with local dns on the pi-hole? For example my homer portainer port is 1.1.1.1 , example 192.168.1.200:1111 how can i add a local dns on the pihole dns? As i see you dont use any port and you can direclty access to the homer dashboard.
the best part of this video is just all the other resources you posted for the rest of us to follow along a learn our way too, i had been so frustrated on bad query results when looking online, with things that just say "buy this crap of NAS and use the crap software it comes with it" nothing on the side of build it yourself, which is what i was actually looking for, thank you so much for this, i looked up on the whole smart home thing, and is a great rabbit hole to fall into, to know that you can even check energy consumption and stuff like that makes it actually really good
This video is exceptional in showing everything you can do... but pretty overwhelming for beginners.
If you want to add more drives into ZFS pool, you'd need to create new vdev and add vdev to pool. And disks in vdev can be replaced with larger disks one by one.
wow! that was a wealth of knowledge. I wish I had my home server setup like yours. I would love to see a video for a linux newbie setting up a system like yours.
I love how excited you appear in your thumbnail. It exudes infectious enthusiasm.
Wow! Very impressive Wolfgang. I would love to see a step by step walk-through & deep dive video for your IaaC setup.
Hey Wolfgang, why are you using XFS instead of Ext4 of Btrsf ? Are there any advantages?
I'm so happy you released this video, what a beautiful Christmas present ! 👀 I want to redo my NAS that I installed with OpenMediaVault and your first part NAS Video tempted me with the PiKVM and Homer dashboard ! I'd like to see the deep dive and step by step walkhtrough of your Ansible configuration, it looks impressive and would help me so much ! Thank you ! ☺️
I’m always learning a lot of new stuff when watching your videos. Keep it up!
Need to put SSL from Let’s Encrypt now!
You are inspiring me to install Home Assistant instead of Apple Home.
You can also use Home Assistant with Apple HomeKit! 🙂
I run a HomeKit bridge to be able to use Siri commands with my Zigbee devices.
ZFS is not as limiting as you make it out to be. The only RAID solutions that I know requires the same size drives to be used are hardware RAID systems. As of OpenZFS 2.1, you now can add additional drives to RAID vdevs after they are created. You can add nVME drives for Caching and they are handled automatically by ZFS itself, no scripts required. I personally like the fact that everything is checksummed with ZFS, so things bit rot can be avoided, something that ext4 does not do or protect from. ZFS is much more flexible than than you realise.
ZFS is a nightmare
@@adiledemiri7372 How is that?
OpenZFS cannot add any drives to vdevs yet, even in the 2.2.0 ... and it will be a long way to go. Plus caching (L2ARC) requires a LARGE amount of RAM available (1:5 to 1:10 as RAM:NVME ratio!), and this should be ECC. So extremely expensive. Plus ZFS performance degrades when the pool is >50% full. Not a workable idea at all if you don't have a lot of money to support all this.
There's so much info in this video I love it thank you Wolfgang!
As someone that hasn't used most of this stuff, it looks like a full time job just setting it all up and maintaining it.
One thing that's missing and also hard to set up properly is off-site backup.
How do you use Local DNS to access docker containers with something like homer.box, since they share the same IP address but different port?
Reverse Proxy!
Have you figured out how to do it? I've been trying all day to set up a reserve proxy with Apache and/or nginx but it doesn't work.
@@Blitzritze let us know if you figure it out..
@@rpm10k. My next try I'll do it with Nginx Proxy Manager, since swag looked too complicated to me. I am completely new to the whole topic.
@@rpm10k. I think I figured it out, I have to rebuild my entire raspberrypi but then it should work.
You have to run all "programs" in docker and in the same docker network and so you can say via swag or traefik that if a certain docker container is accessed with a certain domain it should be forwarded to the certain ip with port.
Been waiting for your vid on this, and was not disappointed!
That piKVM setup looks really slick, definitely going to set that up in my homelab! I'm tired of lugging out the spare monitor when I need it. Great video!
great video. I will definitely use some of these applications.
Since you mention "very legally obtained" movies and software a lot, could you make a video on that topic? All for educational purposes of course
TH-cam already removed my video on how to download TH-cam videos and gave me a TOS strike, so I won’t risk it
@@WolfgangsChannel too bad. Thanks for the reply anyways, I really appreciate it. :)
4:14 *МАМА, Я В БЕРЛИНЕ* pepega
Wow. What a gem of a channel. I honestly feel lucky to have found it
Making my first home server, and the MergerFS and SnapRAID advice is what I was just looking for! You just gained a sub!
You better update your unifi controller, as that version is very much affected by log4j, also the issue with that it constantly wants to adopt is most probably that it sets the wrong set-inform url on the AP when setting it up. if you have the controller as a docker container it might have given the internal ip instead of the host ip, this can be set in the controller to specified ip, setting is called "Host for Inform" and will most probably solve that issue between restarts
Thanks for the info!
Step by step cache drive for mergerfs video please
This is amazing; it's basically exactly what I'm doing or want to do, plus a few new things I'll try out
Really appreciate the callout to all the other contributors. Fantastic stuff
Do you self host your e-mail? I assume that if you do, you might be doing it on a VPS.
Also you should consider hosting a tor node.
I don't - in my opinion it's more trouble than it's worth
Hosting email from residential address space gets you autoblacklisted just about anywhere - no amount of spamlist training can fix that. Then there's the problem of incoming spam. So I agree with Wolfgang it's more trouble than it's worth for sure.
Question: I host my email on a VPS, but I was thinking about setting up a second server at home, and pointing my email address DNS at both the VPS and the home server for some redundancy. Assuming this even makes sense (I'm a DNS noob), would that then just get me blacklisted whenever it sends from my home?
“Based on Rust” is a meme now. An irrelevant detail gets promoted like it’s some kind of feature.
Why?
Yeah, All the work Firefox, Google Chrome & Linux Kernel team is doing to rewrite their projects in Rust is a meme right?
@@4n0nmann5 they aren't rewriting anything. They're using it to write select components. In the kernel case, they're allowing some device drivers to be written in it for instance.
Rust fanaticism is ridiculous. It's a cool language but anyone that's actually used it will tell you it's language ecosystem is still immature. People need to chill.
@@seabrookmx I agree. Rust is ok, but it’s not perfect and has its problems. Just like anything else it’s not a fix all. Rust fans are toxic.
@@WolfgangsChannel End users don’t really care about programming languages and they usually don’t have an effect on usability. Slapping the “based on Rust” label on it doesn’t make it magically good.
Looking forward to that deep dive video! Great job!
Still one of the best Tutorials/Showcases I've seen so far!
Oh hey! Thanks for the video, the home servers are always interesting, hopefully I’ll adapt some of you ideas
Many of the software solutions I was looking for my own server, in one video. Vielen dank!
This video is just everything anyone would ask for, thanks for the dedication.
Whow! That's super inspiring!! 🙏 Thanks a lot!!
Thanks a lot. It can be seen here lots of curated work along the years in a 20 min video. Definitely going to take a look to the references you mention.
This is amazing content man. Just found your channel. Keep up the great work!
I discover your channel watching this video and wow so much content. A lot to get excited about how I can upgrade my Homelab. Thanks for sharing !
博主真是太厉害了，我简直可以直接copy你的这套服务器，和我的需求完全重合，谢谢你做了这期视频
This is such a wealth of info. Bookmarking the links for reference. Thanks a ton!
Great video. I really love videos where people share lots of their fav open source tools around a topic. I wasn't aware of SWAG or DDClient both of them will be very useful to me :-) Been using Ansible for many years (7 maybe?) my fav provisioning tool. I love that it is push based and you can see the progress on multiple servers.
just build a new pc and have been planning to convert my old PC into a HomeLab and as someone with no Server/Docker experience it's quite overwhelming at times. This video was super helpful for me though! explained everything well enough for even myself to understand. well i was a bit lost during the ansible section but i don't think i plan on using it to start with anyways. maybe when i'm more experienced.
This is the first time I'm watching you and it's just, WOW!
THANK YOU ! I was seeking for ideas with my own serv, definitely awesome content
How do you backup your Home Server? Expesially the vaultwarden should really carefully be backed up. Planning to get similar but getting messed up with the backups is my only consern, because that can always happen and better get ready for it before so I don't lose all my account credential and secure information. Best video in a year I have watched!!! 🥳😎
Wow this was an awesome video. I just randomly came across one of your videos through the TH-cam algorithm and I’m hooked. Can’t wait to work on some of this stuff.
Welcome back, Wolfgang! Missed you on the youtube feed!
you are the man! I want to do this for a living and as a hobby its just so nice to see the help!
heavily detailed, and sure once again I'll come back and look at all these when I take my self-hosting journey ~
My goodness, this video is an invaluable resource!
Incredible work, thank you for sharing! 💪
super high quality content, thank you!
This is good stuff man!, Spread it by explaining step by step
Would definitely like to see a step by step. Amazing informative video as always!
the serious expression on your face while talking about legal hannah montana linux, is hilarious !
Thank you for providing great high quality content on your channel
Awesome video man. Thank you so much!
I've always dreamed of having such a set up like this.
Everything was amazing but I’m extra fond of the IoC part! Incredible!
Holy shit! I had so many problems installing my server and I thought it'll be impossible to keep all my services up without loosing my hair but this vid was all I needed. Thanks!
Love your video style and topics! We need a home automation video :)
Liked for Ansible. Subscribed for step by step guide.
Another amazing video, thank you so much!
I'm glad to know we have the same taste in a lot of software.