That moment when you relize you are clueless. Owning a synology and begining to understand its services, you've only scratched the surface of what can be done. Great video.
@@SpaceRexWill Look forward to the Zabbix video. Seems really neat! Never heard of it before. Someone mentioned Dashy and was considering that one, but Zabbix seems much better.
I am really impressed with your content that you have been pushing out! I have been following you for awhile and it’s nice to hear you cover a topic that I hadn’t thought of before. Can you do a video on the different types of users that would use Synology and a setup they would benefit from? For example, a photographer is going to need different setup from a programmer. But both might benefit from a database. That might help me figure out the way to get the most value out of my unit. Also, I like the database discussion. I have thought about setting one up but not sure if I need one or not. If I where to set one up it would be nice to know what I am getting myself into as far as setup and then long term management.
Thank you for all of the great ideas. I was researching to figure out what to use the rest of my two 2u servers for. Lol I don’t need any of this. I just want it. And I’m new to all of this, and learning a lot very quickly and you’ve helped me a lot.
That would be nice! Using PST files to store email was my favorite feature of MS Outlook. I currently use Fastmail’s Web app and Apple Mail together , but neither of them let you archive email offline. I mean, Apple Mail will keep a local copy, but you want export import email from an archive file. There is an app called Devonthink that you can import email into for long term storage, but it’s pretty clunky in my opinion. it also is closed source and cost a few hundred $$$.
I think it depends on the server size. I run plex on a pc and have similar services and it draws between 60-100W. Where I live that's not more than 10-15$ per month (74kwh).
Hi Will, Mariadb - totally need it but the question is Package, Docker (macvlan), Docker ( host) or Docker (bridge). They would all be writing to the same disk drives (SSDs). I have read that speed wise it goes package, macvlan, host then bridge. Though having mentioned speed not that big an issue for a little home user.
I use postgresql db in bridged network mode without any speed issue. I have around 25 containers all on that same network and ssd without issue. o/c I back up their files and databases to a different computer for safety.
9:40 what are advantages to run Bind DNS server instead of Synology DNS package? Is Synology DNS package is just an UI for third-party DNS server, or it is built from scratch?
@@SpaceRexWill Thank you. Good to know. This means that it's should be possible to copy DNS records from the Synology config file if you want to setup additional BIND DNS server somewhere.
Well done dude! I used pretty much everything you mentioned as a Sysadmin at a couple of colleges. Currently running ProxMox with Home Assistant running in a VM as well as a Ubuntu server VM as a Docker host, running Homebridge, Plex, Calibre, and a Broadlink connector. It may be time to run some DNS servers and pihole servers. Thanks, I truly enjoyed the video.
DNS is one of those things thats awesome, but can get you in trouble! One thing I have started doing for clients who have PF sense, is using its conditional forwarder for DNS requests. Basically it will only forward whatever local subdomain you like to your local DNS servers, then everything else gets sent to a public DNS server. this way if your DNS servers go offline, the internet stays up at least!
It really comes down to what you are hosting. 95% of things that are self hosted (even home stuff like Plex) have a database. But not all of them require a external DB. But I would say most home users who are tinkerers should run Gitea to keep track of versions of configs which requires a DB
Tons of stuff! Zabbix, Wordpress, gitea, nextcloud. Some modern full stack things like to add their own (like discourse). But I feel like most old school stuff works with mySQL / MariaDB.
For me I have been a bit wary about going head first and self hosting a password manager, mostly because of how I now have to worry about my own security when it comes to it. I have been using apple keychain for my passwords and for me, it works great. It's about as walled garden as you can be, but the way it handles encryption is phenomenal
I agree with the Git server, that is awesome. But I don't understand why I would need one central DB (in a homelab) with all the data in there.. way easier to setup one MariaDB docker instance for each service that needs a DB, and if you decide to kill that service you can just kill the DB as well.
There are a few reasons why I like having one centralized DB (when possible) 1. backups - having just the one database sever means you only need one backup script and you only need to check one backup location for everything (snapshots are not backups for database, as stuff is in ram) 2. A single pane of glass to set everything up. You can PHPMyAdmin on there and monitor everything in one place. Making new databases is then really easy too 3. One place to get extra performance / tuning
For DNS records for your local services, your router should do that automatically when you set your DHCP reservations. There should be a text box for hostname when you create your reservation, and the router returns the IP address for that hostname, assuming you use you router's IP address as the DNS IP address for DHCP clients.
So the reason I like running a stand alone DNS sever is it let’s you do so much more than this. You can have CNAMES, change records, have records multiple records to the same IP and use a reverse proxy to go to your service. Plus the local domains only work on a layer 2 network. They will not work over a VPN
@@SpaceRexWill Can you do a video on setting up a DNS server (such as a PiHole) and having it work with the VPN server (such as on a Synology) in such a way that local services can be accessed by hostname when remotely connected via the VPN?
I’m still waiting for my UDM Pro router to support CNAMES. It has almost every other type of DNS record except for that. I’m currently using A / AAAA records that all resolve to the same IP in place of CNAMES. I’ll switch them out once my router supports CNAME records.
Any chance you could do a tutorial about the best way to get from ext4 to BTRFS please? No so much concerned with moving data but more how to migrate apps, docker and containers without losing anything. I know there's so much stuff I'm missing out on sticking with ext4 but scared to make the change...
I've done that "migration" last month: Synology DS220+ DSM6 from ext4 to BTRFS. I broke the mirror, deleted one drive from ext4 pool, created a separate SHR pool and created BTRFS on it. Moved data as much as I can, kill ext4 volume, ext4 pool, added second drive to SHR as a mirror. But everything is not that smooth unfortunately 😢 Simple shared folders moved easy and fine. Encrypted folders: you must decrypt it and then encrypt again. Packages: I have to say that Synology have one huge disadvantage: you can move a package only through backing it up and restoring back. And even after that you probably will end up with several non working packages like Photos. Thats because there is a database that is not a package, its just a directory on a volume and has no controls from Control Panel :-(. May be it is a good thing to do as Synology is telling in its documentation: backup everything off of your volume, recreate the volume with the different filesystem but with same name(!), restore everything back. So you will need one (or several) reliable backup target, network or usb3 external drive.
^ I have been there before. I really wish Synology would give an easy way to migrate apps to a new volume. You can do it, but it really sucks. You have to SSH in and move each of the packages symbolic links. I hate doing it because I am always worried I am going to screw something up
Does self hosting a lot of the smart home stuff prevent the constant phoning home many of the IoT devices do. Linus talked about how hes able to prevent that but didn't really go into it. The home lab looks awesome btw.
So pretty much across the board if you are running standard Z-wave or zigbee stuff you and you adopt it into your network you can run it locally. Huge in terms of performance, and long term reliability
A few months ago I got a Synology router and it has a feature called "Safe Access". You can set up user profiles and web filters. I created a profile that included all of my security cameras. And then created a filter that only allowed them access outside the network to do a daily time check at a specific URL. Dead simple.
How can you tell which files are currently or I have previously shared from my Synology NAS? When my NAS runs out of space, how can I tell where all my NAS space is going?
I'm currently evaluating wether to setup zabbix or something like prometheus, but I'm not sure what would be the best fit. What are your thoughts on prometheus and do you think it's like comparing apples to oranges?
I would say its a bit like apples to oranges. (note I am not an expert) Prometheus is more designed for the hyperscalers and people managing massive services that they themselves write. Zabbix is really for monitoring servers and hardware. Its easy to add on to pretty much anything with templates.
Hi Will, quick question: I’m looking for a NAS that will fit into my needs and usage. I want my 5GB Lightroom RAW photos available, back up 5 iPhones, 2 iPads, 3 MacBook Pro’s, and MAYBE put my 1200 DVDs and 100 Blu-rays on the NAS to play in home only on AppleTV and iPad and iPhones. That’s it. I don’t need tons of apps or internet access to my NAS, just local connection over Wifi. Connecting via Ethernet is not an option for me. I had almost decided on a Synology but the more o learned, the more I found out I don’t know. My head is spinning, and I’m almost convinced to just stick with using 3 external HDD at a time using Thunderbolt. Thanks!
@@SpaceRexWill is it too much to ask which Synology you’d suggest given my intended usage? 2 bay or 4 bay? I was thinking about 12TB usable storage… 2x12 or 4x4?
I'm going to try to self host passbolt as I need a password manager and I'm too cheap as well as untrusting (actual word?) to use a cloud password manager. Do you have a pssword manager that you self host that I should consider instead?
can you make mention of speeding connections between two Syno's. Such as using Rsync. I've done it before. I recall it was just limited to one folder or some other limitation. Also - what about Rsyn on Windows? tools like cwRsync or DeltaCopy. I have a few older Syno's from 2014-2018 that are the non + series. And some J series that I've retired from customer use. I'm wondering about what to do with them. I've some some RAM around that I could put in to increase the RAM. I'm hesitant to even let friends & family use them even just limited.
It is indeed depending on the LG app which one you are using. If you are using your NAS as DLNA server for example you need to check which formats your tv supports. It is also possible that the audio format is not supported.
TV's are really bad about compatibility generally. You may look at tweaking media server settings to transcode more often. Or you could always just use hand brake or FFMPEG to transcode the video to something your TV can play.
Hi Rex, what's the advantage of running a DNS server over using mDNS (e.g. accessing your hostname-on-local-network as hostname-on-local-network.local without any DNS/configuration)?
so there are a few reasons: 1) Flexibility, you can change IP's to whatever you want, and update things to new services by just changing an IP 2) This works cross VLAN with layer 3 networks 3) CNAMEs -> you can just point one address to another one!
Checkout the full list (updated): forums.spacerex.co/t/what-are-you-self-hosting-in-your-homelab/294?u=will
That moment when you relize you are clueless. Owning a synology and begining to understand its services, you've only scratched the surface of what can be done. Great video.
haha the whole homelab thing is a dangerous deep hole you can fall down into! It has no end!
It would be great if you could do a Zabbix Server walkthrough - from installation to config. Thanks!
Will for sure be doing one!
Yes, please
Looking forward as well!
@@SpaceRexWill Look forward to the Zabbix video. Seems really neat! Never heard of it before. Someone mentioned Dashy and was considering that one, but Zabbix seems much better.
I am really impressed with your content that you have been pushing out! I have been following you for awhile and it’s nice to hear you cover a topic that I hadn’t thought of before. Can you do a video on the different types of users that would use Synology and a setup they would benefit from? For example, a photographer is going to need different setup from a programmer. But both might benefit from a database. That might help me figure out the way to get the most value out of my unit. Also, I like the database discussion. I have thought about setting one up but not sure if I need one or not. If I where to set one up it would be nice to know what I am getting myself into as far as setup and then long term management.
Thanks!
Thanks!
Thank you for all of the great ideas. I was researching to figure out what to use the rest of my two 2u servers for. Lol I don’t need any of this. I just want it. And I’m new to all of this, and learning a lot very quickly and you’ve helped me a lot.
Please make a video on hosting a mail archive or other ways to setup mail archiving on Synology.
I have been meaning to figure that one out! I have had a few people ask about that, but have not found a solution
That would be nice! Using PST files to store email was my favorite feature of MS Outlook.
I currently use Fastmail’s Web app and Apple Mail together , but neither of them let you archive email offline. I mean, Apple Mail will keep a local copy, but you want export import email from an archive file.
There is an app called Devonthink that you can import email into for long term storage, but it’s pretty clunky in my opinion. it also is closed source and cost a few hundred $$$.
Man, this was soo useful! Thanks for sharing!
Thanks for this video. Inspiring!
Glad you enjoyed it!
Lordy! How much does this add to your monthly electricity bill?
I think it depends on the server size. I run plex on a pc and have similar services and it draws between 60-100W. Where I live that's not more than 10-15$ per month (74kwh).
Hi Will, Mariadb - totally need it but the question is Package, Docker (macvlan), Docker ( host) or Docker (bridge). They would all be writing to the same disk drives (SSDs). I have read that speed wise it goes package, macvlan, host then bridge. Though having mentioned speed not that big an issue for a little home user.
I use postgresql db in bridged network mode without any speed issue. I have around 25 containers all on that same
network and ssd without issue.
o/c I back up their files and databases to a different computer for safety.
Our opinions on Plex couldn't be any more different. I can't stand how they're constantly adding other stuff than my media on the app.
9:40 what are advantages to run Bind DNS server instead of Synology DNS package? Is Synology DNS package is just an UI for third-party DNS server, or it is built from scratch?
So Synology is just a web interface for BIND. I think it just runs it in the background
@@SpaceRexWill Thank you. Good to know. This means that it's should be possible to copy DNS records from the Synology config file if you want to setup additional BIND DNS server somewhere.
Well done dude! I used pretty much everything you mentioned as a Sysadmin at a couple of colleges. Currently running ProxMox with Home Assistant running in a VM as well as a Ubuntu server VM as a Docker host, running Homebridge, Plex, Calibre, and a Broadlink connector. It may be time to run some DNS servers and pihole servers. Thanks, I truly enjoyed the video.
DNS is one of those things thats awesome, but can get you in trouble!
One thing I have started doing for clients who have PF sense, is using its conditional forwarder for DNS requests. Basically it will only forward whatever local subdomain you like to your local DNS servers, then everything else gets sent to a public DNS server.
this way if your DNS servers go offline, the internet stays up at least!
Maybe a silly question, but why would we need a database if you just run a home server for, well, home stuff?
It really comes down to what you are hosting. 95% of things that are self hosted (even home stuff like Plex) have a database. But not all of them require a external DB. But I would say most home users who are tinkerers should run Gitea to keep track of versions of configs which requires a DB
What containers/services do you connect to your DB? I am looking at what I host and I am not seeing many options for a Bring-Your-Own-DB
Tons of stuff! Zabbix, Wordpress, gitea, nextcloud.
Some modern full stack things like to add their own (like discourse). But I feel like most old school stuff works with mySQL / MariaDB.
@@SpaceRexWill Thanks for the reply! Thats awesome I'll have to look deeper.
Do you use a self-hosted password manager? Maybe bitwarden?
Vaultwarden*
For me I have been a bit wary about going head first and self hosting a password manager, mostly because of how I now have to worry about my own security when it comes to it.
I have been using apple keychain for my passwords and for me, it works great. It's about as walled garden as you can be, but the way it handles encryption is phenomenal
Which one is the video that shows how to setup MariaDB server in the NAS?
Great insights! One question: Do you recommend running MariaDB inside a virtual DSM instance?
Why do you prefer nextcloud then synology drive service?
I agree with the Git server, that is awesome. But I don't understand why I would need one central DB (in a homelab) with all the data in there.. way easier to setup one MariaDB docker instance for each service that needs a DB, and if you decide to kill that service you can just kill the DB as well.
There are a few reasons why I like having one centralized DB (when possible)
1. backups - having just the one database sever means you only need one backup script and you only need to check one backup location for everything (snapshots are not backups for database, as stuff is in ram)
2. A single pane of glass to set everything up. You can PHPMyAdmin on there and monitor everything in one place. Making new databases is then really easy too
3. One place to get extra performance / tuning
Hey Jim Carey! That's an awesome home lab you've got there.
I’m curious. What do you think about the problems with western digital right now with users unable to access cloud or remote ?
For DNS records for your local services, your router should do that automatically when you set your DHCP reservations. There should be a text box for hostname when you create your reservation, and the router returns the IP address for that hostname, assuming you use you router's IP address as the DNS IP address for DHCP clients.
So the reason I like running a stand alone DNS sever is it let’s you do so much more than this. You can have CNAMES, change records, have records multiple records to the same IP and use a reverse proxy to go to your service. Plus the local domains only work on a layer 2 network. They will not work over a VPN
@@SpaceRexWill Can you do a video on setting up a DNS server (such as a PiHole) and having it work with the VPN server (such as on a Synology) in such a way that local services can be accessed by hostname when remotely connected via the VPN?
I’m still waiting for my UDM Pro router to support CNAMES. It has almost every other type of DNS record except for that.
I’m currently using A / AAAA records that all resolve to the same IP in place of CNAMES. I’ll switch them out once my router supports CNAME records.
Can you do one on password managers? I saw that you're using apple keychain - what's your thoughts on it all?
Any chance you could do a tutorial about the best way to get from ext4 to BTRFS please? No so much concerned with moving data but more how to migrate apps, docker and containers without losing anything. I know there's so much stuff I'm missing out on sticking with ext4 but scared to make the change...
I have been meaning to do one! But the TLDR is use hyperbackup to rebuild it!
I've done that "migration" last month: Synology DS220+ DSM6 from ext4 to BTRFS. I broke the mirror, deleted one drive from ext4 pool, created a separate SHR pool and created BTRFS on it. Moved data as much as I can, kill ext4 volume, ext4 pool, added second drive to SHR as a mirror. But everything is not that smooth unfortunately 😢
Simple shared folders moved easy and fine. Encrypted folders: you must decrypt it and then encrypt again. Packages: I have to say that Synology have one huge disadvantage: you can move a package only through backing it up and restoring back. And even after that you probably will end up with several non working packages like Photos. Thats because there is a database that is not a package, its just a directory on a volume and has no controls from Control Panel :-(. May be it is a good thing to do as Synology is telling in its documentation: backup everything off of your volume, recreate the volume with the different filesystem but with same name(!), restore everything back. So you will need one (or several) reliable backup target, network or usb3 external drive.
^ I have been there before. I really wish Synology would give an easy way to migrate apps to a new volume. You can do it, but it really sucks. You have to SSH in and move each of the packages symbolic links. I hate doing it because I am always worried I am going to screw something up
At rhe moment I have nextcloud, cloudflared, cloudflare-ddns, mariadb. On the list is syncthing, RDP via SSH and backups.
Great video. Thanks.
Does self hosting a lot of the smart home stuff prevent the constant phoning home many of the IoT devices do. Linus talked about how hes able to prevent that but didn't really go into it. The home lab looks awesome btw.
So pretty much across the board if you are running standard Z-wave or zigbee stuff you and you adopt it into your network you can run it locally. Huge in terms of performance, and long term reliability
@@SpaceRexWill thanks! Thats helpful. Really enjoying your channel. Have learned a lot.
Glad you like it man!
they'll still phone home, but that's wut pi-hole is for :)
A few months ago I got a Synology router and it has a feature called "Safe Access". You can set up user profiles and web filters. I created a profile that included all of my security cameras. And then created a filter that only allowed them access outside the network to do a daily time check at a specific URL. Dead simple.
I am surprised you don't have a home lab dashboard, for example I run homarr and it is amazing
How can you tell which files are currently or I have previously shared from my Synology NAS? When my NAS runs out of space, how can I tell where all my NAS space is going?
Right here
What is Using all of your Synology STORAGE? - How to find out
th-cam.com/video/CoITMkdQ3pw/w-d-xo.html
@@SpaceRexWill thanks so much. 😀
My Plex on synology do not read the video files since I upgrade to DMS 7, Any tip?
Put the speedtest docker on ya Synology, great for testing LAN and WiFi speeds
^ that is a really good one that I actually use a ton specifically for clients needing to figure out what is going!
I'm currently evaluating wether to setup zabbix or something like prometheus, but I'm not sure what would be the best fit. What are your thoughts on prometheus and do you think it's like comparing apples to oranges?
I would say its a bit like apples to oranges. (note I am not an expert)
Prometheus is more designed for the hyperscalers and people managing massive services that they themselves write.
Zabbix is really for monitoring servers and hardware. Its easy to add on to pretty much anything with templates.
Why not both?
Hi Will, quick question:
I’m looking for a NAS that will fit into my needs and usage. I want my 5GB Lightroom RAW photos available, back up 5 iPhones, 2 iPads, 3 MacBook Pro’s, and MAYBE put my 1200 DVDs and 100 Blu-rays on the NAS to play in home only on AppleTV and iPad and iPhones. That’s it. I don’t need tons of apps or internet access to my NAS, just local connection over Wifi. Connecting via Ethernet is not an option for me.
I had almost decided on a Synology but the more o learned, the more I found out I don’t know. My head is spinning, and I’m almost convinced to just stick with using 3 external HDD at a time using Thunderbolt.
Thanks!
I would 100% buy I synology. Having a NAS is absolutly awesome
@@SpaceRexWill thank you very much
@@SpaceRexWill is it too much to ask which Synology you’d suggest given my intended usage? 2 bay or 4 bay? I was thinking about 12TB usable storage… 2x12 or 4x4?
I would buy a 4 bay, and leave 1 or 2 bays empty to start. That way if you need more space you can just slot in another drive at another time!
have you setup any C2 identity instances? There is a lack of setup info out there.
I have not used it
How do you run MariaDB? On bare metal?
On a VM
@@SpaceRexWill Why not in a docker container?
I'm going to try to self host passbolt as I need a password manager and I'm too cheap as well as untrusting (actual word?) to use a cloud password manager. Do you have a pssword manager that you self host that I should consider instead?
Selfhost Vaultwarden in docker. I have been using it and it’s great.
@@basheerparvez I'll check it out. Thanks
Yoo What about TailScale ? Is it a must have or are there alternatives ?
So I actually only use openVPN for my personal VPN
can you make mention of speeding connections between two Syno's. Such as using Rsync. I've done it before. I recall it was just limited to one folder or some other limitation. Also - what about Rsyn on Windows? tools like cwRsync or DeltaCopy. I have a few older Syno's from 2014-2018 that are the non + series. And some J series that I've retired from customer use. I'm wondering about what to do with them. I've some some RAM around that I could put in to increase the RAM. I'm hesitant to even let friends & family use them even just limited.
I have a DS 720+ and I cannot seem to get the movies that I download digitally to run on my LG TV. Do you have any suggestions?
It depends on what app you are using to run on the LG
Just accessing the NAS as a media sever on the TV. The TV says it cannot play the file but it’s an MP4 file.
It is indeed depending on the LG app which one you are using. If you are using your NAS as DLNA server for example you need to check which formats your tv supports. It is also possible that the audio format is not supported.
TV's are really bad about compatibility generally. You may look at tweaking media server settings to transcode more often. Or you could always just use hand brake or FFMPEG to transcode the video to something your TV can play.
Thank you for the help.
Hi Rex, what's the advantage of running a DNS server over using mDNS (e.g. accessing your hostname-on-local-network as hostname-on-local-network.local without any DNS/configuration)?
so there are a few reasons:
1) Flexibility, you can change IP's to whatever you want, and update things to new services by just changing an IP
2) This works cross VLAN with layer 3 networks
3) CNAMEs -> you can just point one address to another one!
Its Will actually
@@SpaceRexWill, thank you!
Great vid
That tv behind you is waaaay too high. r/tvtoohigh
Actually more comfortable that way, when you’re laying on a couch
@@tama47_ not really. It needs to be eye level.
@@feahnorlthe further the more i can imagine its actually a big tv just far away
Homebridge as tutorial? Maybe too basic or self explanatory. Just a suggestion. Thanks.
Jellyfin + infuse
Zabbix: I think it's SNMP not SMTP 😉
You are correct!
SNMP: Used to monitor stuff
SMTP: Used to email you!
❤
you look like the guy from smosh
t'es un gay mon pote