Making an Auto Backup / Failover Server - part 1
ฝัง
- เผยแพร่เมื่อ 15 ก.ย. 2024
- This video is the first part of a short series showing how to setup a backup or failover Unraid server. This part looks at how this all works.
Script used in this video
github.com/Spa...
If you would like to help support the channel please do sh from the below links :)
** Paypal ** www.paypal.com...
** Patreon ** / spaceinvaderone
** Bitcoin ** 3LMxDzcwPdjXQmmeBPzfvUgjYFDTqDAgQF
Need a VPN?
PIA is popular with Unraid users as its easy to setup with various vpn download containers - www.privateint...
Need a good Plex, Emby or Jellyfin client that can handle native h265?
Nvidia Shield TV Pro (best)
USA amzn.to/2XPbVbo
UK amzn.to/3zIDTTI
Nvidia Shield TV (good)
USA amzn.to/39EzS8c
UK amzn.to/3EUtMPi
Torguard is also an excellent VPN again with both openvpn and wireguard protocls supported.
Get 50% off for life using code spaceinvaderone torguard.net/a...
Need a cheap windows 10 licence for around $10 consogame.com/...
Need to buy something from amazon? Then please use my link to help the channel :)
USA - amzn.to/3kCikfU
UK - amzn.to/2UsYb1f
USA link - USB HDD Docking station amzn.to/3v754WG
UK Link - USB HDD Docking station amzn.to/3hLenYp
Still waiting for Part 2 now about 1 1/2 years later. Still is something I want to do but wonder if it will work with Version 6.12.3 and if not is there an updated version?
Man...I'm not sure HOW you do it, but your videos are ALWAYS timely, and EXACTLY what I'm working on. Can't wait for the next part.
Same! Was building an offsite backup the last 2 weeks. But with mixed scripts and tutorials. Now I’m more confident it’s bullet proof
It's somewhat spooky.... maybe he _primes us subconsciously?_ *It's Awesome =)*
No kidding! I just purchased my license for a 2nd server and was wondering about keeping my old one as a backup.
I can confirm the same
Same here!
Hi Ed, thanks as always for the incredible content!
Curious if part 2 ever got published. Also, really interested in what this setup would look like if we wanted to do an offsite backup server. 🙏🙏
Superb Ed. This is exactly what I want to do with my Unraid servers. Looking forward to seeing the series.
Thanks Mark next part will be up in a few days :)
@@SpaceinvaderOne ok not to be in the way but this never happened...... i really like your video's....
Yeah, I would love to see next part of this video
I got this working, but had to do a simple workaround on the backup server. WOL would wake the backup server, but I couldn't get the backup script to run. The workaround has two steps: 1) set the backup server to auto-start the array; 2) in User Scripts set the backup script to execute "At Start of Array". This works well, as the backup server starts, backs up the data. then shuts down.
But I'm (im)patiently waiting for Part 2 of the video. I'd really like to have my (low wattage) backup server take over!
Awesome video! Is part 2 coming soon?
Hi Spaceinvader One, I love your channel and all your tutorials, they are very helpful and simple to follow. Working on building my first Nas build thanks to your awesome videos👍
Hi Atom -88. Thanks glad you like the channel. Best of luck building your NAS i am sure it will be great. Thanks for watching :)
Really exciting stuff, looking forward to the next part! Thanks a lot for your awesome work!
Spaceinvader your videos are a invaluable tool for the unraid community. Thank you for your continued efforts. I'm looking forward to the next part of this video series.
Love your videos. Where is Part 2!!! ?
I would love to see the completion of the nextcloud series with installation of the onlyoffice document server and elasticsearch
This!
Yes Nextcloud series is continuing soon. I split it up a bit so not to have lots of one type of video in a row. But yes soon :) Thanks or watching
Will a part 2 be coming? I’m ready :)!
Ready for Part 2
Did you ever complete this series? A really interesting and important topic.
Would you please provide a link to part 2? I've browsed through your posted videos and don't seem to be able to find it.
I'm looking for it also. Can't seem to find it.
Dear Sir, is the next part come out yet. I have watched all the videos on your channel. It is real hard work you have put in. God bless.
Where are you Spaceinvader?! i have my second unraid server ready to make a backup... part 2? 🙂
Hey Ed! Just following up on this. Creating a fail over sever is something that I'm really interested in since there's a lot of important files on my server. Just wondering if you're ever planning on doing a Part 2 to this video?
Nice video Ed! Thanks for sharing it with us!💖👍😎JP
Thanks for watching!
@@SpaceinvaderOne Your very welcome Ed! Have a wonderful week😎
Awesome content! Definitely curious as to how you have your unRaid backups running. Is it with a script utilizing rsync? Last video on backups was using duplicati. I have had enough of duplicati with the amount of issues I have ran into…
Hi Scrumpi yes the scripts are using rsync. Thanks for watching.
This is awesome! I've been thinking about setting up something similar but couldn't figure out how to automate anything more than the data sync. One question though...what happens if there are active streams being served by Emby when the failover script starts? Can clients continue playback seamlessly (if they have enough video buffered) while the server failover is taking place until the failover is complete? Does the client video buffer then refill from the backup server?
After my most recent server crash I think it’s time to look into a backup
What a teaser 🙂
Hey Spaceinvader, great subject, but is part two coming soon
Geez I just had a big scare. Went to bed last night and unraid was working just fine. In the morning my phone had some notifications that some nextcloud syncs were failing. I tried to pull up unraid but I couldn't access anything at all. I ended up pulling the USB, moving the config file to my PC, formatting and reinstalling unraid, and then just over wrote the config file with the backup. Put it back in my server and all is well. I'm not even sure that was the problem but it's all working now. 🤷
Man ,sorry to here that. Glad your server is back up and running now :)
Also would like to se pt 2 of this series.
do you have a video showing how to setup an unraid server at a different location for backup or just syncing to the main server? I want to have a complete clone of my unraid server in a different location and when one thing is downloaded or updated to the main server it gets updated on the other machine too.
Looking forward to part 2 as well. Also curious, is there a way to do it so both servers are on all the time and If main server turns off or shutdown it automatically goes to backup server then once the main server is back up it goes back to the main server?
Blake’s 7 the darkest sci-fi
I can't find part 2, was it ever done? Really would like a walkthru on the scripts.
Do you have a video for a very specific edge case? Mine is: I have unraid at my house, my parents want to have a unraid at their house. I want to set both up. Mine will be the primary at my house and their is primary at that house. I don't want to overide any data on theirs if they sync videos or photos to it. I want mine to get a copy and update whenever they do something on that unraid instance but still have mine sync back to theirs when I do something. Should I just look at getting a third instance and then have that as the primary that syncs to both? The downside would be that I can not transfer to mine locally.
I literally just sent hardware to my friends house as an off site backup solution! Curious how you do it here.
Was there a reason you couldn't replace the failed drive and rebuild from parity?
I could have built back from parity but as the data was corrupted it would have rebuilt the corrupted data on a new drive. So repairing the xfs file system was the best option for me
3:40 Where this gui comes from? (prime_power)
7:14 In order for the two serves to be synced you need them online. Wouldn t that create a conflict having a service run at the same ip:port ?
I'm guessing the dockers aren't running unless the backup server can't see the main server.
What about using rclone (or rsync with multiple streams)? Having an offsite backup server (for example on different continent as the most possible bulletproof backup solution) could introduce significant ping between the servers, where with only one transfer stream would drastically impact the speed of syncing huge amount of small files (overhead for waiting for response / confirmation for each file).
By running rclone with, let's say 10 concurrent streams, really saves the headache in this scenario. I'd love to know whether there is a smarter way to approach this problem, but a weekly rclone script running on a windows VM so far does the job for me.
Is there a recent video on how to backup an unraid server to another NAS incrementally Incl pools? So that you in essence can restore it all… and w.o. Terminal? Like eg tima machine for unraid?
Hi there, I don’t know if you have a video on it already but how do you add your main and backup server to the header on unraid so you can easily switch?
Awesome video, was looking for a solution like this. Is it possible to automatically start a backup from the backup server to send data to Backblaze B2 cloud storage once the copy from source is done?
Very nice Video;-)
is there a part 2?
Do, did your parity drive fail to replace the defective disk?
When will part 2 be out?
I can't find the second video. Has it been made yet?
Hi do you know if you will be making an invoice ninja unraid installation tutorial?
What video of the continuation to this project??
Any timeline on Pt2?
What is that neat power showing thing?
Hi Zack. Ttats a sonoff powr2 (smart switch) but flashed with tasmoto firmware tasmota.github.io/docs/ Thanks for watching.
how do you set one server to shutdown another?
I can't find the docker app discover in the unraid app store. Am I spelling it right?
diskover
Is that a power plugin you are using? At the 3:40 mark
Thats a smart plug flashed with tasmota firmware
Why would you have lost any data from the xfs corruption? I thought the other discs in the array would have had the data? Am I missing something?
I also just lost data when my unraid USB died and I restored the os from a backup it had made prior to installing the latest drive. I then started the array thinking it would parity check but it cleared the newest drive. I thought it would rebuild the drive from parity but no.
Hi fyrearm on blast. The data became corrupted so this corruption of the filessytem got reflected in the parity. So rebuilding the data from parity on a new disk would have given me the corrupted data on a new disk. So for my situation an xfs repair was best to do. If the whole drive had failed yes i could have rebuilt from parity. Its kind of similar if you deleted a whole lot of files from your server you couldnt rebuild the deleted files from the parity. Hope that make sense. thanks for watching :)
@@SpaceinvaderOne totally makes sense! I followed your instructions for everything I'm doing. I get the "how's" but I really need a better knowledge base of the "whys". I really appreciate all you do for the community!
How are you handling the IP conflict? when both servers are on with the same ip? i understand once the media is copied but the conflict will happen in the morning and at night.
Hi Ivan. The ip of the servers are different. Just the 'mirror' containers IP is the same. The script only starts the containainers when the other server hosting the 'mirror' container has shut down. Thanks for watching :)
@@SpaceinvaderOne Have you looked at keepalived? Would be an easy way to have a single IP serve those services with automatic failover. Should scale beyond 2 backup servers if desired as well. It runs VRRP under the hood and can quickly be setup in dockers within a few minutes.
Hello, any update on part 2?
What happens if both servers are running and you get client traffic?
Hi Dylan. The script makes sure the containers are not running at the same time
Damn, I wish I didn’t have 400+tb of media so I could affordably do this lol.
lWow thats makes my little server seem pathetic lol I cant imagine 400tb of media thats amazing :) Thanks for watching
@@SpaceinvaderOne and thank you for all your content! You have helped me a lot over the years!
Where is part 2?
Part 2?
Is there a Part 2 to this video?
very soon :)
@@SpaceinvaderOne Thanks Ed! I saw in your last video the reason why things have been slow. My condolences to you and your family. Hope you guys are doing well!
Part 2
So where is Part 2 LOL!
Did I miss part 2?
Only groupies and simpletons worry about movies, media and all that superfluos commercialization and consumerism.
Useful information, knowledge, history and your own memories, sure, but worrying about Hollywood, et all?
why disable dislike? How do you know if people like your tutorial?
edit: I just saw dislike returned on this video.
Dislike can be enabled by a Chrome plug-in. The plug-in showed dislike was disabled by uploader when I initially saw the video. It's back now.
He didn't chose to disable dislikes. TH-cam turned off dislikes across the whole platform.
Holy cow, you must live in the stone age bro, that's a youtube decision.
TH-cam in their infinite wisdom decided to turn off the dislike counter. Creators can still see the counter, we cant
Great video as always, but so missing part 2. I have worked out to share the SSH keys so can get RSYNC to copy but the script on the backup just fails with
"rsync: connection unexpectedly closed (0 bytes received so far) [Receiver]
rsync error: unexplained error (code 255) at io.c(231) [Receiver=3.2.7]
/tmp/user.scripts/tmpScripts/Backup Betty/script: line 38: /mnt/user/appdata/backupserver/config.cfg: No such file or directory
If anyone wants to give me a hand I would appreciate the insight.
part 2?