Thanks David, Duplicati is a great piece of software. And yeah i love my keyboard... and i love flashing lights and the keyboard has that too, bonus, lol !!!
Hahaha I know how that feels; I got myself the corsair k70 rgb with cherry reds. As someone who used to boot from 5.25 floppy on an eye blinding green monitor, the clicking of these keyboards take me back to the days of old!
Ah the k70 RGB is a nice keyboard. I would prefer that one to mine a razer black widow chromo. Yeah, it's funny a lot of people don't realise that mech keyboards have been around for years. A lot of the old keyboards out living the computers they were made for!
Another awesome video Ed! a few weeks back i picked up a Unraid pro license when they asked where i herd of unraid from i said "Spaceinvader one" Thank you for always sharing with us!💖👌👍😎JP
Thanks for this video. I did some quick checks on my server and it works great. I’m now testing a 70GB Dropbox upload which should be fun. Also, great tip for how to avoid using the small docker folder for large file splits. I have image files to upload to Dropbox and I want to minimise file counts (bigger splits) for ease of use. Your temporary folder on the bigger cache SSD should hopefully help me, thanks.
btw dont know since when, but in the actual duplicati container build you can specify the tmp folder for backups during the docker installation. you dont need to specify any dedicated host path afterwards
This docker seems to be broken as of Feb/2021. The webui appears to be started but whatever browser is used just endlessly tries to access it with no luck.
Thanks. gonna try this. Another great vid. Sorry about your dog. Keep up with the vids. I look forward to whats comming next. And thanks for answering my question last time. Plex with SMB share and Sab with SMB off a synology works perfect now 😁
Duplicati certainly looks interesting, but I do think I personally prefer CrashPlan. I have that set up so that all my PCs/Macs backup to the Unraid server + cloud, and the server backs itself up to the cloud. The cloud backup ofcourse isn't free, but with unlimited storage I think it's a pretty good deal when you have multiple terrabytes to backup (even though the upload speed leaves quite a bit to be desired, the data is still recoverable)
Yeah, crash plan is great too. Both Duplicati and CrashPlan support client-side encryption which is a must in my opinion. But the only thing with CrashPlan cloud, is that your backups become locked-in into their online storage plans that are more expensive than competing generic cloud storage providers that people may already have. I really like using my amazon cloud drive with the mac desktop client, Rclone on unRAID and Duplicati on unRAID, plus I have set up Duplicati on various family members computers backing up to my amazon account. But my MacBook uses CrashPlan to backup to the unRAID server but I may change that I'm not sure. So far all has been good. But then if my amazon account ever became locked there would be a lot of eggs in one basket!!
Thanks for the video. I had planned on going with crash plan but they no longer offer home based stuff. only enterprise. I'm kind of glad that didn't work out for me as I like the flexibility of this. trying to get it all set up on my nas now. Is there a max upload size on this? my large uploads seem to freeze.
Great video and I'm thinking of putting my old NAS at my home to function as an off-site backup for my office server. Does this SMB-thing work for that, or would I need a VPN or other form of tunneling for that?
Is there a way or an option to copy from amazon cloud to my unassigned drive on my unRaid? I would like a weekly one way copy from amazon to my local drive. Thanks
Thank you for great video. I’ve just setup a backup to Google drive and done a backup. Just a question, if something happened to my unraid server (eg fire). Would I be able to setup a Duplicati instance on a windows machine or built a new unraid server. Will I be able to do a restore the backup from google drive?
From the looks of it, you need to export the config files for each backup you set up, and store them separately from your automated backups. Then if you have to set up a new server, once you have everything configured and duplicati installed again, when you go to set up your backups select "import from file" and import all your configs to the new server one by one.
Thank You SI-1 for another great video! I have been experimenting with Duplicati on my Unraid Server. So I have my backups going to a local Synology Box located in another building on my property. In the event of an Unraid server total loss(fire or water damage), how would I recover my data? Are you assuming that I am also backing up my AppData? I am just wondering where Duplicati keeps track of these Encrypted Backups. How would I recover my data using another UnRaid Server assuming that I have a valid Encryption Key?
Now that crashplan home is shutting down Duplicati looks like an interesting option for peer-to-peer backup. But I want to backup from remote windows to an unraid server, best as far as I know would be over sftp, but I don't want to use the root user. How can I setup any user on unraid to use ssh?
I know this is an old video, but this problem has persisted for years. On large backups, duplicati always hangs multiple times. When backing up less than 1TB, it works perfect. But multi TB backups will just stop. It looks good for a few days, then the upload just stops and never starts up again. Stopping the docker and restarting it allows the upload to restart where it left off after if verifies the backend, and checks each individual file (which also takes a while). I have looked on unraid and duplicati sites, and no one seems to know why this happens.
Would backing up a very large folder have any implications when backing up to the cloud? We are a 500GB folder which contains a lot of programs and installer we wouldn't want to lose. Obviously it would take a considerable amount of time to upload, but would the Duplicati docker be able to handle it?
Great Video... my condolences about your dog... i lost mine 2 years now, and i still get some tears of sadness... =( can you do a video regarding cpu usage on Dockers ? i read on limetech something about it, but i think i did something wrong...
Yeah thanks, Mikael. He was a great dog. I am doing a video about performance tweaking on unRAID which will include docker container CPU isolation, VM CPU tweaks and disk io tweaks etc.... May even be this weekend's video depending on how busy I am at work :)
Great video! I can’t seem to be able to connect remote share on another test unraid server. It shows the server in the setup but nothing for the shares so put the share name manually. Then when I mount the share it thinks for a bit, screen refreshes and it doesn’t mount. Is there a way to somehow test the connection? I can connect to all shares using my Mac. Thanks for any insight!
Got it to work through adding it as NFS share. SMB still does not work for me. You have to go into shares (on the unraid system you want to connect to) go to the settings for that share and enable NFS. Then you should be able to list the shares in unassigned devices add remote share dialog box. Found this fix with Spaceinvader One's video Unraid Shares in Depth PT1. Thank you Spaceinvader One!
Hey Gridrunner, I had a quick question related to the incremental/block based backups you mentioned at the end of the video. How might I go about running scheduled backups of the same data over different periods of time. IE-Daily, Weekly, and Monthly backups. Right now I have it setup with 3 separate backups having differently named suffixes, all pointing to the same source and destination folders, and scheduled as indicated previously. Is this the right way to go about getting my spaced interval backups, or is there a better way to go about this? Thanks as always for all your great information and videos!
Hi there love your videos but ..... they are outdated. Tried to follow this vid and can't finish installing duplicati because in the new version there is a new path that is not in yours. It's called host path 2 and its displayed to mount to container path /tmp. Duplicati tells me to fill out this path but I dont know what to put there
I get a popup when trying to select to add a remote smb/nfs share. Clicking NEXT does nothing. I do have Unassigned Device installed. This is the Popup note: : Note: Dockers will not be able to access any SMB or NFS share until you restart the Docker service after the device is mounted. Be sure to add a Docker path mapping the SMB or NFS share as 'RW/Slave' or 'RO/Slave'. Go to Settings->Docker and disable then re-enable Docker.
Are you still using Duplicati? Are you still happy with it? It doesn't have a very good reputation hence I'm a bit scared using it for my important backups.
Thank you for another great unRaid tutorial. I went ahead and installed Duplicati on my unRaid server and it's working great. The only issue is the speed. I have it setup to backup about 1 TB of data to a share on another server. The backup job took a long time, more than a week. Do you have a any tips on how to speed this up? Thank you again.
Hi Harry. Wow yeah thats a long time. You will find subsequent backups now will be far quicker now the first one has been done. Not much you can do to speed it up as its just the upload speed.
Hi Spaceinvader. I'm using Duplicati to backup a share to another server on the same internal 1GB home network. I tried it using both unencrypted and encrypted and both the same speed. I'll keep trying to see if I can get some different results. Thanks again for your unRaid videos. They really do help a lot. God bless.
Hi Paul. No, we don't have zfs on unraid. I personally don't like zfs due to having much ram it requires and other reasons. But of course, many people are very happy using zfs. But also worth reading this louwrentius.com/the-hidden-cost-of-using-zfs-for-your-home-nas.html
Thanks Guys glad you liked the intro. My attempt at humour! The music is from here freemusicarchive.org/music/Rolemusic/Rolemusic_-_Singles_1090/La_la_triroriro_1770
Glad you like the vid. Yeah, I think the music wasn't quite right too! :) Was a bit repetitive and overpowering. Sometimes I just kind of experiment and it seems a good idea at the time!
Hi Fred. Its still there on CA. Please make sure that you havent accidently spelt the name incorrrectly when searching. Its spelt duplicati Thanks for watching :)
I don't think that you can get it to start at midnight and stop at 9 am. But what you could do is to schedule the backup to start at midnight on a given day then repeat every week etc. Then it will start at that same time. The problem is you would have to manually pause it if it hasn't finished by 9 am. However, once the backup is done the future backups should be really quick as only changed files will be included. If you are thinking you want to backup the whole server and the first backup will take a long time I would make backup jobs for each share and do that way and only go onto the next when one is completed.
No you dont need an unRAID box to restore, you can download the files from the cloud then unencrypt them on a windows PC with aescrypt. But the easiest way is just to export the backup job keep that file safe.Then import it to another duplicate install on windows if you need to, then restore the files you want down to the windows box. Then you don't have to download everything then unencrypt to get the files you want :)
Ha lol, yeah you probably right> :) I just have to use anything without copyright else youtube takes the video down but maybe should have used something else !
6 years later, still a great tutorial. You are amazing!
Take it from me friends. Family went through a house fire. I LOVE the security a NAS brings, but offsite backups are so important.
Excellent walk through. Much appreciated. Please keep up the great work with Unraid.
Thanks for the video! Regards from Chile.
That clicky keyboard sounds awesome... mmmm mechanical. Great video as always! Gonna try it out sometime this week.
Thanks David, Duplicati is a great piece of software. And yeah i love my keyboard... and i love flashing lights and the keyboard has that too, bonus, lol !!!
Hahaha I know how that feels; I got myself the corsair k70 rgb with cherry reds. As someone who used to boot from 5.25 floppy on an eye blinding green monitor, the clicking of these keyboards take me back to the days of old!
Ah the k70 RGB is a nice keyboard. I would prefer that one to mine a razer black widow chromo. Yeah, it's funny a lot of people don't realise that mech keyboards have been around for years. A lot of the old keyboards out living the computers they were made for!
Another awesome video Ed! a few weeks back i picked up a Unraid pro license when they asked where i herd of unraid from i said "Spaceinvader one" Thank you for always sharing with us!💖👌👍😎JP
+1 for the 8bit audio. Love it!
thank you for this video, this is exactly what I've been looking for to protect my important data on my unRAID server
Thanks for this video. I did some quick checks on my server and it works great. I’m now testing a 70GB Dropbox upload which should be fun.
Also, great tip for how to avoid using the small docker folder for large file splits. I have image files to upload to Dropbox and I want to minimise file counts (bigger splits) for ease of use. Your temporary folder on the bigger cache SSD should hopefully help me, thanks.
btw dont know since when, but in the actual duplicati container build you can specify the tmp folder for backups during the docker installation. you dont need to specify any dedicated host path afterwards
You just clicked "Remove" on it?
remember him this year again :)
This docker seems to be broken as of Feb/2021. The webui appears to be started but whatever browser is used just endlessly tries to access it with no luck.
Thanks. gonna try this. Another great vid. Sorry about your dog. Keep up with the vids. I look forward to whats comming next. And thanks for answering my question last time. Plex with SMB share and Sab with SMB off a synology works perfect now 😁
Thanks, Awoody002. Glad you got it all working :)
just sent u a donation thru paypal to say thanks and encourage ya to keep going
Ah thanks so much for the donation it is really appreciated :)
Duplicati certainly looks interesting, but I do think I personally prefer CrashPlan. I have that set up so that all my PCs/Macs backup to the Unraid server + cloud, and the server backs itself up to the cloud. The cloud backup ofcourse isn't free, but with unlimited storage I think it's a pretty good deal when you have multiple terrabytes to backup (even though the upload speed leaves quite a bit to be desired, the data is still recoverable)
Yeah, crash plan is great too. Both Duplicati and CrashPlan support client-side encryption which is a must in my opinion.
But the only thing with CrashPlan cloud, is that your backups become locked-in into their online storage plans that are more expensive than competing generic cloud storage providers that people may already have. I really like using my amazon cloud drive with the mac desktop client, Rclone on unRAID and Duplicati on unRAID, plus I have set up Duplicati on various family members computers backing up to my amazon account.
But my MacBook uses CrashPlan to backup to the unRAID server but I may change that I'm not sure. So far all has been good. But then if my amazon account ever became locked there would be a lot of eggs in one basket!!
Thanks for the video. I had planned on going with crash plan but they no longer offer home based stuff. only enterprise. I'm kind of glad that didn't work out for me as I like the flexibility of this. trying to get it all set up on my nas now. Is there a max upload size on this? my large uploads seem to freeze.
Miss path: Container Path: /tmp. Not in the video. Perhaps is a old version of Duplicati in this guide?
Same issue here.
Great video and I'm thinking of putting my old NAS at my home to function as an off-site backup for my office server. Does this SMB-thing work for that, or would I need a VPN or other form of tunneling for that?
Is there a way or an option to copy from amazon cloud to my unassigned drive on my unRaid? I would like a weekly one way copy from amazon to my local drive. Thanks
Thank you for great video. I’ve just setup a backup to Google drive and done a backup. Just a question, if something happened to my unraid server (eg fire). Would I be able to setup a Duplicati instance on a windows machine or built a new unraid server. Will I be able to do a restore the backup from google drive?
From the looks of it, you need to export the config files for each backup you set up, and store them separately from your automated backups. Then if you have to set up a new server, once you have everything configured and duplicati installed again, when you go to set up your backups select "import from file" and import all your configs to the new server one by one.
Thank You SI-1 for another great video! I have been experimenting with Duplicati on my Unraid Server. So I have my backups going to a local Synology Box located in another building on my property. In the event of an Unraid server total loss(fire or water damage), how would I recover my data? Are you assuming that I am also backing up my AppData? I am just wondering where Duplicati keeps track of these Encrypted Backups. How would I recover my data using another UnRaid Server assuming that I have a valid Encryption Key?
Duplicati on my windows 10 hangs on "verifying backend data" 😕
Is there an updated version of this video with the changes Crashplan has made to subscription options?
Now that crashplan home is shutting down Duplicati looks like an interesting option for peer-to-peer backup.
But I want to backup from remote windows to an unraid server, best as far as I know would be over sftp, but I don't want to use the root user. How can I setup any user on unraid to use ssh?
I know this is an old video, but this problem has persisted for years. On large backups, duplicati always hangs multiple times. When backing up less than 1TB, it works perfect. But multi TB backups will just stop. It looks good for a few days, then the upload just stops and never starts up again. Stopping the docker and restarting it allows the upload to restart where it left off after if verifies the backend, and checks each individual file (which also takes a while). I have looked on unraid and duplicati sites, and no one seems to know why this happens.
Does this still work or is it still the recommended option? I was looking at something like Syncthing or Resillio but I can't find an unraid tutorial
Would backing up a very large folder have any implications when backing up to the cloud? We are a 500GB folder which contains a lot of programs and installer we wouldn't want to lose. Obviously it would take a considerable amount of time to upload, but would the Duplicati docker be able to handle it?
Great Video... my condolences about your dog... i lost mine 2 years now, and i still get some tears of sadness... =(
can you do a video regarding cpu usage on Dockers ? i read on limetech something about it, but i think i did something wrong...
Yeah thanks, Mikael. He was a great dog.
I am doing a video about performance tweaking on unRAID which will include docker container CPU isolation, VM CPU tweaks and disk io tweaks etc.... May even be this weekend's video depending on how busy I am at work :)
thats good to know... if there is anything that i can help with, let me know... i can give you access to my server for test purposes
Great video! I can’t seem to be able to connect remote share on another test unraid server. It shows the server in the setup but nothing for the shares so put the share name manually. Then when I mount the share it thinks for a bit, screen refreshes and it doesn’t mount. Is there a way to somehow test the connection? I can connect to all shares using my Mac. Thanks for any insight!
Got it to work through adding it as NFS share. SMB still does not work for me. You have to go into shares (on the unraid system you want to connect to) go to the settings for that share and enable NFS. Then you should be able to list the shares in unassigned devices add remote share dialog box. Found this fix with Spaceinvader One's video Unraid Shares in Depth PT1. Thank you Spaceinvader One!
Hey Gridrunner, I had a quick question related to the incremental/block based backups you mentioned at the end of the video. How might I go about running scheduled backups of the same data over different periods of time. IE-Daily, Weekly, and Monthly backups. Right now I have it setup with 3 separate backups having differently named suffixes, all pointing to the same source and destination folders, and scheduled as indicated previously. Is this the right way to go about getting my spaced interval backups, or is there a better way to go about this? Thanks as always for all your great information and videos!
Hi, yes that will be absolutely fine
Great naming theme for your network!
Lol, Yeah got to love transformers. Servers are called Prime and Megatron but wifi networks are Autobots on the 2.4gz and Decepticons on the 5gz 😄
Hi there love your videos but ..... they are outdated. Tried to follow this vid and can't finish installing duplicati because in the new version there is a new path that is not in yours. It's called host path 2 and its displayed to mount to container path /tmp. Duplicati tells me to fill out this path but I dont know what to put there
Little late with the reply, but I would suggest mapping it to a folder on your cache drive. for me that looks like /mnt/cache/tmp
I get a popup when trying to select to add a remote smb/nfs share. Clicking NEXT does nothing. I do have Unassigned Device installed. This is the Popup note: : Note: Dockers will not be able to access any SMB or NFS share until you restart the Docker service after the device is mounted. Be sure to add a Docker path mapping the SMB or NFS share as 'RW/Slave' or 'RO/Slave'.
Go to Settings->Docker and disable then re-enable Docker.
We need more of your dog pics in future videos.
Zoolz are currently giving away 100GB lifetime storage but I can't see that there is proprietary support in this video for it?
Are you still using Duplicati? Are you still happy with it? It doesn't have a very good reputation hence I'm a bit scared using it for my important backups.
Thank you for another great unRaid tutorial. I went ahead and installed Duplicati on my unRaid server and it's working great. The only issue is the speed. I have it setup to backup about 1 TB of data to a share on another server. The backup job took a long time, more than a week. Do you have a any tips on how to speed this up? Thank you again.
Hi Harry. Wow yeah thats a long time. You will find subsequent backups now will be far quicker now the first one has been done. Not much you can do to speed it up as its just the upload speed.
Hi Spaceinvader. I'm using Duplicati to backup a share to another server on the same internal 1GB home network. I tried it using both unencrypted and encrypted and both the same speed. I'll keep trying to see if I can get some different results. Thanks again for your unRaid videos. They really do help a lot. God bless.
Do you have setup ZFS file system on unraid? I can't find anything online about setting it up on unraid.
Hi Paul. No, we don't have zfs on unraid. I personally don't like zfs due to having much ram it requires and other reasons.
But of course, many people are very happy using zfs. But also worth reading this louwrentius.com/the-hidden-cost-of-using-zfs-for-your-home-nas.html
I wonder how secure it is exposing SMB to the internet and sending your data too
Nice intro!
yes loving the intro. chiptunes music cool too is that c64
Thanks Guys glad you liked the intro. My attempt at humour! The music is from here freemusicarchive.org/music/Rolemusic/Rolemusic_-_Singles_1090/La_la_triroriro_1770
Any plans on doing a video on Organizer and letsencrypt docker? With Sonarr/Radarr/Plexpy ect? :)
I could do without the music on the whole video. Just sayin. Great Video and information. Thanks Joe
Glad you like the vid. Yeah, I think the music wasn't quite right too! :) Was a bit repetitive and overpowering. Sometimes I just kind of experiment and it seems a good idea at the time!
Looks like Duplicate no longer installs directly from the Community Apps. Any advice on how to install it now?
Hi Fred. Its still there on CA. Please make sure that you havent accidently spelt the name incorrrectly when searching. Its spelt duplicati Thanks for watching :)
Is there a way to make duplicati backup your files say for example between 12pm and 9am?
I don't think that you can get it to start at midnight and stop at 9 am. But what you could do is to schedule the backup to start at midnight on a given day then repeat every week etc. Then it will start at that same time.
The problem is you would have to manually pause it if it hasn't finished by 9 am. However, once the backup is done the future backups should be really quick as only changed files will be included.
If you are thinking you want to backup the whole server and the first backup will take a long time I would make backup jobs for each share and do that way and only go onto the next when one is completed.
Is there something you could use to browse the .aes files on a Windows system?
Just curious whether the restore relied on having a working unRaid box.
No you dont need an unRAID box to restore, you can download the files from the cloud then unencrypt them on a windows PC with aescrypt.
But the easiest way is just to export the backup job keep that file safe.Then import it to another duplicate install on windows if you need to, then restore the files you want down to the windows box. Then you don't have to download everything then unencrypt to get the files you want :)
The music ruins the video for me. Makes it hard to watch even though I desperately want to watch the great information!!
Right? ... WRONG! xD
Terrible music
Ha lol, yeah you probably right> :) I just have to use anything without copyright else youtube takes the video down but maybe should have used something else !