So very helpful! I spent a few hours today trying to figure out how to do EXACTLY this. Tom helped me solve the transfer problem in 10 minutes. Thank you so much for all you do!
Thats great to know! I just went through the process of switching all of my client backups from Synology to my SCALE box to using rsync over SSH, which is a good bit more of a pain to setup with hyperbackup
I have two remote offices pushing files to a main office using rsync over a vpn. The servers are windows systems using cygwin. I tried syncing files with built-in windows options like dfs replication in the past, but it had lots of issues. Rsync works and it's very efficient.
Great video, thanks! I was already able to successfully create the first backups with Synology. But when I want to restore folders and files, only folders are restored successfully. I get an error saying I don't have rights to restore the files. The user can create files manually without any problems. Do you have any idea what it is?
Thanks for the video and for pointing out the Data Protection >> Rsync is for connecting (mainly) to a different non Truenas Rsync server while the app in the video is for setting up a server for other servers to talk to. I think you are the first to actually point this out.
I think rsync is also useful when you have 2 (or more) independent TrueNAS systems synching live data with each other. Data that is being updated on both (or all) of the TrueNAS systems by users of those independent systems. I feel like TrueNAS replication is more of a back-up-my-data-to-a-redundant-system kind of thing and isn’t meant for synching live data in both directions.
I've figured out how to do this with Synology and TrueNAS Scale being on the same network, but how do you get it work when the TrueNAS scale computer is at a different location? I have TailScale installed on the Synology and the TrueNAS Scale computer. I can ping the TrueNAS Scale computer from my Synology console, but when using HyperBackup, the IP address just will not connect.
could you show how to pull data from a rsync-compatible server using rsync tasks in truenas? i have a headache with an old device that does run as a rsync server - i just cant get truenas to pull from it
I ran into an issue with the new sync app on existing dataset. I couldn't get the file in the existing dataset to transfer from Truenas Scales to non Truenas NAS?
It would be nice to get a video covering the best option(s) for setting up cloud backup of a TrueNAS Scale device (maybe I've just missed it but I don't think so). Is it something built in? Borg/Dupicati/etc? Some sort of Backblaze service or is there something better out there? Any special considerations for encryption during transfer and at rest? Any special considerations for only backing up diffs vs all of the data again? What's the restoration story for the described solution? It would just be nice to get a good jumping off point because there are a lot of different products and services out there and it's hard to know what the differences are and what needs to be considered.
I need to make a new one due to changes, but I do have a video on using Backblaze with TrueNAS th-cam.com/video/jc7bUFBl4RQ/w-d-xo.htmlsi=D6PvDaFRVBhgzLjV
I backup my TrueNAS core to an offsite TrueNAS box via ZFS replication. I also backup to BackBlaze B2. I consider the offsite TrueNAS as the “1st backup”. I.e., this is where I would restore from. But I also do B2 to comply with the 3 backup rule. I haven’t explored the other options you mentioned, but I can share that my experience with Backblaze has been fantastic
If I had been using the "old" module to rsync to the server with either cygwin's rsync, or a regular linux rsync client, as a backup service (hint: I was!) and I update now to the new "app" rsyncd, what changes (if any: port #?) do I need to make to my rsync command line?
What about the user rights ACL’s if I’m going from SynOlogy to Trunenas scale? can sync copy over the ACL’s? I assume that the usernames/ passwords have to be the same on both nas’s/file systems?
After a conversation on the Truenas forums it appears that the rsync debacle is a little more confusing than originally anticipated. 1. The rsync service under System >> Services is being/has been deprecated. I thought this services was a prerequisite to use the rsync tasks setup but it isn't. 2. The Data Protection >> rsync tasks are remaining and will continue to function in the future. 3. rsyncd as a separate docker application is also available. When iXSystems stated that rsync was being deprecated, I though that EVERYTHING related to rsync was being removed and there was no option but to use the docker app but this is not the case. rsync is and will remain available in the Data Protection tab therefore, I have no use for the docker app. Not a great explanation from iXSytems for this in my opinion.
I think Truenas scared the bejeasus out of everyone when announcing "we have depreciated Rsync and will remove it in a future update. I get it, they are programmers and relate to code better than people sometimes. It should have been as easy as "the service >> Rsync has been depreciated and will be removed in a future update. If you want to push/pull data from an external non Truenas Rsync server then setup a Data Protection >> Rsync task with ssh. If you want to connect an external server to Truenas Rsync and push data to Truenas from an external server then use the Application >> Rsync and setup a module.
Thanls Tom. I was waiting for this video before I even updated my TrueNas Scale to Cobia, as didn't want to stress out working it out as it was already working to backup my Synology. I had stupidly set up each dataset as the same share name in Synology, and therefore I had a lot of modules to create which was tedious. Do you know how I could move all the datasets, as children of a another dataset, this way I could just have 1 module instead of the dozen or so I have now??
My rsync is not working. Also, can't get the app to work. I wish they would leave things alone sometimes!!!!!!! rsync was working great for my use case.
@@LAWRENCESYSTEMS it worked! had a tiny bug where my syno has 2 lan ports, so 2 IP, and somehow it let me find the rsyncd module (allowing one IP) with hyperbackup but didn't let me get past the apps to the final fold part later, saying no connection, without allowing both of my syno IPs on the rsyncd settings. This is great! thank you!
@@LAWRENCESYSTEMS Thanks for getting back to me so quickly. I rewatched the video again and realized that I skipped a step when I created the dataset in TrueNAS Scale. My next attempt to use your method was successful. Thanks again for this video and sharing your knowledge!
You don't seem to understand the why behind this. Moving services from the core of OS build allows them the update them more frequently and allows an app to be updated without a full OS update.
I would not be using rsync modules anymore. There is a reason they do not want it in their code/responsibility. Now, rsync over ssh is ok, secure and the only way, if you still need this old technology.
Hi, can you explain more about the issue with rsync modules? What is not secure about them (other than not being encrypted, but that can be added through hyper backup)? SSH seems liked unnecessary overhead to me, but wondering why you think it is preferred.
So very helpful! I spent a few hours today trying to figure out how to do EXACTLY this. Tom helped me solve the transfer problem in 10 minutes. Thank you so much for all you do!
Thats great to know! I just went through the process of switching all of my client backups from Synology to my SCALE box to using rsync over SSH, which is a good bit more of a pain to setup with hyperbackup
I have two remote offices pushing files to a main office using rsync over a vpn. The servers are windows systems using cygwin. I tried syncing files with built-in windows options like dfs replication in the past, but it had lots of issues. Rsync works and it's very efficient.
Great video, thanks! I was already able to successfully create the first backups with Synology. But when I want to restore folders and files, only folders are restored successfully. I get an error saying I don't have rights to restore the files. The user can create files manually without any problems. Do you have any idea what it is?
Thanks for the video and for pointing out the Data Protection >> Rsync is for connecting (mainly) to a different non Truenas Rsync server while the app in the video is for setting up a server for other servers to talk to. I think you are the first to actually point this out.
I think rsync is also useful when you have 2 (or more) independent TrueNAS systems synching live data with each other. Data that is being updated on both (or all) of the TrueNAS systems by users of those independent systems. I feel like TrueNAS replication is more of a back-up-my-data-to-a-redundant-system kind of thing and isn’t meant for synching live data in both directions.
Been trying to figure out how to move dats back from a backup truenas to a primary truenas
I've figured out how to do this with Synology and TrueNAS Scale being on the same network, but how do you get it work when the TrueNAS scale computer is at a different location? I have TailScale installed on the Synology and the TrueNAS Scale computer. I can ping the TrueNAS Scale computer from my Synology console, but when using HyperBackup, the IP address just will not connect.
could you show how to pull data from a rsync-compatible server using rsync tasks in truenas? i have a headache with an old device that does run as a rsync server - i just cant get truenas to pull from it
I ran into an issue with the new sync app on existing dataset. I couldn't get the file in the existing dataset to transfer from Truenas Scales to non Truenas NAS?
It would be nice to get a video covering the best option(s) for setting up cloud backup of a TrueNAS Scale device (maybe I've just missed it but I don't think so). Is it something built in? Borg/Dupicati/etc? Some sort of Backblaze service or is there something better out there? Any special considerations for encryption during transfer and at rest? Any special considerations for only backing up diffs vs all of the data again? What's the restoration story for the described solution? It would just be nice to get a good jumping off point because there are a lot of different products and services out there and it's hard to know what the differences are and what needs to be considered.
I need to make a new one due to changes, but I do have a video on using Backblaze with TrueNAS th-cam.com/video/jc7bUFBl4RQ/w-d-xo.htmlsi=D6PvDaFRVBhgzLjV
I backup my TrueNAS core to an offsite TrueNAS box via ZFS replication. I also backup to BackBlaze B2.
I consider the offsite TrueNAS as the “1st backup”. I.e., this is where I would restore from. But I also do B2 to comply with the 3 backup rule.
I haven’t explored the other options you mentioned, but I can share that my experience with Backblaze has been fantastic
How do I do this the other way around? Backing TrueNAS to Synology?
Not quite as simple, enable Rsync on Synology and setup SSH keys and permissions. Maybe I will make a video on that as well.
This would be amazing@@LAWRENCESYSTEMS
Thank you! This video was very helpful and now my synology is backing up to my TrueNAS box
If I had been using the "old" module to rsync to the server with either cygwin's rsync, or a regular linux rsync client, as a backup service (hint: I was!) and I update now to the new "app" rsyncd, what changes (if any: port #?) do I need to make to my rsync command line?
What about the user rights ACL’s if I’m going from SynOlogy to Trunenas scale? can sync copy over the ACL’s? I assume that the usernames/ passwords have to be the same on both nas’s/file systems?
Fantastic. Just what i was searching for 🙂
In Synology, I have message no answer from destination.
They are on same network, without ip restriction for now.
So don't work for me 😢
After a conversation on the Truenas forums it appears that the rsync debacle is a little more confusing than originally anticipated.
1. The rsync service under System >> Services is being/has been deprecated. I thought this services was a prerequisite to use the rsync tasks setup but it isn't.
2. The Data Protection >> rsync tasks are remaining and will continue to function in the future.
3. rsyncd as a separate docker application is also available.
When iXSystems stated that rsync was being deprecated, I though that EVERYTHING related to rsync was being removed and there was no option but to use the docker app but this is not the case. rsync is and will remain available in the Data Protection tab therefore, I have no use for the docker app.
Not a great explanation from iXSytems for this in my opinion.
I think Truenas scared the bejeasus out of everyone when announcing "we have depreciated Rsync and will remove it in a future update. I get it, they are programmers and relate to code better than people sometimes.
It should have been as easy as "the service >> Rsync has been depreciated and will be removed in a future update. If you want to push/pull data from an external non Truenas Rsync server then setup a Data Protection >> Rsync task with ssh. If you want to connect an external server to Truenas Rsync and push data to Truenas from an external server then use the Application >> Rsync and setup a module.
Perhaps it Replication had an option to sync data both ways (i.e. Source/Target being r/w) rsync would be laid to rest.
Thanls Tom. I was waiting for this video before I even updated my TrueNas Scale to Cobia, as didn't want to stress out working it out as it was already working to backup my Synology.
I had stupidly set up each dataset as the same share name in Synology, and therefore I had a lot of modules to create which was tedious. Do you know how I could move all the datasets, as children of a another dataset, this way I could just have 1 module instead of the dozen or so I have now??
My rsync is not working. Also, can't get the app to work. I wish they would leave things alone sometimes!!!!!!! rsync was working great for my use case.
If I will migrate my data from Synology to a home built truenas, is this the best way to get it over?
Yes
@@LAWRENCESYSTEMS it worked! had a tiny bug where my syno has 2 lan ports, so 2 IP, and somehow it let me find the rsyncd module (allowing one IP) with hyperbackup but didn't let me get past the apps to the final fold part later, saying no connection, without allowing both of my syno IPs on the rsyncd settings. This is great! thank you!
This method did not work for me. Has TrueNAS or Synology changed something since this video was released?
Not that I know of
@@LAWRENCESYSTEMS Thanks for getting back to me so quickly. I rewatched the video again and realized that I skipped a step when I created the dataset in TrueNAS Scale. My next attempt to use your method was successful. Thanks again for this video and sharing your knowledge!
Ive always used Syncthing, to sync up my backups, is there an advantage using Rsync over syncthing?
Rsycn is more for copying files from one place to another, not syncing them
Appreciate the video. Come across Synology devices often and another backup option is always good to have.
can you do this over tailscale
I have not tested, but should work.
I was able to send files from AS202TE Nas to Truenas , but I can't send files from my Truenas Scales server ?
Yes, it should work using the option under Data Protection and under Rsync Tasks
I am confused by your comment about rsync being deprecated on TrueNas. what does that mean and will all the things in this video be unavailable soon?
Rysnc has been deprecated, this is the new way to run Rsync in TrueNAS Scale.
@@LAWRENCESYSTEMSwhat does that mean for scale?
Is there a good way of doing this when the truenas Server is in a different Network?
VPN or use your firewall to allow the rsync traffic.
Thank you SO MUCH Tom! You're the best.
Is there a betting pool on what they gonna cut next, maybe ntp, who needs accurate time anyway? /s
You don't seem to understand the why behind this. Moving services from the core of OS build allows them the update them more frequently and allows an app to be updated without a full OS update.
@@LAWRENCESYSTEMSyes, I still fail to understand it
Tailscale would have been a good option for security.
Thanks for the video.
good video - thanks
You glossed over setting up an rsync task. Using Rsync on localhost doesn't work.
As I show in the video, use the IP of the TrueNAS when setting up the Synology RSYNC task
So if I get you you juste need a mega cab 😊🤷♂️
It’s going to take me some time to get used to the new ad read…
I had Brett (he has been on the channel many times) do the read. He has great voice for it as he does do pro VO work.
I would not be using rsync modules anymore.
There is a reason they do not want it in their code/responsibility.
Now, rsync over ssh is ok, secure and the only way, if you still need this old technology.
Hi, can you explain more about the issue with rsync modules? What is not secure about them (other than not being encrypted, but that can be added through hyper backup)? SSH seems liked unnecessary overhead to me, but wondering why you think it is preferred.