Proxmox Backup Server Saves You Money And Time!

แชร์
ฝัง
  • เผยแพร่เมื่อ 1 ก.ค. 2024
  • Move away from manual backups in Proxmox VE, and use Proxmox Backup Server instead. The use of deduplication means that you'll save valuable space and time when performing backups.
    In this video I'll show how to deploy Proxmox Backup Server, how to mount an SMB share from TrueNAS, and how to integrate it into your existing Proxmox VE to backup your VMs.
    Video Commands:
    github.com/JamesTurland/JimsG...
    Recommended Hardware: github.com/JamesTurland/JimsG...
    Discord: / discord
    Twitter: / jimsgarage_
    Reddit: / jims-garage
    GitHub: github.com/JamesTurland/JimsG...
    00:00 - Introduction to Proxmox Backup Server & backup practices
    02:34 - Download Proxmox Backup Server
    06:06 - Create VM & Installation
    11:25 - Proxmox Backup Server Web GUI
    12:44 - Adding CIFS for SMB Mount
    20:24 - Using the SMB Mount in Proxmox VE
    24:18 - Outro
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 188

  • @rickhernandez2114
    @rickhernandez2114 7 หลายเดือนก่อน +33

    Do you live in one of the rooms in my house?
    More than once I'm working on setting up something in my home lab, and either that day or the next day you drop a video on *EXACTLY* what I'm working on.
    This is truly the most complete, thorough, and easy to understand channel on the internet, bar none.
    Nice job Jim.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      Haha, spooky! Thanks for the feedback, I really appreciate it.

    • @i.p.knightly149
      @i.p.knightly149 7 หลายเดือนก่อน +7

      Make sure to feed him once in a while.

    • @tollav
      @tollav 3 หลายเดือนก่อน +1

      Check the cupboards. He looks flexible, maybe in there??

  • @maxg4958
    @maxg4958 2 หลายเดือนก่อน +3

    This must be one of the best channels when it comes to setting up things. Well explained, any omissions corrected. Easy to follow. Very comprehensive. I love it. Thank you.

    • @Jims-Garage
      @Jims-Garage  2 หลายเดือนก่อน

      Appreciate that, thank you!

  • @jeffrisdon2803
    @jeffrisdon2803 7 หลายเดือนก่อน +2

    Thanks for this! Could never figure out how to get this to work with my truenas shares...until I saw this video!! Exellent! Thank you!

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      You're welcome, glad it helped

  • @yanickg
    @yanickg 7 หลายเดือนก่อน +1

    Nice one! Worked on the first go. Will re-use the smb share/ credentials method for my plex vm server. Thanks!

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Great, thanks.

  • @chrisumali9841
    @chrisumali9841 7 หลายเดือนก่อน +1

    Thanks for the demo and info, have a great day

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Thanks, you too!

  • @JorgeGarciaM
    @JorgeGarciaM 7 หลายเดือนก่อน +1

    HA! Brilliant! At last someone explaining the benefits of the PBS and the step-by-step configuration. Thank you, Jim!

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Thanks 👍

  • @JPEaglesandKatz
    @JPEaglesandKatz หลายเดือนก่อน +1

    Your videos are absolute amazing... Detailed and accurate and helpful!!!

    • @Jims-Garage
      @Jims-Garage  หลายเดือนก่อน

      Many thanks, appreciate the feedback 🙂

  • @CraigGivant
    @CraigGivant 7 หลายเดือนก่อน +3

    I have been running PBS for awhile now and was never able to get the storage located on a network drive. Your Mount and FSTAB commands were just what the doctor ordered and I was able to successful create a VM and mount the storage to my NAS. I can now get rid of the outdated Unraid container I had resorted to. Thanks for this!

    • @Jims-Garage
      @Jims-Garage  6 หลายเดือนก่อน

      Great, that's good to hear.

  • @Muddysmind
    @Muddysmind หลายเดือนก่อน +2

    Very well done, thanks. Easy to follow, no fluff, calm, well thought out.

    • @Jims-Garage
      @Jims-Garage  29 วันที่ผ่านมา

      Much appreciated!

  • @-rm-rf
    @-rm-rf 7 หลายเดือนก่อน +2

    Perfect timing as alway 😂 I will definitely look to set this up asap when I have my network figured out 😅

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      Psychic Jim strikes again 😂

    • @-rm-rf
      @-rm-rf 7 หลายเดือนก่อน

      @@Jims-Garage with scary accuracy

  • @BromZlab
    @BromZlab 7 หลายเดือนก่อน +2

    Verry good Jim! Yet again an easy to follow guide.. This is verry useful

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Thanks, glad you found it useful.

    • @brianhansen9578
      @brianhansen9578 7 หลายเดือนก่อน +1

      @@Jims-Garage why samba over NFS for backend ?

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      @@brianhansen9578 I prefer the security and role based access controls (NFS isn't as feature rich in this area).

  • @PaulShadwell
    @PaulShadwell 5 หลายเดือนก่อน +1

    Thankyou for this, very helpful. I just set this up for my initial demo setup. Incidentally, I had to switch the SMB mount to v2.0 as it seems neither my Unraid server nor my Synology NAS support SMB v3.0 yet.

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน

      Interesting, are you able to update the Synology? SMBv2 suffers from Wannacry Zero Day, not sure exposed you are on a non-Windows machine.

  • @White2115Fangirl
    @White2115Fangirl 7 หลายเดือนก่อน +2

    That’s a helpful video man!

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Glad it was helpful!

  • @jaymax97
    @jaymax97 7 หลายเดือนก่อน +1

    Took me a while to get it working, but I had to just create a new user on my synology for it to work! Thanks for the video

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Great, good job 👍

    • @jenniferw8963
      @jenniferw8963 20 วันที่ผ่านมา

      I so want to do this. add antoher 8gb RAM module to my Synology nas and run PBS in a VM. All the fast storage and snapshots are already there. Why get more hardware?

  • @jig1056
    @jig1056 5 หลายเดือนก่อน +2

    This is awesome. I'm an XCP-NG user but thinking of switching to Proxmox because I can't back up XCP-NG VMs when I have a physical USB device connected. I never really liked Proxmox but it's growing on me. I didn't really understand the point of have a backup server when I could have just used network storage to back up directly from my PVE server. This totally changed my mind, I really get it now. Your video was easy to follow, it worked like a charm. I have it running on my test box. We'll see if I convert to Proxmox. You may have gone a long way in helping me make a decision. Thanks

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน

      Thanks, really appreciate the feedback

  • @ozmosyd
    @ozmosyd 7 หลายเดือนก่อน +2

    Was pondering on the PBS for a while. Your breakdown here has cleaed/answered, any questions and doubts about giving it a spin.
    Thanks for sharing.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      You're welcome 😁

  • @Glatze603
    @Glatze603 7 หลายเดือนก่อน +2

    I use PBS as backup target for some other linux-based machines. For this I installed the PBS-Agent on these machines and can then backup them with cli commands.

  • @dzmelinux7769
    @dzmelinux7769 4 หลายเดือนก่อน +1

    Great video 👍 especially without background noise 🤔🤨😳😲😉

  • @cheebadigga4092
    @cheebadigga4092 7 หลายเดือนก่อน +8

    Note about the "Disks" section when creating a VM: Always use SSD Emulation together with Discard to enable trim support awareness of the VM on the hypervisor level.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +2

      Thanks, useful tip 💯

    • @cheebadigga4092
      @cheebadigga4092 7 หลายเดือนก่อน +1

      @@Jims-Garage I'm not sure how exactly this interoperability between the VM and the hypervisor works, but there are some blog posts spread across the internet about it. AFAIK the Promox wiki doesn't necessarily say anything about it. But what I personally found was that the GUI, especially the storage graphs "know" the correct size of the VM disk after trimming when Discard is enabled. It wouldn't work otherwise which confused me, so I always enable both lol

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      @@cheebadigga4092 thanks, I'll check mine out this evening with it enabled.

  • @hmeland1
    @hmeland1 หลายเดือนก่อน

    If you go into Datacenter -> Storage -> Local. You can edit the "content" of that storage and remove the option to store backups on "local" storage. Hence no longer needed to choose between storages in any drop-down menus.

  • @LampJustin
    @LampJustin 7 หลายเดือนก่อน +9

    07:00 in fact you should always use the q35 machine type. It's much newer and more efficient. The i440fx platform didn't even have PCIe, yes, it's that old...
    07:50 while that is true with physical hardware, when you use a VM you also have to enable discard to be able to free up the reclaimed space.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      Thanks for the added details

  • @CoolWolf69
    @CoolWolf69 7 หลายเดือนก่อน +3

    PBS is really a great tool. I am using my main PBS on bare metal and started last weekend playing around with a virtualized 2nd PBS on PVE which I am planning to run remotely and which then syncs (pulls) the datastore from my main PBS to the remote site for another layer of data(store) protection 🙂
    As datastore I am using a 1TB iSCSI disk which is hosted on my TrueNAS system (and of course snapshotted and replicated to a backup TrueNAS server). I have currently a Deduplication Factor of 15.13 so my datastore looks like it will "never" get full (only 24% used) even if I am backing up 24 CTs and 3 VMs with overall more than 400 Snapshots.
    You gotta love Proxmox and what they are doing with PVE and PBS 👍

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      That's awesome, cool setup!

  • @mankala8
    @mankala8 26 วันที่ผ่านมา +1

    I think you may have described differential backup instead of deduplicationn. I think dedupe goes further - if you have 5 debian vms, dedupe will only store one copy of anything that's the same between the vms (eg app binaries, conf files, copy of your pub key, etc). Dedupe also causes differential backup as a byproduct.

  • @ronm6585
    @ronm6585 4 หลายเดือนก่อน +1

    Nice! Thank you.

    • @Jims-Garage
      @Jims-Garage  4 หลายเดือนก่อน

      You're welcome

  • @yasaralzakout7691
    @yasaralzakout7691 หลายเดือนก่อน +1

    Thanks, Jim. Your tutorials are always clear and very helpful. Have you tried doing the same thing with NFS? I’ve tried it several times, but I keep encountering permission errors!

    • @Jims-Garage
      @Jims-Garage  หลายเดือนก่อน

      Wow, thank you that's extremely generous. I don't use NFS as most of my end user devices are windows. I do have a TrueNAS video that sets up a NFS share, that might be useful?

  • @simonfaulkner5596
    @simonfaulkner5596 7 หลายเดือนก่อน +2

    Cheers Jim, great video, particularly interesting to use a virtual instance, I hadn't thought of that. Just out of interest why did you choose CIFS for the share rather than NFS?

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +2

      Thanks! Cifs is more advanced when it comes to role based access control and permissions (and a few other benefits).

  • @user-ey1mw5cg4m
    @user-ey1mw5cg4m 3 หลายเดือนก่อน +1

    I am not only improving & learning SRE stuff and good practicies but also understanding better London accent.
    I think your best strenght is not the way you speak. It is the speed you speak!

    • @Jims-Garage
      @Jims-Garage  3 หลายเดือนก่อน

      Thanks, I appreciate the feedback. I'm not from London though 😉 Midlands

  • @davechristoffersen6633
    @davechristoffersen6633 6 หลายเดือนก่อน +1

    Great video sir well explained +1 sub

    • @Jims-Garage
      @Jims-Garage  6 หลายเดือนก่อน

      Thanks for the kind feedback and support

  • @pavlovsky0
    @pavlovsky0 7 หลายเดือนก่อน +1

    Here’s a catch-22, how do you backup the TrueNAS? If you lose trueNAS pool your data is gone and your backups! Think about getting an LTO4 or LTO5 tape drive and adding that to your setup and cutting your own offline backup tapes. Also, proxmox backup client is great to backup desktops in your local network. Great video!

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      I backup to Google Drive, checkout my rClone video. Your point is valid though, how many is enough when it comes to backups?

    • @pavlovsky0
      @pavlovsky0 7 หลายเดือนก่อน

      @@Jims-Garage fair enough. Check out a video by a guy with the channel name of apalrds adventures. He does a good breakdown of why backing up to tape makes a lot of sense financially (hint it’s when you pull back data they get you with hidden costs). You have all you need to backup to tapes. You just need an inexpensive sas controller and a cheap used LTO tape drive. I got mine from goodwill (thrift store in United States) for like 45 dollars and I’ve been backing up to tape happily. 3-2-1 self hosted!

    • @mikenorfleet2235
      @mikenorfleet2235 5 หลายเดือนก่อน

      I purchased a tape drive from ebay, looking forward to using it with PBS. Got to get that additional "media" instead of just more hard disks and sdds...i think I may be going overboard? Well nothing feels better than peace of mind.

  • @TrimmerCognition
    @TrimmerCognition 2 หลายเดือนก่อน +1

    Jim. Thanks for all the great videos! They have helped a lot. Regarding the cifs mount, please can you explain the addition of uid=34,gid=34 that you made to the command. Why was this necessary / what does it achieve? Thanks! EDIT- I should have watched the video fully!

    • @Jims-Garage
      @Jims-Garage  2 หลายเดือนก่อน +1

      They're user IDs and Groups, they're necessary for permissions. Basically who owns it and what they can do as part of a group. Without that it doesn't have permission to write/read.

    • @TrimmerCognition
      @TrimmerCognition 2 หลายเดือนก่อน

      @@Jims-Garage Thanks. I just came to edit my comment as I saw you addressed it later in the video. Serves me right for not watching it all through first!

  • @user-vm2bu7hn1i
    @user-vm2bu7hn1i 7 หลายเดือนก่อน +1

    Jim, Great video as always. Just a question, is there's a way to use ProxMox Backup Server with a cloud storage provider to get backups off-site? To have local and cloud backups.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Thanks, I will need to check. The way I do it is to backup my Nas to the cloud using rClone (I have a video on that).

  • @michaelrichardson7277
    @michaelrichardson7277 2 หลายเดือนก่อน +1

    Appreciate the video and step-by-step instructions. May I ask if you have a process for backing up, at a minimum, the configuration of the Proxmox host?

    • @Jims-Garage
      @Jims-Garage  2 หลายเดือนก่อน +1

      Thanks, I don't back up the host per se, but I do export the /pve folder which is pretty much the same thing. I do also run the host on a raid config for redundancy.

  • @FilipeNeto616
    @FilipeNeto616 หลายเดือนก่อน

    As usual, very detailed and helpfull content. However, one doubt arises. How does the pbs prune options and proxmox backup retention works together? Let's say in pbs I configure the datastore to keep last 5, and in proxmox I define a backup with a keep last 10 retention policy. How does that work?

  • @happy9955
    @happy9955 7 หลายเดือนก่อน +3

    Great video, thank you. I'm from Hong Kong, and English is not my native language, but I can hear quite clearly.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      Thanks, I appreciate your feedback 😃

  • @Hombre1968
    @Hombre1968 5 หลายเดือนก่อน +1

    Excellent video, do you have a similar video for restoring a backup?

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน

      No, sorry I don't. It's extremely simple though. Restore backup from PBS storage (select storage in tree, navigate to backups, select a backup and hit restore)

  • @ryanmalone2681
    @ryanmalone2681 หลายเดือนก่อน +1

    I came for the backup tutorial but stayed for the magenta cardigan!

    • @Jims-Garage
      @Jims-Garage  หลายเดือนก่อน +1

      There's a whole ensemble to work through, Jim's Cardigans coming soon!

  • @arronpitman6323
    @arronpitman6323 หลายเดือนก่อน

    I appreciated the prune joke

  • @repairman2be250
    @repairman2be250 7 หลายเดือนก่อน +1

    Thanks for the video. How do you go about to backup your Proxmox installation?

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      I don't, but I do run it on a raid mirror, and I have 2 nodes. You can backup by cloning the pve folder is my understanding

  • @jimmy651
    @jimmy651 6 หลายเดือนก่อน +1

    Thank you

    • @Jims-Garage
      @Jims-Garage  6 หลายเดือนก่อน

      You're welcome 🤗

  • @buzzy_cnayl
    @buzzy_cnayl 3 หลายเดือนก่อน +1

    Great video, thanks. Slightly confused me though as initially your mount was at /mnt/truenas but then when you made it permanent via fstab it got changed to /mnt/test-pbs

    • @genshinimpactjoki5393
      @genshinimpactjoki5393 7 วันที่ผ่านมา

      im confused too, so, u write it using /mnt/truenas or /mnt/test-pbs?

  • @sohail579
    @sohail579 2 หลายเดือนก่อน +1

    Love the way you explain. One question. Is it still ok if my NAS is also on the same host?

    • @Jims-Garage
      @Jims-Garage  2 หลายเดือนก่อน

      Yes, that's fine.

    • @sohail579
      @sohail579 2 หลายเดือนก่อน

      @@Jims-Garage Awesome thanks. have you done a video on restoring from backups? also i noticed you dont really run containers more so VMs is there a reason for that?

  • @jenniferw8963
    @jenniferw8963 20 วันที่ผ่านมา +1

    What do you think about virtualizing PBS on Synology NAS? The fast storage is already there and the snapshots as well. I have a 42TB of storage on my DS1522+. I can add some more RAM as well, for the VM.

    • @Jims-Garage
      @Jims-Garage  20 วันที่ผ่านมา

      That should be fine

  • @bigup7777
    @bigup7777 5 หลายเดือนก่อน +1

    great video, thank you! if pbs is a vm in the proxmox cluster, would you recommend backing that up to itself as well?

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน +1

      You can, but it's probably not needed as it's quick to rebuild

    • @bigup7777
      @bigup7777 5 หลายเดือนก่อน +1

      @@Jims-Garage thanks. Have used the video to backup to unraid server. Works well. Looking forward to the de-dupe! Subscribed!

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน

      @@bigup7777 that's great, thanks 👍

  • @SSBelmont
    @SSBelmont 3 หลายเดือนก่อน +6

    Jim - You failed to mention any details about the use of UID and GID. Is this the user id ang group id of the account on your PBS system on the UID,GID of the user account that owns the SMB on the TrueNas? I think you guys that create these videos fail to realize that a lot of the community isn't as Linux savvy as you guys so explaining the most basic things is very important, especially since so many folks are moving over to Linux from Windows.

    • @JeramiFrost
      @JeramiFrost 15 วันที่ผ่านมา

      As best as I can tell, this is the user “backup” in proxmox. My TrueNas id’s start at 1000 and go up. However, in PBS backup has uid and gid as 34 for user backup. Hopefully this helps someone at some point. I located the uid and gid with the following command in pbs shell “for user in $(cat /etc/passwd | cut -f1 -d”:”); do id $user; done”. Remove the first and last “ mark from the command.
      Edit: after watching the video further, Jim goes over this detail explaining exactly what I found on my own.

  • @dimitristsoutsouras2712
    @dimitristsoutsouras2712 5 หลายเดือนก่อน

    Nice presentation. What needs to be clarified here is this. PBS does the deduplication automatically without any configuration from the user right? The storage though of the PBS isn t owned by him but its a remote one coming from TrueNas. Shouldn t you show or mention that deduplication has to be enabled on the dataset which is then mounted to the PBS? I m pretty sure there is an option at TrueNas when you create a dataset, where you enable or leave it unticked (default option if I can recall) in order for all this you want to accomplish to happen?

  • @mjmeans7983
    @mjmeans7983 หลายเดือนก่อน

    Does the deduplication work across multiple client machines? Scenario: I have a dozen client machines that are all nearly identical, but very large. Some very large files that rarely change, and when they do they change in small ways that may not be common between the clients. Some clients will also have some large static files that never change. When backing up all the clients, will whatever files that happen to be common between them be deduplicated in the overall backup storage? i.e. Not just deduplicated within each machine's history, but deduplicated across all histories of all machines in the datastore?

  • @facetofaceid
    @facetofaceid หลายเดือนก่อน

    I think that to activate trim you should have selected "Discard", not "SSD emulation". The latter just tells the guest system that it's running on a solid state drive even if it's not.

  • @anthonydelagarde3990
    @anthonydelagarde3990 6 หลายเดือนก่อน +1

    Brilliant video, thank you! Question, I am not clear on the following. If my physical Proxmox server dies with the backup server being virtualized as a procedure building a net new host and importing the pbs vm? Any docs on this. Thank you for your video!

    • @Jims-Garage
      @Jims-Garage  6 หลายเดือนก่อน +1

      Rebuild Proxmox, recreate PBS VM, attach the existing NAS with all your backups. Voila!

  • @mithubopensourcelab482
    @mithubopensourcelab482 6 หลายเดือนก่อน +2

    The other benefit of PBS is that you can restore a individual file if required.

  • @cezaryjuszczyk7269
    @cezaryjuszczyk7269 4 หลายเดือนก่อน

    Can you write how we should create scheduler for backup VM ? Use mode stop or snapshot ?

  • @ttuschak
    @ttuschak 3 หลายเดือนก่อน +1

    would pbs run also in a lxc container? or do we indeed need a vm for that? - thank you for your answer

    • @Jims-Garage
      @Jims-Garage  3 หลายเดือนก่อน +1

      It shoulf work in an LXC, albeit a VM might be a better choice.

  • @Glatze603
    @Glatze603 7 หลายเดือนก่อน +1

    Hi Jim and thanks for this tutorial! With some (not all) CT I have the problem that the backup sems to be 30-50 GB. When I backup the containers on local storage they are only 500-700 MB. Seems that one file tells PBS that it is so big, although it is not.

    • @Glatze603
      @Glatze603 7 หลายเดือนก่อน +1

      I have to correct my comment: the local backup of my ct is 305 MB, if I backup it up to my PBS, my proxmox shows it is 559 GB big and my PBS shows it is 520 GB big (on my PBS I only used503 GB for all backups)?!? Whe I click "file-recovery" I see, that the directory "root.pxar.didx" seems to be 520 GB. I hace this issue with 4 of my 5 CT and till now now solution, so I only use local storage for backup.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      Interesting, I will have to look into that.

    • @Glatze603
      @Glatze603 7 หลายเดือนก่อน

      I hav set up a new PBS as VM and used my truans-share, too, but the result is the same (see above). Seems that backing up lxc to pbs is not the best choice...

    • @Glatze603
      @Glatze603 7 หลายเดือนก่อน

      When I run "zfs get all 'DATASTORE/subvol-MY_LXC_ID-disk-0" on my proxmox, I get "used: 1.37G, available: 6.63G, compressratio: 2.21x" > seems all ok.

  • @tonypilborg
    @tonypilborg 2 หลายเดือนก่อน +1

    Wow @Jim: You are running a 2-node cluster... In itself a little dangerous.
    But then you add than your PBS is running in that cluster!!! If a node goes down in your cluster, it is more likely than not, than you will not be able to start the other node - because it will not start VMs until the cluster is up!
    Now you have the data on your TrueNAS box - but no access to the PBS that owns these data.. Lets keep our fingers crossed that you stored the encryption key safe - and not on something that relies on our cluster being operational :)
    I would always argue that running PBS virtualised is slightly risky, and should only be done if you are certain that is will always be operational.... In a cluster is even more dangerous, but in a 2-node cluster, that is suicidal.. (and then what happened to the 3-2-1 rule??)

    • @Jims-Garage
      @Jims-Garage  2 หลายเดือนก่อน

      Thanks for you comment, all valid points, but points that I am aware of and have prepared for. None of my VMs auto fail over, largely due to passthrough anyway. All keys are backed up and easily accessible when needed. I have extensively tested recovery for VMs and as mentioned in previous videos, I don't really care about VMs, those are quick to fix. What I care about is data, and all of that data is abstracted from the VM and can simply be imported when needed to fresh VMs.
      Eventually I might go triple node.

    • @tonypilborg
      @tonypilborg 2 หลายเดือนก่อน +1

      @@Jims-Garage I wasn't worried on your behalf.... It was more reflecting on the teaching/role model aspect of it.... That some (probably inexperienced) will see the video(s) and replicate, without being aware of these pitfalls :)
      Otherwise - like the video 😎

    • @blinkitogaming
      @blinkitogaming 2 หลายเดือนก่อน

      I’m quite interested on understanding the recovery process with a virtualized PBS instance.
      Actually I just have a Proxmox node with a couple of VMs. Let's say that I do the PBS vietualized way on my node and for some reason one day my node dies.
      Will I be able to spin up a fresh Proxmox node or a PBS fresh install rather as a VM or a barebone, configure the SMB storage and that way restore those backed up VMs?
      Or will they be somehow linked to the first PBS instance that died and I won't ever have access to those backed up snapshots again to be able to restore them?
      Thanks in advance guys!

    • @tonypilborg
      @tonypilborg 2 หลายเดือนก่อน +1

      @@blinkitogaming The backups are not linked to the PBS server - so you can always attach the storage to another PBS, and have access to the data.
      However - you can setup an encryption key (this is done in the "Storage" tab on the PVE server)... And if that node is lost, so is the encryption key. So either go for a trusted (or walled, where access to your data is limited to the PBS server), or make sure to store the encryption key in a safe place (actually, like with all backup - in more than one - safe place :)

    • @blinkitogaming
      @blinkitogaming 2 หลายเดือนก่อน

      @@tonypilborg thank you for your response, I appreciate it!

  • @lmmartinez97
    @lmmartinez97 2 หลายเดือนก่อน

    Hi! I just deployed this without thinking too much -I know, should've researched thoroughly first- and created a dataset in my TrueNAS machine without a quota. Does the chunk operation effect the entire zfs pool in which the dataset is stored? Or just the dataset itself? I'd be rather sad that I botched everything in my NAS due to trigger happy noobing. Thanks!

    • @genshinimpactjoki5393
      @genshinimpactjoki5393 7 วันที่ผ่านมา

      i have the same question. let me know if you already have the answer please. Thanks

  • @mattpowell3287
    @mattpowell3287 2 หลายเดือนก่อน

    G'day Jim, great videos mate.
    Got a question...I have an issue where PBS throws the following error when I try and add the datastore: "parameter verification errors (400) max-depth: schema does not allow additional properties". Not sure what this is all about as I have added a datastore using your method on another implementation of PBS with no issues. I googled this with no luck. Any chance you have seen something like this?

    • @Jims-Garage
      @Jims-Garage  2 หลายเดือนก่อน

      Sorry I haven't seen that error before. I think it's literally what it says though, one of the parameters is incorrect.

  • @casavieira3443
    @casavieira3443 7 หลายเดือนก่อน +2

    Hello Jim 😊
    I'm writing you from Lisboa in Portugal.
    Can you please do a small video explaining how can I restore my proxmox from the backup?
    Or even restore a VM from a backup.
    Beacause 90% of the times I do have problems during the restoring process and not on the backup process.
    I'm new to the proxmox I was using Harvester but I realized that thing was consuming memory like crazy. And I can't affort that.
    Thank you.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Yes, I'll come back to this in the future. Wow, you're brave running Harvester at home! I do love the idea of Kubernetes inside Kubernetes 😂

  • @jeytis72
    @jeytis72 7 หลายเดือนก่อน +1

    Can I install PBS on my PVE and use PBS to backup to an external usb disk instead of TRUENAS? Thanks for your video. Very neat!

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      Yes, that should be possible. Just change the data store location

    • @jeytis72
      @jeytis72 7 หลายเดือนก่อน

      @@Jims-Garage By the way, just to make sure that I got it right, you put your truenas credentials in .smbcreds. IP 192.168.6.2 and "Freenas" are respectively your Truenas IP and its folder where files are going to be saved to. Right? Thanks again.

  • @magnerugnes
    @magnerugnes 7 หลายเดือนก่อน +1

    Great video. Is it possible to add Corosync in pbm? So I can use a pbm on bare-metal as my third cluster node achieving quorum? Thanks!

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Thanks. Yes, it's just Debian 12 under the hood, should be able to install the binary without issue.

    • @magnerugnes
      @magnerugnes 7 หลายเดือนก่อน +1

      Cool, perhaps I'll try that. Is there a reason why you choose VM and not LXC for installing pbs in this video? LXC seem lighter to me. @@Jims-Garage

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      @@magnerugnes you're right, it is lighter. However, I prefer the portability, security, and ease of backup with a VM.

  • @p1ngvin1
    @p1ngvin1 7 หลายเดือนก่อน +1

    Great tutorial, got me up and running! But what happens if a hw fail occurs on PVE (and then also PBS)? Could you simply spin up a new PVE and restore all the backups, including the PBS?

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      Yes, you can restore a new PVE from an existing PBS. However, if PBS failed, you'd need to rebuild PBS first, and specify your existing NAS store.

    • @p1ngvin1
      @p1ngvin1 7 หลายเดือนก่อน +1

      @@Jims-Garage Do you know if there is a tutorial for this?

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      @@p1ngvin1 you've just done everything that's required. You need to mount the folder to PBS from the Nas, then add the data store in pve

  • @basdfgwe
    @basdfgwe 7 หลายเดือนก่อน +1

    I'm going to need to watch this later, because my 2 node proxmox has so many problems with backup (there's errors that I have been ignoring for a while) . I'm doing a daily backup of the VMs etc.. and I keep 7 days, one node seems to be working fine the other always has errors.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Interesting, share some logs and I can help to diagnose

  • @BillCClinton
    @BillCClinton 6 หลายเดือนก่อน +1

    I have a few VM's on a single PVE. Can I run PBS on the same PVE that my VM's are on? I will be using a synology to store the backups. What happens if the PVE machine dies with the PBS VM on it? Thanks so much for these great videos. You're a natural.

    • @Jims-Garage
      @Jims-Garage  6 หลายเดือนก่อน +1

      That's exactly what I'm doing in this video, and I give the reasons for this (which seems a similar setup to yours).

    • @BillCClinton
      @BillCClinton 6 หลายเดือนก่อน

      @@Jims-Garage Thanks! I will give a go tonight?

    • @BillCClinton
      @BillCClinton 5 หลายเดือนก่อน +1

      @@Jims-Garage Works perfectly! I was using the regular backup and it was eating away my synology space. I like keeping the last 10 copies, so this is saving me a ton of space. Thanks!

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน

      @@BillCClinton you're welcome, glad it worked out well

  • @fousay
    @fousay หลายเดือนก่อน +1

    I have a question, I am planning to implement this in my cluster but I am having an issue with the difference between adding NFS Shared storage and this backup Server? Whats the difference?When you say it will save space does that mean this method saves space but also restores faster?

    • @Jims-Garage
      @Jims-Garage  หลายเดือนก่อน +1

      This performs incremental backups (only backs up new files each time, this saves space). Using an NFS does an entire backup of the VM each time. This also has deduplication which saves space when files are similar. In short, use it.

    • @fousay
      @fousay หลายเดือนก่อน +1

      Will do! Also I have about a 4 PC cluster, when setting up this backup should I setup HA?

    • @Jims-Garage
      @Jims-Garage  หลายเดือนก่อน

      @@fousay you could do yes. I assume you're saving to a separate NAS?

  • @joseajimenez5669
    @joseajimenez5669 2 หลายเดือนก่อน

    smb share storage 3tb but only show 27gb on pbs ??? any idea why??

  • @JulianBrennum
    @JulianBrennum 3 หลายเดือนก่อน +1

    Quick question: what happens if the Proxmox Storage Server get's corrupted, or the whole host goes down. Is the backup still easily accessable if you spin up a new one? Or is it the server that holds the "encryption" key?

    • @Jims-Garage
      @Jims-Garage  3 หลายเดือนก่อน +1

      You can create a new PBS and add the same credentials, that's fine.

    • @JulianBrennum
      @JulianBrennum 3 หลายเดือนก่อน +1

      @@Jims-Garage Perfect, thanks!

  • @DudeItsDallyBoy
    @DudeItsDallyBoy 7 หลายเดือนก่อน

    can you make a video on the proxmox mail gate? Kinda curious what that does.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Not something that I have used as I don't want to host my own email server. It does sound useful though.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Not something that I have used as I don't want to host my own email server. It does sound useful though.

  • @MarcMcMillin
    @MarcMcMillin 7 หลายเดือนก่อน +2

    #1 liker :-)

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน +1

      First! 🥇

  • @ierosgr
    @ierosgr 5 หลายเดือนก่อน +1

    Since TrueNas (at least scale) supports deduplication itself, what is the point of doing all these extra steps (of creating a middle step with proxmox backup server) instead of just adding as backup storage TrueNas itself and choosing the storage options accordingly.
    Also at 6:47 you should check discard as well in order for trim to work properly.

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน

      Good question. From my understanding and experience, deduplication of differential backups is smaller than deduplication of full backups.

    • @ierosgr
      @ierosgr 5 หลายเดือนก่อน +1

      @@Jims-Garage So the key word in Prox Back Server is differential while TrueNas only does it on full backups?

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน +2

      @@ierosgr proxmox ve does full backups, proxmox backup server does differential (and deduplication)

  • @AceBoy2099
    @AceBoy2099 23 วันที่ผ่านมา +1

    Ok, my PBS seems to have broke. How do I go about reinstalling and importing the current backups to the new install?

    • @Jims-Garage
      @Jims-Garage  23 วันที่ผ่านมา

      You should restore PBS from backup, failing that reinstall it and import the same encryption keys as before

    • @AceBoy2099
      @AceBoy2099 22 วันที่ผ่านมา

      @Jims-Garage I got it sorted out. Turns out my lvm was full and wouldn't let the VM start. I found a video on how to move the VMs to another "storage pool" and that got me going. Since initial setup I'd upgraded the pve ssd and was able to expand the local, but can't figure out how to get the lvm to expand, maybe I can't since local took all the allocation?!
      All that aside, could you do a video sometime on how to do those options, since pbs couldn't start I didn't have a way to restore a backup and have no idea how to re/install and import the existing backups to the new install.

  • @AceBoy2099
    @AceBoy2099 5 หลายเดือนก่อน +1

    Ok, i just followed this to a "T",everything worked fine while setting it up, as soon as i finished i tried to do a "run now" in the backups tab of proxmox and it errored, now pbs is showing [bad request (400) unable to open chunk store 'Backups' at "/mnt/truenas.chunks" - no such file or directory (os error 2)].
    What happened?
    I figured it out, in the fstab i put "/mnt/Backups" (dataset name) instead of "/mnt/truenas" (directiry name). Fixed that then rebooted to check and its working now.
    How do you have darkmode on pbs window? Is that from your os/browser, or is that a theme in PBS like i have on my PVE?

    • @genshinimpactjoki5393
      @genshinimpactjoki5393 7 วันที่ผ่านมา

      so the correct one was /mnt/truenas (the mount point)?

    • @AceBoy2099
      @AceBoy2099 7 วันที่ผ่านมา

      @@genshinimpactjoki5393 in my case, yes.

  • @collectorguy3919
    @collectorguy3919 7 หลายเดือนก่อน +2

    I would want to do a test restore, assuming the Proxmox Backup Server VM is unavailable (eg: destroyed in the same hw failure). It seems reasonable to expect a new PBS using the same NAS backend would just work for the restore, but I don't know that. That's assuming a PBS is actually needed for a restore. Proxmox might have a handy recovery utility.
    BTW, incremental backups and deduplication are different concepts, but they compliment each other so well that making a distinction perhaps only belongs in pedantic comments.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Thanks, yes I'm aware that there's a nuance between the two but I didn't want to derail too much. I have covered those concepts in previous videos.

  • @demorez5
    @demorez5 5 หลายเดือนก่อน +1

    unfortunately it seems you cannot backup to PBS the VM which actually hosts the datastore. I have set up my datastore based on the video (but used NFS instead of Samba) and everything works fine except backing up my NAS VM which is actually hosting the datastore. I guess its because PVE stops the VM for a second and the share disappears. Interestingly the same backup structure works when using a simple network share (without PBS) as a target

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน

      Yes, I suspect that's right. However, are you backing up a NAS to a NAS? My NAS is my backup with a mirror in the cloud.

    • @demorez5
      @demorez5 5 หลายเดือนก่อน +1

      @@Jims-Garage yes, backing up the NAS OS (OpenMediaVault) disk to the drives attached to the NAS.
      this may sound stupid at first glance, but the main reason i am using OMV is that i can individually read each drive from any operating system and i can attach pre-filled drives to it. was thinking several times about switching to TrueNAS and ZFS RAID, but that would always require a machine able to host 4+ HDDs to read the data. I can read all data from my NAS even from a windows laptop.

    • @Jims-Garage
      @Jims-Garage  5 หลายเดือนก่อน +1

      @@demorez5 zfs requires a minimum of 2 drives for raidz1. Do you have any redundancy in your current Nas?

    • @demorez5
      @demorez5 5 หลายเดือนก่อน

      @@Jims-Garage yeah, don't worry. generally i use snapraid, but have regular offsite and B2 cloud backups for important data (which are actually the VM snapshots). actually i think its pretty overkill for a bunch of movies i am never gonna watch

  • @Glatze603
    @Glatze603 7 หลายเดือนก่อน

    PBS is not showing used size, although I mounted the share as backup-user and -group (34)?!?

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Interesting, what's it showing?

    • @Glatze603
      @Glatze603 7 หลายเดือนก่อน

      @@Jims-Garage 655,36 KB! No error messages in syslog, no other idea...

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      @@Glatze603 have you performed a backup or just scheduled one?

    • @Glatze603
      @Glatze603 7 หลายเดือนก่อน +1

      @@Jims-Garage both. I already have over 200 GB of data in the ".chunk" directory and permission is backup:backup

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      @@Glatze603 strange! I guess it's still working though?

  • @jeremywiginton2502
    @jeremywiginton2502 7 หลายเดือนก่อน +2

    So, your explanation of deduplication is incorrect. Your definition is simply an “Incremental” backup - i.e. backing up just the files that have changed. Deduplication is actually not backing up all files that are the same across multiple sources - i.e. if you’re backing up multiple VMs of the same OS, it would only back up a single copy of the files that are identical across all VMs.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Yes, you're correct, and this approach scales further when you're looking at SANs, Cloud etc (amazing what Google does in this space). I didn't want to go too far down the rabbit hole of definitions but appreciate there is a distinct nuance.

  • @ruwn561
    @ruwn561 7 หลายเดือนก่อน +1

    You are confusing incremental backups with deduplication ; it’s not the same thing.

    • @Jims-Garage
      @Jims-Garage  7 หลายเดือนก่อน

      Thanks. I appreciate it isn't, I've covered the nuance in previous videos and didn't want to go down the same rabbit hole again. However, PBS does use deduplication when performing incremental backups.

  • @antonfelin
    @antonfelin 6 หลายเดือนก่อน

    адский акцент у тебя чуувак. Учи английский