Seriously dude! You've been such a great help on getting me setup in my homelab. I was completely confused on how TrueNAS would operate within Proxmox and this has demystified it greatly. You freakin rock!
MrP, I'll promote you to DrP as your video is just what I needed for my Truenas project!! Great workflow and touch on all the critical storage aspects. Thanks!
I just noticed this is a Really Good setup by combining all the power in one system to run Proxmox AND Scale apps and taking advantage of external storage for backups, NICE! I've been looking for a solution like this! ( what I did instead was made another Proxmox node to run PBS vm ) since it has more pros then cons, but your method works to backup the VMs within the same system :D
just saw your last video on proxmox backup server, i was planning to build a nas with truenas scale on bare metal but i like the idea of truenas in VM i gonna try that thx, your video are all the time great
thank you for sharing this, it helped me to set up my truenas in proxmox. However, I passed through the the internal hdd and one ssd to the Truenas VM. The hdd is the mirrored zfs storage and the 250 gb ssd is used as a cache. smb is running and I can see the share in my windows pc. great stuff 👍 strangely my true nas looked different to yours. Maybe because I use the newer version.
Thanks for this video! I've managed to set up a external single WD 500Gb storage and my question is that is that possible to add for future other drives? Like the NAS solution you've?
Great Video, explained a lot. Unfortunately it did not solve my specific issue. I am switching from TrueNas Scale raw install to Proxmox with TrueNas Scale as a VM. Since I already have a ZFS Pool with 9TB allocated, destroying my pool is not an option. Also I have 4 HDDs connected with SATA so I have to pass them through otherwise. For everyone with this exact problem: Do not pass your HDDs directly to TrueNas Scale via config while leaving the ZFS Pool managed by Proxmox. Proxmox really doesn't like that. It ended in a boot loop so I had to reinstall proxmox though it did not mess with my pool.
Thanks for sharing this! Just a warning though -- given that you're now mounting the backup directory which is a shared SAMBA drive, there's the network overhead added with this method. This is compared to your previous setup where the ZFS on Proxmox allowed direct backups to the disks which had no overhead latency. For people with slow network and large backup, or even router problems, backing up to mounted SAMBA shares can be quite slow, or even fail.
First I must say exactly video and thank you for all your hard work, but I have a question I have truenas scale installed in proxmox and I would like to share my pool or smb share with all my media files to my Plex container in proxmox is this possible, If so could you point me in the right direction please..?
Great solution DrP ;) with Truenas mounted as a VM over Proxmox and managing the virtual drives. Thank you for the great video. My only concern is for how to backup the disks. Moreso, in case of a Proxmox boot drive failure, where we find ourselves having to replace the boot drive and install proxmox again. We would restore the VMs from there backups. But how would you restore the truenas virtual discs into the new Proxmox? It would be great if you could do a video on that, but I would be grateful the same for an answer here. Thanks again!
Hi, I follow backup rule 3-2-1 : 3 backups, on two media storage with 1 being off-site My backups sits inside Truenas ZFS and external drive connected to my Proxmox. So i have two backups. Extra backup gets mirrored to my brothers house via Syncthing. Upcoming video i am planing is to show how to setup TrueNAS and Backblaze connection for offsite backup.
@@MRPtech thank you for your answer! My question is with truenas being a VM, how we can backup the truenas virtual disks which are mounted in Proxmox? Second, how we would restore them into a new proxmox installation?
Sorry for dumb question but ho do I get my internal SATA HDDs into NAS that way? Can´t choose them as an option :/ Would I create 2 zfs and merge them in a pool inside TrueNAS or does that miss the purpose?
In proxmox node CLI: 1. run command "blkid" to identify drives. You will see something like this : /dev/sda2: UUID="BD43-5706" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="d9e4f149-d37f-4a5e-a575-0a7a78653caa" Take a note of PARTUUID number. 2. Once you have all IDs run command replacing PARTUUID number: qm set -scsi /dev/disk/by-partuuid/ Make sure to use scsi ID that is not been taken by any other drive.
if my truenas installation breaks for whatever reason and i cannot boot into truenas scale, my smb shares in proxmox would disappear because they're tied to my truenas installation right?
I tried adding 2 x 1TB drives to test into a USB Clone/Enclosure but of course when you went to add the new USB device it only sees it as 1 usb host. Tried adding it twice but again it had same ID and when in trunas it only sees the one drive.
Yes. Some USB enclosures will assign same ID number for USB connection. What you need to do: find out 2x1TB drives UUID Lets say your Truenas VM ID is 200 inside proxmox host terminal type: qm set 200 -scsi2 /dev/disk/by-id/Your_Drive_UUID_1 next one will be like this: qm set 200 -scsi3 /dev/disk/by-id/Your_Drive_UUID_2 Here is one of my drives passed using this method: qm set -scsi5 /dev/disk/by-partuuid/c71ef206-096a-4d44-a28c-8cfdeeef30a8
@@MRPtech Excellent and thank you for the reply. Just testing it on an old server in work so I ended up just plugging the 2 drives inside the case but then truenas threw an error saying cant have same serial numbers. I will try the USB method on my old laptop at home...thanks again for the detailed reply.
Mr.Pi thanks a lot for all videos and effort! I'm stuck now here with minute 9.47 sec as i get a command 'zpool destroy tank' failed: exit code 1 | also i notice that the content your Vm's and Containers changed or was renamed and that confused me - so i'm stuck ...
when you trying to destroy zfs pool, you moved all stuff out of it and removed storage links from Datacenter? I am confused too - where did i change content of VM/Container :) ?
@@MRPtech no worries - i sorted out starting setting up everything - and like i've mentioned in another comment i'm no longer using ZFS and moved to TrueNAS.
Not sure why but if I create a smb share while smb is already running I have to turn off and then turn back on the smb service for the new share to be recognized. It drove me crazy for a whole weekend before I figured it out. Thank you for posting the video.
I followed your original video and created the folder sets within proxmox (thanks for that), Why have you moved those datasets to Truenas? I have left "tank" with the 3 folders from previous video for proxmox to handle. I have passed through additional drives to Truenas for "data" and my storage. please advise why backups and VM drives can not reside within promox and why they are moved to truenas?
Hey MrP, Thanks so much for your videos, they have been a massive help for me setting up my system. I was wondering if you have a solution to be able to spin down disks when not in use. My TrueNAS server is permanently on but not always in use so I would like to spin down the disks when they've not been used for an hour. I've seen solutions fore TrueNAS Core but as a complete beginner I've not been able to find a suitable solution for Scale. Cheers
i have been looking in to this this for a while now. As far as i can find this is easy to setup on Truenas Core not TrueNAS Scale. In addition to that, if ZFS pool get's accessed a lot, there is no time for disks to spin down. In my case ZFS get's access almost always. I would say 20 hours a day ZFS works :) Still - i am looking in to this as i know that there are people who want this to be done so i i will find something that is works i will definitely share with you all.
I had the same problem last night, they were just constantly spinning up and down every 5 seconds. Noise was very irritating so just ended up turning it off. Although the tutorials were excellent and i've learnt so much in a few videos than i have of reading up documents. I do find Truenas and the other VMs to be overkill for what it does. Good experience though.
Hey MRP, after watching this video, I got inspired to buy & add 2 x 1TB usb external hardrives to my old laptop & set up proxmox & truenas/zfs pool. It's working pretty well, i think, but I'm getting worried about how hot the external drives can get sometimes, when the ambient temp is high. Do you know of any ways we can make truenas/proxmox reduce their use of the drives when they reach a particular temperature? truenas seems to be able to monitor the temp. And do you know if we can set proxmox to gracefully shut down if the laptop battery is critically low? (occasional power outage issue) Thanks so much for your videos, they're great.
Hi. Thank you for your comment. And welcome to Proxmox family :) I don't think there is a way to reduce drives use depending on temps. I have mine tucked behind the laptop in the corner where direct sun won't reach. If i notice that they misbehaving i might just hide them under the desk and get cheap USB fan from amazon to cool them down.
I have added 3 SSD disks to my system and they do show up in ProxMox as /dev/sdb, /dev/sdc, and /dev/sdd but when I tried to add them to TrueNas they are not listed. What do I need to do to these three SATA SSD drives to show up. Do I need to GPT initialize them or create a partition or create a zfs dataset as I did with the two NVME disks that are showing?
first you need to find out UUID or PARTUUID numbers for each drive - use command: blkid Note each unique number and imported them. Using HOST CLI use command "qm set ......" Please watch this part of my video where i am demonstrating this: th-cam.com/video/PHmHNzv3a7s/w-d-xo.html
Thank you for this series. I have a little problem, if i try to clone (linked clone) the lxc th-cam.com/video/oSD-VoloQag/w-d-xo.html it wont work. i will get an error message "Linked clone feature for 'local:998/base-998-disk-0.raw' is not available (500)" and i dont know why. if i clone the VM template it worked fine. Hopefully can help me.
I like your videos a lot, because they are very informative for newbie. th-cam.com/video/RS0EabrH6hg/w-d-xo.html you can include information how to add USB disk in ntfs format to move vm and have write access. Below how I did. On proxmox shell I had to use apt-install ntfs-3g, after that I can mount usb disk to proxmox datacenter using command: mount -t ntfs-3g /dev/sd*1 /mnt/usb and add directory usb share and move vm to usb with write permissions. And also how to choose ssd disks instead of usb preparing for freenas you talking around 10th minute., I won't see disks when trying to add them, fdsik shows them like sdb and sdc.
Seriously dude! You've been such a great help on getting me setup in my homelab. I was completely confused on how TrueNAS would operate within Proxmox and this has demystified it greatly. You freakin rock!
MrP, I'll promote you to DrP as your video is just what I needed for my Truenas project!! Great workflow and touch on all the critical storage aspects. Thanks!
I just noticed this is a Really Good setup by combining all the power in one system to run Proxmox AND Scale apps and taking advantage of external storage for backups, NICE! I've been looking for a solution like this! ( what I did instead was made another Proxmox node to run PBS vm ) since it has more pros then cons, but your method works to backup the VMs within the same system :D
just saw your last video on proxmox backup server,
i was planning to build a nas with truenas scale on bare metal but i like the idea of truenas in VM
i gonna try that
thx, your video are all the time great
thank you for sharing this, it helped me to set up my truenas in proxmox. However, I passed through the the internal hdd and one ssd to the Truenas VM. The hdd is the mirrored zfs storage and the 250 gb ssd is used as a cache. smb is running and I can see the share in my windows pc. great stuff 👍 strangely my true nas looked different to yours. Maybe because I use the newer version.
Thanks for this video! I've managed to set up a external single WD 500Gb storage and my question is that is that possible to add for future other drives? Like the NAS solution you've?
Great Video, explained a lot. Unfortunately it did not solve my specific issue.
I am switching from TrueNas Scale raw install to Proxmox with TrueNas Scale as a VM.
Since I already have a ZFS Pool with 9TB allocated, destroying my pool is not an option.
Also I have 4 HDDs connected with SATA so I have to pass them through otherwise.
For everyone with this exact problem:
Do not pass your HDDs directly to TrueNas Scale via config while leaving the ZFS Pool managed by Proxmox.
Proxmox really doesn't like that. It ended in a boot loop so I had to reinstall proxmox though it did not mess with my pool.
best series of videos, thank you so much for them
Thank you for such an amazing comment.
Thanks for sharing this! Just a warning though -- given that you're now mounting the backup directory which is a shared SAMBA drive, there's the network overhead added with this method. This is compared to your previous setup where the ZFS on Proxmox allowed direct backups to the disks which had no overhead latency. For people with slow network and large backup, or even router problems, backing up to mounted SAMBA shares can be quite slow, or even fail.
Thank you MrP!
First I must say exactly video and thank you for all your hard work, but I have a question I have truenas scale installed in proxmox and I would like to share my pool or smb share with all my media files to my Plex container in proxmox is this possible, If so could you point me in the right direction please..?
Great solution DrP ;) with Truenas mounted as a VM over Proxmox and managing the virtual drives. Thank you for the great video.
My only concern is for how to backup the disks. Moreso, in case of a Proxmox boot drive failure, where we find ourselves having to replace the boot drive and install proxmox again. We would restore the VMs from there backups. But how would you restore the truenas virtual discs into the new Proxmox? It would be great if you could do a video on that, but I would be grateful the same for an answer here. Thanks again!
Hi,
I follow backup rule 3-2-1 : 3 backups, on two media storage with 1 being off-site
My backups sits inside Truenas ZFS and external drive connected to my Proxmox. So i have two backups. Extra backup gets mirrored to my brothers house via Syncthing.
Upcoming video i am planing is to show how to setup TrueNAS and Backblaze connection for offsite backup.
@@MRPtech thank you for your answer!
My question is with truenas being a VM, how we can backup the truenas virtual disks which are mounted in Proxmox?
Second, how we would restore them into a new proxmox installation?
@@ear6 ( you tick backup ) on the vm in the hardware Disk options
Fantastisch, schöne Grüße 👍👍👌👌
Sorry for dumb question but ho do I get my internal SATA HDDs into NAS that way? Can´t choose them as an option :/
Would I create 2 zfs and merge them in a pool inside TrueNAS or does that miss the purpose?
In proxmox node CLI:
1. run command "blkid" to identify drives. You will see something like this :
/dev/sda2: UUID="BD43-5706" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="d9e4f149-d37f-4a5e-a575-0a7a78653caa" Take a note of PARTUUID number.
2. Once you have all IDs run command replacing PARTUUID number:
qm set -scsi /dev/disk/by-partuuid/
Make sure to use scsi ID that is not been taken by any other drive.
if my truenas installation breaks for whatever reason and i cannot boot into truenas scale, my smb shares in proxmox would disappear because they're tied to my truenas installation right?
Yes
I tried adding 2 x 1TB drives to test into a USB Clone/Enclosure but of course when you went to add the new USB device it only sees it as 1 usb host. Tried adding it twice but again it had same ID and when in trunas it only sees the one drive.
Yes. Some USB enclosures will assign same ID number for USB connection.
What you need to do:
find out 2x1TB drives UUID
Lets say your Truenas VM ID is 200
inside proxmox host terminal type:
qm set 200 -scsi2 /dev/disk/by-id/Your_Drive_UUID_1
next one will be like this:
qm set 200 -scsi3 /dev/disk/by-id/Your_Drive_UUID_2
Here is one of my drives passed using this method:
qm set -scsi5 /dev/disk/by-partuuid/c71ef206-096a-4d44-a28c-8cfdeeef30a8
@@MRPtech Excellent and thank you for the reply. Just testing it on an old server in work so I ended up just plugging the 2 drives inside the case but then truenas threw an error saying cant have same serial numbers. I will try the USB method on my old laptop at home...thanks again for the detailed reply.
Mr.Pi thanks a lot for all videos and effort! I'm stuck now here with minute 9.47 sec as i get a
command 'zpool destroy tank' failed: exit code 1 | also i notice that the content your Vm's and Containers changed or was renamed and that confused me - so i'm stuck ...
when you trying to destroy zfs pool, you moved all stuff out of it and removed storage links from Datacenter?
I am confused too - where did i change content of VM/Container :) ?
@@MRPtech no worries - i sorted out starting setting up everything - and like i've mentioned in another comment i'm no longer using ZFS and moved to TrueNAS.
Great Job
Not sure why but if I create a smb share while smb is already running I have to turn off and then turn back on the smb service for the new share to be recognized. It drove me crazy for a whole weekend before I figured it out. Thank you for posting the video.
I followed your original video and created the folder sets within proxmox (thanks for that), Why have you moved those datasets to Truenas? I have left "tank" with the 3 folders from previous video for proxmox to handle. I have passed through additional drives to Truenas for "data" and my storage. please advise why backups and VM drives can not reside within promox and why they are moved to truenas?
Hey MrP, Thanks so much for your videos, they have been a massive help for me setting up my system. I was wondering if you have a solution to be able to spin down disks when not in use. My TrueNAS server is permanently on but not always in use so I would like to spin down the disks when they've not been used for an hour. I've seen solutions fore TrueNAS Core but as a complete beginner I've not been able to find a suitable solution for Scale. Cheers
i have been looking in to this this for a while now.
As far as i can find this is easy to setup on Truenas Core not TrueNAS Scale. In addition to that, if ZFS pool get's accessed a lot, there is no time for disks to spin down. In my case ZFS get's access almost always. I would say 20 hours a day ZFS works :)
Still - i am looking in to this as i know that there are people who want this to be done so i i will find something that is works i will definitely share with you all.
I had the same problem last night, they were just constantly spinning up and down every 5 seconds. Noise was very irritating so just ended up turning it off. Although the tutorials were excellent and i've learnt so much in a few videos than i have of reading up documents. I do find Truenas and the other VMs to be overkill for what it does. Good experience though.
Hey MRP, after watching this video, I got inspired to buy & add 2 x 1TB usb external hardrives to my old laptop & set up proxmox & truenas/zfs pool. It's working pretty well, i think, but I'm getting worried about how hot the external drives can get sometimes, when the ambient temp is high.
Do you know of any ways we can make truenas/proxmox reduce their use of the drives when they reach a particular temperature? truenas seems to be able to monitor the temp.
And do you know if we can set proxmox to gracefully shut down if the laptop battery is critically low? (occasional power outage issue)
Thanks so much for your videos, they're great.
Hi.
Thank you for your comment. And welcome to Proxmox family :)
I don't think there is a way to reduce drives use depending on temps. I have mine tucked behind the laptop in the corner where direct sun won't reach. If i notice that they misbehaving i might just hide them under the desk and get cheap USB fan from amazon to cool them down.
I have added 3 SSD disks to my system and they do show up in ProxMox as /dev/sdb, /dev/sdc, and /dev/sdd but when I tried to add them to TrueNas they are not listed. What do I need to do to these three SATA SSD drives to show up. Do I need to GPT initialize them or create a partition or create a zfs dataset as I did with the two NVME disks that are showing?
first you need to find out UUID or PARTUUID numbers for each drive - use command: blkid
Note each unique number and imported them. Using HOST CLI use command "qm set ......"
Please watch this part of my video where i am demonstrating this:
th-cam.com/video/PHmHNzv3a7s/w-d-xo.html
What Samsung device are you showing this from?
Galaxy Fold 3
Thank you for this series.
I have a little problem, if i try to clone (linked clone) the lxc th-cam.com/video/oSD-VoloQag/w-d-xo.html it wont work.
i will get an error message "Linked clone feature for 'local:998/base-998-disk-0.raw' is not available (500)" and i dont know why.
if i clone the VM template it worked fine.
Hopefully can help me.
Looks like that LXC container missing a drive. Can you confirm if virtual drive is attached to that LXC container?
@@MRPtech i fixed it allready, ty for your reply
I like your videos a lot, because they are very informative for newbie.
th-cam.com/video/RS0EabrH6hg/w-d-xo.html you can include information how to add USB disk in ntfs format to move vm and have write access. Below how I did.
On proxmox shell I had to use apt-install ntfs-3g, after that I can mount usb disk to proxmox datacenter using command: mount -t ntfs-3g /dev/sd*1 /mnt/usb and add directory usb share and move vm to usb with write permissions.
And also how to choose ssd disks instead of usb preparing for freenas you talking around 10th minute., I won't see disks when trying to add them, fdsik shows them like sdb and sdc.