Cluster Migration using velero:- - need 2 cluster - create namespace in cluster 1 - install velero server on cluster1 and take backup of namespace from cluster1 - now install velero server with same minio credentials and endpoint on cluster 2 - check velero backup available on cluster2 which we created on cluster1 - now restore backup on cluster2 - on cluster2 namaspace is available Migration completed
@@tannaalok Thanks. Actually there is Restic integration with Velero, using which you can snapshot/backup NFS persistent volumes. But it is in beta version so may not work very well. I will have to explore the options. Cheers.
Hi, I have followed your video and installed velero via docker desktop on windows 10. created bucket at minio console and installed velero which the command you provided. After executing the command "velero backup create firstbackup --include-namespaces testing", "firstbackup" folder is not getting created and cannot visible under /kubedemo on minio console. and getting status as below after giving the command "velero backup get " NAME STATUS ERRORS WARNINGS CREATED EXPIRES STORAGE LOCATION SELECTOR firstbackups Failed 0 0 2021-04-06 20:54:34 +0530 IST 29d default could you please suggest.
Hi Prasad, thanks for watching. I think in the newer versions of velero the arguments have changed slightly so I will need to re-test this and may be post a new video soon.
@Just me and Opensource : Thanks so much for your reply. waiting for your new video. can I have your mail id plz to clarify some doubts as I have been stucked with this by 2 weeks.
@@prasadm1067 there is a slack workspace for this channel. May you can ask your questions there as well. You can find the invite link in the channel banner. I hardly get any free time these days. So others might be able to answer your queries as well.
Thanks for this video..I'am new to devops and want to switch job in devops position, but its getting very difficult for me to prepare for technical interviews since I dont have real time experience of devops culture and work. I would be very grateful to you if you would provide some overview of how to prepare for devops technical interview.What should be the preparation areas..topics to cover..not the technicalities or technical details but the overall idea of how should be the preparation points and topics. It would be a much help. Many many Thankyou in advance.
Hi venkat. Excellent content and presentation. Can you please do a demo for back up and restore of pv? Preferably mongodb replicas. Is that possible in Valero?
Hi Sanjeev, thanks for watching this video. Backup and restoring of persistent volumes is possible with Velero. But you need to use a supported storage provider for that. Unfortunately in my setup on bare metal, I use nfs-provisioner which is not supported by Velero. If you happen to use any of the managed Kubernetes in the cloud (EKS, GKE, Azure), its possible to test pv backup restore. In the future, I will see if I can get that done in AWS. Thanks.
Hi Venkat, the video is super useful and very clear about instructions. I have AWS EKS deployed through rancher and AWS EFS as persistent volumes. Could you please share the insights to perform backups and restores. This video is not covering persistent volumes though, great thanks in anticipation.
Hi Narasimha, thanks for watching this video. I haven't tried it on AWS yet. Just on my local environment. In order to backup and restore persistent volumes, you will have to use supported storage provider in the first place. In this video, I used NFS provisioning for dynamic storage which is not supported by Velero. I will see if I can explore further in this topic. Cheers.
@@OZIndkids No worries. I have a Slack workspace for this channel where there are over 100 users. You may find it useful joining the workspace and discussing with fellow users who have similar interest in kubernetes. join.slack.com/t/justmeopensource/shared_invite/enQtODg4NDcxMTg5Mjk2LTgyNWJkMzlmNzRlMDdhYzc2ZjA3NjA0N2ZkODg5NzAyMzNjMGY4OGJjZDkzNmRhNDU1ZjEzZjc1NzhiMjBlMmI Cheers.
Hi Venkat, Do you have a tutorial on rotating the Kubernetes component certificates? The Kubernetes generate the certs for 1 year for all its component and I am looking into a method to rotate it before it expires.
Hi Kulwant, thanks for watching this video. I haven't looked deep into certificates yet. Most of my videos were based on kubeadm installation method which auto-generates the certificates. I will look into it and if I find a proper solution, I will make a video of it. Thanks.
Hey @venkat, can we use the velero for backup from old K8s cluster and restore in the new cluster? Yes, Pointing on the same velero configuration is needed. What else?
Very Helpful video .....My scenario is we want to shutdown/delete eks cluster for a few months and then restore back (until then we won't have any eks cluster to store backup endpoints or objects) so will this help me if not please can you suggest alternative
Hi Ashish, thanks for watching. I don't think you can shutdown an EKS managed cluster. You can however reduce the number of worker nodes. But if you are not going to use, then the only possibility is to delete the EKS cluster. Velero is exactly for this. Just take a backup of your cluster including persistent volumes and then you can restore it to any cluster.
hello, all the backups are saved in same "backup" folder. can we created different folders to store backups of different clusters in diffirent folders but same s3 bucket?
Hi Zoe, thanks for watching. You can actually achieve that with "objectStorage/prefix" option. The directory inside a storage bucket where backups are to be uploaded. velero.io/docs/v1.1.0/api-types/backupstoragelocation/
Awesome! It has helped a lot! Can you please create some more content around this like back-up and restore using snapshots. Keep teaching the world! :-)
Hi, thanks for watching. I haven't done velero with persistent storage backup/restore. When I did this video, there wasn't any support for nfs provisioner as persistent storage. Now there is Restic. I have it in my list to try though.
Thanks a lot. This is something that I've been waiting for! I've few doubts though. In my case, I've to host multiple WordPress sites. Each site will have its own namespace 1) Is Velero production-ready to back PV? All my states are saved in NFS servers mounted as PV 2) How can I backup/restore programmatically, like by calling an API? My use case is that my clients should be able to backup/restore their wp site on clicking a button
Hi Gijo, thanks for watching this video. Velero is production ready and it can backup persistent volumes as well. Having said that, it doesn't support all persistent volumes. You will have to use a supported storage provisioner to make use of volume snapshots. Unfortunately its not a lot that is supported at the moment. heptio.github.io/velero/master/support-matrix.html NFS is not supported. I am not sure of any API for programmatic access. Thanks
Hi Venkat, thanks for watching this video. I will try to do that. But on bare metal, you have to choose an appropriate storage provider that supports snapshots. But its easy to do if we operate in cloud. Anyways, I will play with it and record a video when I get some time. Thanks
Hi Venkat. Thank you so much for this video. But I need an help from you for implementing the backup of the aws lab eks cluster resources. I have to perform this task as there was an issue in our labs because the namespaces got deleted accidentally and they were not having backup available for lab environment. Can you please help me out for this issue on how can I make scheduled back ups and setup RBAC role to restrict certain commands to execute and setup whole automation process for the lab eks cluster. Is this possible to do all these steps with velero? Can you please make one video for me on this which will help me out a lot and your help will be really appreciated.
In a k8s 1.11.10 cluster i'm trying to backup the PVC's resources from deployments, velero sayd, YES i've backuedUP (i'm using restic) i see in the backup log that the pvc was backuedup, but! when i'm trying to restore, velero restore the PVC but empty .... if i'm doing the same thing with a simple POD everithing works fine. Do you know why? PS: the annotations are present in both resources of course :) thanks
Hi Hari, Thanks for watching. If you are using one of the supported persistent storage then Velero can back up persistent volumes as well. All cloud storage is supported. My setup was on local workstation where I used NFS as storage provisioner. At the time of recording this video, nfs is not supported but later it was possible through Restic.
Thanks a lot for all your videos. Just wanted to ask, is there any to automate the restore steps? In case the primary data centre is down, I would like to restore the application and data in the other data centre automatically.
Thanks for the Video. Please do a video on PV backup and restore. We are moving our cluster from One region to another, can we achieve it using Velero?
Hi Prashanth, thanks for watching this video. You can absolutely use Velero to move your cluster from one region to another. You can backup everything and restore just what you want on the target cluster. If you are using cloud provider, then you can also backup the PV. Unfortunatley I am not there yet. All my clusters are based on bare metal on-prem and my storage solution for PVs are NFS, which are not supported by Velero. Thanks.
@Rohan Shinde Clearly NFS storage provisioning is not supported by Velero. It has to be one of their supported storage provider, if you want to do backups of persistent volumes. It is very unfortunate they don't support NFS. Having said that, there is Restic integration with Velero, which you can use for NFS snapshots. But it is beta version. velero.io/docs/master/supported-providers/ velero.io/docs/master/restic/ Cheers.
I am not able to get velero to work successfully on the new cluster. I think it has something to do with the IAM permissions. Since we already created IAM permissions and IAM service account for the velero in the first cluster, it is conflicting with the permissions for the new cluster. I need help to figure out how to make it work.
Hello, I face difficulties when i create a backup on cluster 1 and restore it on cluster 2 with the same minio credentials. Could you please provide steps to do that as well.
Hi, thanks for watching. When I recorded this video, there wasn't any support for backing up NFS backed storage. Although later Velero added Restic integration to take snapshot of NFS volumes as well. I haven't tried it.
hello Venkat thakn you for your bup. I follow your tuto and i have got some erro when i want to initialise container. pod/velero and deployment.app/velero always stays in statut 0/1 any idea ?
Hi Cheik, thanks for watching this video. Have you checked the "kubectl describe pod " & "kubetl describe deploy velero" command to see why its failing? Thanks
thanks for your nice video ...can you please tell me if this tool works for my application migration ... I have a Kubernetes cluster running with a few applications and storage volume attached in this case CEPH RBD...now I need to migrate application data stored in Ceph which I need to migrate into another Ceph cluster ....
Hi Venkat, thanks for sharing those videos. its really helpful.... here i got struck while installing Velero on Google Kubernetes Engine (GKE), i have followed each step as you did in this video. but when i do VELERO VERSION, it throwing an error like this, """ """" what could be the reason ? TIA
Hi Mahendra, thanks for watching. I used Velero 1.0.0 version in this video. Once you download the tar ball using wget and move velero to /usr/local/bin, you can do velero version to check the output. It is safe to ignore the server version error at this point as long as you see the client version.
In which node velero needs to be installed? Is it master or any worker node? Is it possible to install it outside the K8s cluster and has access to the K8s cluster?
Hi Anusha, Thanks for watching. Velero installation actually deploys certain resources in your Kubernetes cluster. It doesn't deploy them specifically on master or worker nodes but just to your cluster. The resources/pods can actually run on any nodes. Velero installation consists of downloading the velero binary and installing the required components into the cluster.
How to restore pv in a completely new cluster using velero ? I have a deployment with an attached pv. I am successfully backing up and restoring the same in the same cluster. How do I restore the same in a completely new k8s cluster ?
Hi Tushar, thanks for watching this video. In this demo I showed backup and restore of Kubernetes resources excluding persistent volumes. In order to backup and restore persistent volumes as part of velero process, we have to be using supported storage provisioning that supports volume snapshot feature. Since all my videos are based on bare-metal, I could only go with NFS dynamic provisioning for persistent volumes which are not supported storage backend. Thanks.
@@justmeandopensource Hello, even I am using the same thing. I have 2 local clusters, each with one master 2 slaves architecture. I have a separate NFS in which I have installed docker and minio inside it. Is there absolutely no solution to restore backups taken in nfs from cluster 1 to cluster 2 ?
@@tusharson Ahh. Minio is cloud native storage and is a supported backend in Velero. You should be able to backup and restore. I haven't explored that yet I am afraid. I will have to test that. When I get some time, I will play with it and may be post a follow up video on this topic. Thanks.
Hi Tushar, You can ask questions in here. I will try my best to respond. I don't work outside of TH-cam and have a 9-6 primary job. Everyday I am setting aside some time to respond to viewers questions. Feel free to ask any questions. Bear in mind that I am not an expert. I am learning as well and sharing my knowledge. Cheers.
Hi Babuni, thanks for watching. I haven't covered persistent volume back up in this video as I demostrated it in bare metal kubernetes. It would only work on cloud providers. But other resources, you can just follow this video. I might do a video on including pv backup in the future. Cheers.
Nice video Venkat! seems the installation of velero changed a bit since you make this video. Would you mind making a newer version and also this time including backup of PVs?
Hi Jp, thanks for watching. I don't have a running cluster in any of the cloud. I only setup clusters few times for recording videos. But if I get some time I will give it a try. Cheers.
@@liliiabutorina2526 I believe you should be able to backup and restore kube-system namespace as well. If you are using one of managed kubernetes service from any cloud providers, you don't really have to worry about kube-system namespace which is mainly used for cluster components. You should be deploying all your applications in a separate namespace other than kube-system.
@Just me and Opensource Thanks for the Videos.. I have a query, I have a configured all the stuff like minio,Velero everything and taken the backups too, now i need to restore the data's into the new server how to do that? am confused can you please educate me..
Hi Antony, thanks for watching. So you have deployed velero in your existing Kubernetes cluster and took the backup of what you want. Now in order to restore it to a different kubernetes cluster, you will have to update your kubeconfig file to point to the new k8s cluster. Velero uses your kubeconfig file to interact with the k8s cluster. You are still connecting to the same minio object storage server where the backups are. Then you can follow the same process shown in this video to restore from backup. Cheers.
Hi Sir. You great sir and i need some help on below this how to migrate my data is available in PVC then i need to move this data into new Kubernetes pods of PVC.
Thanks Venkat for this nice training video. Just a quick query, is there any other video which talks about taking backup of the persistent volumes and restoring the same.
Hi Durga, thanks for watching. I haven't done any video on backup/restore of persistent volumes using Velero. So far Velero has only been supporting backups of PVs in the cloud. Now it seems there is Restic integration with Velero that supports backing up of other supported volumes as well including NFS. velero.io/docs/master/restic/ But I need to explore that. Cheers.
Hi Venkat, thanks for watching. There is no automatic restore of backup. If you have taken backups of the namespace, then you can restore it. Its not the best practise to automate restoring of backups. Cheers.
Hi Venkat, thanks for watching this video. I haven't used it with Openshift but it should be the same I guess. The below link might be helpful. blog.openshift.com/backup-openshift-resources-the-native-way/ Thanks.
Can someone help me with the below exception while setting up the valero in the cluster --> Error creating resource Deployment/velero: the server could not find the requested resource
Hi Girts, thanks for watching. Do you mean another cluster? Yes its possible. Thats the main use case. You will have to install Velero on the other cluster as well to be able to restore.
Hi Gonzalo, thanks for watching this video. Basically, you don't have to backup etcd separately. When you are performing a backup using Velero, it queries the etcd for the current state of the cluster. Etcd is the datastore and is used during the backup. If you want to backup etcd, then you can create a snapshot of the current state of the etcd datastore. I came across below article in Coreos website. support.coreos.com/hc/en-us/articles/115000323894-Creating-etcd-backup Thanks.
Hi Prashanth, thanks for watching this video. I believe you can. If you already backed up your cluster while you had velero namespace, you should be able to restore. But you won't be able to backup with out it. I am not 100% sure about this. I may be wrong. I haven't tested that scenario. Thanks.
yes you can. Using velero, you are just backing up the resources (like pods, daemonsets, deployments etc) in your cluster. You can then deploy those resources in any k8s cluster.
Hi, thanks for watching this video. I used v1.0.0 of Velero (github.com/vmware-tanzu/velero/releases/tag/v1.0.0). The latest version is v1.2.0 (github.com/vmware-tanzu/velero/releases/tag/v1.2.0) which introduced this requirement of --plugin to the velero install command. But reading through the documentation, it was mentioned that --plugin is optional.
@@justmeandopensource Here is one answer that will work: velero install --provider aws --plugins velero/velero-plugin-for-aws:v1.0.0 --kubeconfig config --bucket bucketone --secret-file ./minio.credentials --backup-location-config region=minio,s3ForcePathStyle=true,s3Url=10.12.16.144:9000 where velero version is v1.2.0 velero plugin for AWS svelero/velero-plugin-for-aws:v1.0.0 config is config for your kubernetes cluster 10.12.16.144:9000 is the address for Minio container bucketone is Minio storage bucket
I tried to replicate this exercise with K3D to no avail. It seems that velero does not suport K3D generated clusters. Now I'm trying to replicate this lab using KinD. Let's see if I can do it. Thanks For The Video!
Velero pod is failing with below error "An error occurred: some backup storage locations are invalid: backup store for location "default" is invalid: rpc error: code = Unknown desc = RequestError: send request failed caused by: Get 127.0.0.1:9000/kubedemo?delimiter=%2F&list-type=2&prefix=: dial tcp 127.0.0.1:9000: connect: connection refused"
Do the following: kubectl delete deploy velero -n velero && kubectl delete ns velero Then when you rerun the velero install command make sure you put your computers local address such as (192.168.1.2) in the s3Url=:9000 part of the command. Additional note for anyone who has a more up to date version of the velero binary you will need to include an additional --plugins flag Here was my command: velero install \ --provider aws \ --plugins velero/velero-plugin-for-aws:v1.1.0 \ --bucket kubebackup \ --secret-file ./minio.credentials \ --backup-location-config region=minio,s3ForcePathStyle=true,s3Url=192.168.1.2:9000 I was unable to get this demo to work as even with my local IP in the install command i would get a failed connection from the kind cluster to the docker minio. I took the path of installing minio into my cluster using helm (helm install stable/minio -n minio) and for s3Url=minio.default.svc.cluster.local:9000 and that worked.
1. How can I take the etcd backup on our vagrant provisioned cluster? ajeesh@Aspire-A515-51G:~$ kubectl exec -it -n kube-system --etcd-kmaster.example.com-- -- sh # ./etcd-manager-ctl --help sh: 1: ./etcd-manager-ctl: not found # 2. Regarding the Velero i have some issue: ajeesh@Aspire-A515-51G:~$ velero backup get NAME STATUS CREATED EXPIRES STORAGE LOCATION SELECTOR namespacenginx New 29d ajeesh@Aspire-A515-51G:~$ velero backup logs namespacenginx Logs for backup "namespacenginx" are not available until it's finished processing. Please wait until the backup has a phase of Completed or Failed and try again. ajeesh@Aspire-A515-51G:~$
velero backup create mybackup2 --include-namespaces nginxbkp --wait Backup request "mybackup2" submitted successfully. Waiting for backup to complete. You may safely press ctrl-c to stop waiting - your backup will continue in the background. ..................................................................................................................................................................................... My backup is taking too long, please help velero backup get NAME STATUS CREATED EXPIRES STORAGE LOCATION SELECTOR mybackup New 29d mybackup2 New 29d
Hi Anbu, thanks for watching. Is it just this namespace that you have problems backing up? Have you tried any other namespace or any other backup options? None of you backups are completing?
It will be hard to troubleshoot remotely. I haven't had any of those problems. Its worth getting as much information as possible and ask in StackOverflow with much details. Sorry I couldn't be of any help here.
Deleting Backups Use the following commands to delete Velero backups and data: kubectl delete backup -n will delete the backup custom resource only and will not delete any associated data from object/block storage velero backup delete will delete the backup resource including all data in object/block storage
velero backup create mybackup2 --include-namespaces nginxbkp --wait Backup request "mybackup2" submitted successfully. Waiting for backup to complete. You may safely press ctrl-c to stop waiting - your backup will continue in the background. ....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... Too long
![[ Kube 46 ] Kubespray Vagrant Demo](http://i.ytimg.com/vi/dz-nuXbvqWU/mqdefault.jpg)
![[ Kube 46 ] Kubespray Vagrant Demo](/img/tr.png)
![[ Kube 35 ] Using Horizontal Pod Autoscaler in Kubernetes](http://i.ytimg.com/vi/uxuyPru3_Lc/mqdefault.jpg)
![[LIVE] : ONE ลุมพินี 89 | คู่เอก "ยอดไอคิว vs คิริลล์"](http://i.ytimg.com/vi/Z3vYkHJ_5Ig/mqdefault.jpg)
Thanks for your Videos. All your videos are very nice and also which give us the latest technology overview. Keep rocking.
Hi Dilip, thanks for watching this video and taking time to comment. Cheers.
Cluster Migration using velero:-
- need 2 cluster
- create namespace in cluster 1
- install velero server on cluster1 and take backup of namespace from cluster1
- now install velero server with same minio credentials and endpoint on cluster 2
- check velero backup available on cluster2 which we created on cluster1
- now restore backup on cluster2
- on cluster2 namaspace is available
Migration completed
Perfect. That's the way to go. Cheers.
@@justmeandopensource i tried in similar way but it didnt work : An error occurred: file not found
Thank you so much. Looking forward on how to backup the volumes. :)
Hi Bethoveen, thanks for watching this video. I will add it to my list and get that done when I get some time. Cheers.
@@justmeandopensource Thank you waiting for the Volumes video
@@tannaalok Thanks. Actually there is Restic integration with Velero, using which you can snapshot/backup NFS persistent volumes. But it is in beta version so may not work very well. I will have to explore the options. Cheers.
Thanks you so much. The video is super useful and very clear about instructions. I happy to watch this video.
Hi Abishek, thanks for watching. Cheers.
Amazing content, you're doing God's work here. I will contribute as many times as I can ! Regards
Hi Felipe, many thanks for your contribution. Much appreciated. Cheers.
Thanks for your videos. Very helpful for me. Please teach us more. Looking forward to learn more from you sir!
Hi Soundarya, thanks for your interest in this channel. I will certainly be doing more videos. Cheers.
Hi, I have followed your video and installed velero via docker desktop on windows 10.
created bucket at minio console and installed velero which the command you provided.
After executing the command "velero backup create firstbackup --include-namespaces testing",
"firstbackup" folder is not getting created and cannot visible under /kubedemo on minio console.
and getting status as below after giving the command "velero backup get "
NAME STATUS ERRORS WARNINGS CREATED EXPIRES STORAGE LOCATION SELECTOR
firstbackups Failed 0 0 2021-04-06 20:54:34 +0530 IST 29d default
could you please suggest.
Hi Prasad, thanks for watching. I think in the newer versions of velero the arguments have changed slightly so I will need to re-test this and may be post a new video soon.
@Just me and Opensource : Thanks so much for your reply. waiting for your new video. can I have your mail id plz to clarify some doubts as I have been stucked with this by 2 weeks.
@@prasadm1067 there is a slack workspace for this channel. May you can ask your questions there as well. You can find the invite link in the channel banner. I hardly get any free time these days. So others might be able to answer your queries as well.
@@justmeandopensource : Yes I am trying to login the same. Thanks for your quick reply.
Thanks for this video..I'am new to devops and want to switch job in devops position, but its getting very difficult for me to prepare for technical interviews since I dont have real time experience of devops culture and work. I would be very grateful to you if you would provide some overview of how to prepare for devops technical interview.What should be the preparation areas..topics to cover..not the technicalities or technical details but the overall idea of how should be the preparation points and topics. It would be a much help.
Many many Thankyou in advance.
Nice Video and good information for starting...
Hi Shirish, thanks for watch.
@Just me and Opensource Awsome, Thank you so much & it is crystal clear
Thanks so much, absolutely great video
Hi Sajith, thanks for watching. Cheers.
Thanks for your vidéo. waiting for second video :)
HI Siva, thanks for watching.
Thank you! Great video!
The idea migrate cluster very cool, i really need it, hope you spend time to do it.
Hi Bao, thanks for watching this video. I will see if I can do that video. Cheers.
Hi venkat. Excellent content and presentation. Can you please do a demo for back up and restore of pv? Preferably mongodb replicas. Is that possible in Valero?
Hi Sanjeev, thanks for watching this video. Backup and restoring of persistent volumes is possible with Velero. But you need to use a supported storage provider for that. Unfortunately in my setup on bare metal, I use nfs-provisioner which is not supported by Velero. If you happen to use any of the managed Kubernetes in the cloud (EKS, GKE, Azure), its possible to test pv backup restore.
In the future, I will see if I can get that done in AWS.
Thanks.
Thanks for the wonderful video. Is there any way we can configure local back-up storage for Velero instead of AWS, Azure or GCP..?
Thanks for watching. You can use minio (I guess thats what I used in this video) as an object storage. Just runs in a container. Cheers.
Hi Venkat, the video is super useful and very clear about instructions.
I have AWS EKS deployed through rancher and AWS EFS as persistent volumes.
Could you please share the insights to perform backups and restores. This video is not covering persistent volumes though, great thanks in anticipation.
Hi Narasimha, thanks for watching this video. I haven't tried it on AWS yet. Just on my local environment. In order to backup and restore persistent volumes, you will have to use supported storage provider in the first place. In this video, I used NFS provisioning for dynamic storage which is not supported by Velero. I will see if I can explore further in this topic. Cheers.
Thanks Venkat for your kind response. Much appreciated. Could you please let me know is there anyway that i can get in touch with you, thanks.
@@OZIndkids No worries. I have a Slack workspace for this channel where there are over 100 users. You may find it useful joining the workspace and discussing with fellow users who have similar interest in kubernetes.
join.slack.com/t/justmeopensource/shared_invite/enQtODg4NDcxMTg5Mjk2LTgyNWJkMzlmNzRlMDdhYzc2ZjA3NjA0N2ZkODg5NzAyMzNjMGY4OGJjZDkzNmRhNDU1ZjEzZjc1NzhiMjBlMmI
Cheers.
You talk about a kaind setup done in a previous video, which one are you referring to?
Hi, can you point me to the exact time in this video where I mentioned it? I can then comment on it. Cheers.
@@justmeandopensource minute 11:25
Hi Venkat, Do you have a tutorial on rotating the Kubernetes component certificates? The Kubernetes generate the certs for 1 year for all its component and I am looking into a method to rotate it before it expires.
Hi Kulwant, thanks for watching this video. I haven't looked deep into certificates yet. Most of my videos were based on kubeadm installation method which auto-generates the certificates. I will look into it and if I find a proper solution, I will make a video of it. Thanks.
Hey @venkat, can we use the velero for backup from old K8s cluster and restore in the new cluster? Yes, Pointing on the same velero configuration is needed. What else?
Very Helpful video .....My scenario is we want to shutdown/delete eks cluster for a few months and then restore back (until then we won't have any eks cluster to store backup endpoints or objects) so will this help me if not please can you suggest alternative
Hi Ashish, thanks for watching. I don't think you can shutdown an EKS managed cluster. You can however reduce the number of worker nodes. But if you are not going to use, then the only possibility is to delete the EKS cluster. Velero is exactly for this. Just take a backup of your cluster including persistent volumes and then you can restore it to any cluster.
hello, all the backups are saved in same "backup" folder. can we created different folders to store backups of different clusters in diffirent folders but same s3 bucket?
Hi Zoe, thanks for watching. You can actually achieve that with "objectStorage/prefix" option.
The directory inside a storage bucket where backups are to be uploaded.
velero.io/docs/v1.1.0/api-types/backupstoragelocation/
Awesome! It has helped a lot! Can you please create some more content around this like back-up and restore using snapshots. Keep teaching the world! :-)
Hi Nikhil, thanks for watching. I will certainly be doing more videos on Kubernetes as and when I find time. Cheers.
Awesome dude. I have learned so much from you. Do you have a video for Velero and PVC backup and restore?
Hi, thanks for watching. I haven't done velero with persistent storage backup/restore. When I did this video, there wasn't any support for nfs provisioner as persistent storage. Now there is Restic. I have it in my list to try though.
Thanks a lot. This is something that I've been waiting for! I've few doubts though. In my case, I've to host multiple WordPress sites. Each site will have its own namespace
1) Is Velero production-ready to back PV? All my states are saved in NFS servers mounted as PV
2) How can I backup/restore programmatically, like by calling an API? My use case is that my clients should be able to backup/restore their wp site on clicking a button
Hi Gijo, thanks for watching this video.
Velero is production ready and it can backup persistent volumes as well. Having said that, it doesn't support all persistent volumes. You will have to use a supported storage provisioner to make use of volume snapshots. Unfortunately its not a lot that is supported at the moment.
heptio.github.io/velero/master/support-matrix.html
NFS is not supported.
I am not sure of any API for programmatic access.
Thanks
@@justmeandopensource ok. Thanks a lot :) I'll look into it
@@gijovarghese7548 You are welcome. Please let me know if you find something thats useful.
@@justmeandopensource have you tried github.com/stashed/stash?
@@gijovarghese7548 Looks interesting. Thanks for sharing this. I will definitely give this a try when I get some free time.
Thank you for the video on valero. when you get some time can you please share the video how to restore the PV using valero/heptio ark
Hi Venkat, thanks for watching this video. I will try to do that. But on bare metal, you have to choose an appropriate storage provider that supports snapshots. But its easy to do if we operate in cloud. Anyways, I will play with it and record a video when I get some time. Thanks
@@justmeandopensource Hi, Please do this
@@rickyclarke1267 Struggling to find time.
Hi, as suggested in the video what is the link for velero backup migration from one cluster to other cluster, i could not find it on your channel.
Hi Venkat. Thank you so much for this video. But I need an help from you for implementing the backup of the aws lab eks cluster resources. I have to perform this task as there was an issue in our labs because the namespaces got deleted accidentally and they were not having backup available for lab environment. Can you please help me out for this issue on how can I make scheduled back ups and setup RBAC role to restrict certain commands to execute and setup whole automation process for the lab eks cluster. Is this possible to do all these steps with velero? Can you please make one video for me on this which will help me out a lot and your help will be really appreciated.
Perfect, thank you so much for this video
In a k8s 1.11.10 cluster i'm trying to backup the PVC's resources from deployments, velero sayd, YES i've backuedUP (i'm using restic) i see in the backup log that the pvc was backuedup, but! when i'm trying to restore, velero restore the PVC but empty .... if i'm doing the same thing with a simple POD everithing works fine.
Do you know why?
PS: the annotations are present in both resources of course :)
thanks
Great efforts!!!Thank you for the video!!! How to perform reliable backups of any persistent state ?
Hi Hari, Thanks for watching. If you are using one of the supported persistent storage then Velero can back up persistent volumes as well. All cloud storage is supported. My setup was on local workstation where I used NFS as storage provisioner. At the time of recording this video, nfs is not supported but later it was possible through Restic.
Thanks a lot for all your videos. Just wanted to ask, is there any to automate the restore steps? In case the primary data centre is down, I would like to restore the application and data in the other data centre automatically.
Thanks for the Video. Please do a video on PV backup and restore. We are moving our cluster from One region to another, can we achieve it using Velero?
Hi Prashanth, thanks for watching this video. You can absolutely use Velero to move your cluster from one region to another. You can backup everything and restore just what you want on the target cluster. If you are using cloud provider, then you can also backup the PV. Unfortunatley I am not there yet. All my clusters are based on bare metal on-prem and my storage solution for PVs are NFS, which are not supported by Velero.
Thanks.
@Rohan Shinde Clearly NFS storage provisioning is not supported by Velero. It has to be one of their supported storage provider, if you want to do backups of persistent volumes. It is very unfortunate they don't support NFS.
Having said that, there is Restic integration with Velero, which you can use for NFS snapshots. But it is beta version.
velero.io/docs/master/supported-providers/
velero.io/docs/master/restic/
Cheers.
I am not able to get velero to work successfully on the new cluster. I think it has something to do with the IAM permissions. Since we already created IAM permissions and IAM service account for the velero in the first cluster, it is conflicting with the permissions for the new cluster. I need help to figure out how to make it work.
Hello, I face difficulties when i create a backup on cluster 1 and restore it on cluster 2 with the same minio credentials. Could you please provide steps to do that as well.
thanks for the best content. But can you do it with a backup of a stateful set app /app with pvc ?? Will helpful a lot
Hi, thanks for watching. When I recorded this video, there wasn't any support for backing up NFS backed storage. Although later Velero added Restic integration to take snapshot of NFS volumes as well. I haven't tried it.
@@justmeandopensource hope you will get it done ,when you have time .
hello Venkat thakn you for your bup.
I follow your tuto and i have got some erro when i want to initialise
container. pod/velero and deployment.app/velero always stays in statut 0/1 any idea ?
Hi Cheik, thanks for watching this video. Have you checked the "kubectl describe pod " & "kubetl describe deploy velero" command to see why its failing?
Thanks
@@justmeandopensource
OK i retry its OK Yes it was a bad configure.
Thak you verry much this vidéo really helped in m'y projet thanks alot
@@cheikamedmaoulida7367 Cool. Glad to hear that the video was useful. Cheers.
thanks for your nice video ...can you please tell me if this tool works for my application migration ... I have a Kubernetes cluster running with a few applications and storage volume attached in this case CEPH RBD...now I need to migrate application data stored in Ceph which I need to migrate into another Ceph cluster ....
Hi Venkat,
thanks for sharing those videos. its really helpful....
here i got struck while installing Velero on Google Kubernetes Engine (GKE),
i have followed each step as you did in this video. but when i do VELERO VERSION, it throwing an error like this,
""" """"
what could be the reason ?
TIA
Hi Mahendra, thanks for watching. I used Velero 1.0.0 version in this video. Once you download the tar ball using wget and move velero to /usr/local/bin, you can do velero version to check the output. It is safe to ignore the server version error at this point as long as you see the client version.
In which node velero needs to be installed? Is it master or any worker node? Is it possible to install it outside the K8s cluster and has access to the K8s cluster?
Hi Anusha,
Thanks for watching. Velero installation actually deploys certain resources in your Kubernetes cluster. It doesn't deploy them specifically on master or worker nodes but just to your cluster. The resources/pods can actually run on any nodes. Velero installation consists of downloading the velero binary and installing the required components into the cluster.
thanks very much , it really helped. could you please let know the link of the other video which you mentioned for migration.
Nice video... I learned a lot, thanks anyway
Hi Shidiq, thanks for watching.
Thanks for the video
Hi Satish, thanks for watching.
How to restore pv in a completely new cluster using velero ?
I have a deployment with an attached pv. I am successfully backing up and restoring the same in the same cluster. How do I restore the same in a completely new k8s cluster ?
Hi Tushar, thanks for watching this video. In this demo I showed backup and restore of Kubernetes resources excluding persistent volumes. In order to backup and restore persistent volumes as part of velero process, we have to be using supported storage provisioning that supports volume snapshot feature. Since all my videos are based on bare-metal, I could only go with NFS dynamic provisioning for persistent volumes which are not supported storage backend.
Thanks.
@@justmeandopensource Hello, even I am using the same thing. I have 2 local clusters, each with one master 2 slaves architecture. I have a separate NFS in which I have installed docker and minio inside it. Is there absolutely no solution to restore backups taken in nfs from cluster 1 to cluster 2 ?
@@justmeandopensource Sir are you on slack or something ? I have a lot of questions actually.
@@tusharson Ahh. Minio is cloud native storage and is a supported backend in Velero. You should be able to backup and restore. I haven't explored that yet I am afraid.
I will have to test that. When I get some time, I will play with it and may be post a follow up video on this topic. Thanks.
Hi Tushar, You can ask questions in here. I will try my best to respond. I don't work outside of TH-cam and have a 9-6 primary job. Everyday I am setting aside some time to respond to viewers questions. Feel free to ask any questions. Bear in mind that I am not an expert. I am learning as well and sharing my knowledge. Cheers.
Could you pls provide the link for take backup namespace, pv,pvc, and other resources .. using Velero
Hi Babuni, thanks for watching. I haven't covered persistent volume back up in this video as I demostrated it in bare metal kubernetes. It would only work on cloud providers. But other resources, you can just follow this video. I might do a video on including pv backup in the future. Cheers.
@@justmeandopensource Thank you very much for your response ...Waiting for the next Video
And also provide me your TH-cam main Page and if is there any other channel related your uploaded video ..
Nice video Venkat!
seems the installation of velero changed a bit since you make this video.
Would you mind making a newer version and also this time including backup of PVs?
Hi Martin, thanks for watching. Yes I can do that. I will add it to my list.
Thank you. Can you please share a video on backup & restore using Velero from GKE to EKS or AKS.
Hi Jp, thanks for watching. I don't have a running cluster in any of the cloud. I only setup clusters few times for recording videos. But if I get some time I will give it a try. Cheers.
@@justmeandopensource those will be real world use cases which customers expect.
@@jpjp-gu5nf Yeah I agree.
Velero install --help
Btw, what is the command if i want to backup entire k8s cluster?
Hi Shidiq, thanks for watching this video. You will have to backup all the namespaces. Thats it.
@@justmeandopensource, is it possible to restore kube-system namespace. As i know, before restore i should remove object from target cluster.
@@liliiabutorina2526 I believe you should be able to backup and restore kube-system namespace as well. If you are using one of managed kubernetes service from any cloud providers, you don't really have to worry about kube-system namespace which is mainly used for cluster components. You should be deploying all your applications in a separate namespace other than kube-system.
it's works only on aws,gcp,azure? i can't backup local k8s cluster?
@Just me and Opensource Thanks for the Videos.. I have a query, I have a configured all the stuff like minio,Velero everything and taken the backups too, now i need to restore the data's into the new server how to do that? am confused
can you please educate me..
Hi Antony, thanks for watching. So you have deployed velero in your existing Kubernetes cluster and took the backup of what you want. Now in order to restore it to a different kubernetes cluster, you will have to update your kubeconfig file to point to the new k8s cluster. Velero uses your kubeconfig file to interact with the k8s cluster. You are still connecting to the same minio object storage server where the backups are. Then you can follow the same process shown in this video to restore from backup. Cheers.
@@justmeandopensource Thanks for the reply.. will check and confirm
@Just me and Opensource Thanks man for the help.. it works fine :) , Keep Roc(K)ing..
@@antonyjohnsoni5483 Cool.
@@antonyjohnsoni5483 Cool.
Thanks for the video sir
Is it possible to make a video for pv backup and snapshots
Hi, thanks for watching. I will add it to my list. I have a huge list of topics requested but surely I will get to this when I have some time. Cheers.
Hi Sir.
You great sir and i need some help on below this
how to migrate my data is available in PVC then i need to move this data into new Kubernetes pods of PVC.
Thanks Venkat for this nice training video. Just a quick query, is there any other video which talks about taking backup of the persistent volumes and restoring the same.
Hi Durga, thanks for watching. I haven't done any video on backup/restore of persistent volumes using Velero. So far Velero has only been supporting backups of PVs in the cloud. Now it seems there is Restic integration with Velero that supports backing up of other supported volumes as well including NFS.
velero.io/docs/master/restic/
But I need to explore that.
Cheers.
any method is there automatically restore backup when delete a namespace acciedentally
Hi Venkat, thanks for watching. There is no automatic restore of backup. If you have taken backups of the namespace, then you can restore it. Its not the best practise to automate restoring of backups. Cheers.
Perfect ...Thank you
Hi Venkat, Thanks for the video, Can we apply the same velero installation on OpenShift?
Hi Venkat, thanks for watching this video. I haven't used it with Openshift but it should be the same I guess.
The below link might be helpful.
blog.openshift.com/backup-openshift-resources-the-native-way/
Thanks.
Hi,
When i executed the velero install ***** command, am getting ERROR CREATING DEPLOYMENT
Hi Guys,
The issue with the version, i have used the latest version now there is no issue
Hi Bala, thanks for watching.
Nothing happens when: source
Can someone help me with the below exception while setting up the valero in the cluster --> Error creating resource Deployment/velero: the server could not find the requested resource
Same, error. Did you find a way to fix it?
Hi! Is it possible from backup to do restore to another env?
Hi Girts, thanks for watching. Do you mean another cluster? Yes its possible. Thats the main use case. You will have to install Velero on the other cluster as well to be able to restore.
Thank you ! wanted to confirm if Velero can backup pv from VMware
I think that should be possible. I haven't tried it though.
Excelent video !!! Can you do a ETCD backup with Velero and restore the cluster ? ( im investigation to do that in a HA cluster of k8s)
Hi Gonzalo, thanks for watching this video.
Basically, you don't have to backup etcd separately. When you are performing a backup using Velero, it queries the etcd for the current state of the cluster. Etcd is the datastore and is used during the backup.
If you want to backup etcd, then you can create a snapshot of the current state of the etcd datastore. I came across below article in Coreos website.
support.coreos.com/hc/en-us/articles/115000323894-Creating-etcd-backup
Thanks.
venkat, can you make the video on migration and also video including pv,pvc
Hi Khaleel, thanks for watching. I will see if I can do that. Cheers.
@@justmeandopensource That would be great if you can take time and perform the videos. Appreciate your work .... Cheers
@@KhaleelShaik-vd5wj no worries.
Can we delete the velero namespace itself and restore it??
Hi Prashanth, thanks for watching this video. I believe you can. If you already backed up your cluster while you had velero namespace, you should be able to restore. But you won't be able to backup with out it. I am not 100% sure about this. I may be wrong. I haven't tested that scenario. Thanks.
you're awesome
Hi Tarikur, thanks for watching this video.
Can I migrate the whole cluster to different CIDR of node ip?
Different VPC
yes you can. Using velero, you are just backing up the resources (like pods, daemonsets, deployments etc) in your cluster. You can then deploy those resources in any k8s cluster.
Thanks its nice..
Hi Venki, thanks for watching this video and taking time to comment. Cheers.
Hello Venkat, can you provide a transcript from your video please, it is very nice and informative thank you in advance.
It's awesome
Hi Santosh, thanks for watching.
@@justmeandopensource any reference or videos on restic
@@SanthoshKumar-sf8oi Not yet. Its in my list though. I have to spend some time exploring that.
hello bro is this correct for s3 bucket
velero install \
--provider aws \
--plugins velero/velero-plugin-for-aws:v1.0.1 \
--bucket s3://swagat1211 \
--backup-location-config region=ap-south-1 \
--secret-file ./aws.credentials
i am trying to save backup to s3 bucket . can you help me plz
@@Java_basic I will have to check this. But from the look of it, the command looks good.
Whether this will work on Cluster which has been setup using Kubeadm..!!
Hi Bala, thanks for watching. Yes it will work on clusters provisioned by any method.
thank you
Thanks for watching.
velero install command failed, An error occurred: --plugins flag is required
Hi, thanks for watching this video. I used v1.0.0 of Velero (github.com/vmware-tanzu/velero/releases/tag/v1.0.0). The latest version is v1.2.0 (github.com/vmware-tanzu/velero/releases/tag/v1.2.0) which introduced this requirement of --plugin to the velero install command. But reading through the documentation, it was mentioned that --plugin is optional.
@@justmeandopensource Here is one answer that will work:
velero install --provider aws --plugins velero/velero-plugin-for-aws:v1.0.0 --kubeconfig config --bucket bucketone --secret-file ./minio.credentials --backup-location-config region=minio,s3ForcePathStyle=true,s3Url=10.12.16.144:9000
where
velero version is v1.2.0
velero plugin for AWS svelero/velero-plugin-for-aws:v1.0.0
config is config for your kubernetes cluster
10.12.16.144:9000 is the address for Minio container
bucketone is Minio storage bucket
After I used plug in I am getting manifest is unknow
Can you restore a backup on another cluster?
Hi, thanks for watching. Yes you can restore it into another cluster.
@@justmeandopensource I am checking if I can find the same tool as operator for openshift. Thanks so much.
No worries.
thnks man
HI Rafael, thanks for watching. Cheers.
I tried to replicate this exercise with K3D to no avail. It seems that velero does not suport K3D generated clusters. Now I'm trying to replicate this lab using KinD. Let's see if I can do it. Thanks For The Video!
Thanks for watching.
Velero pod is failing with below error "An error occurred: some backup storage locations are invalid: backup store for location "default" is invalid: rpc error: code = Unknown desc = RequestError: send request failed
caused by: Get 127.0.0.1:9000/kubedemo?delimiter=%2F&list-type=2&prefix=: dial tcp 127.0.0.1:9000: connect: connection refused"
Do the following: kubectl delete deploy velero -n velero && kubectl delete ns velero
Then when you rerun the velero install command make sure you put your computers local address such as (192.168.1.2) in the s3Url=:9000 part of the command.
Additional note for anyone who has a more up to date version of the velero binary you will need to include an additional
--plugins flag
Here was my command:
velero install \
--provider aws \
--plugins velero/velero-plugin-for-aws:v1.1.0 \
--bucket kubebackup \
--secret-file ./minio.credentials \
--backup-location-config region=minio,s3ForcePathStyle=true,s3Url=192.168.1.2:9000
I was unable to get this demo to work as even with my local IP in the install command i would get a failed connection from the kind cluster to the docker minio.
I took the path of installing minio into my cluster using helm (helm install stable/minio -n minio) and for s3Url=minio.default.svc.cluster.local:9000 and that worked.
1. How can I take the etcd backup on our vagrant provisioned cluster?
ajeesh@Aspire-A515-51G:~$ kubectl exec -it -n kube-system --etcd-kmaster.example.com-- -- sh
# ./etcd-manager-ctl --help
sh: 1: ./etcd-manager-ctl: not found
#
2. Regarding the Velero i have some issue:
ajeesh@Aspire-A515-51G:~$ velero backup get
NAME STATUS CREATED EXPIRES STORAGE LOCATION SELECTOR
namespacenginx New 29d
ajeesh@Aspire-A515-51G:~$ velero backup logs namespacenginx
Logs for backup "namespacenginx" are not available until it's finished processing. Please wait until the backup has a phase of Completed or Failed and try again.
ajeesh@Aspire-A515-51G:~$
Hi Ajeesh, thanks for watchig. I haven't explored much into it. i will see if I can do this. Cheers.
velero backup create mybackup2 --include-namespaces nginxbkp --wait
Backup request "mybackup2" submitted successfully.
Waiting for backup to complete. You may safely press ctrl-c to stop waiting - your backup will continue in the background.
.....................................................................................................................................................................................
My backup is taking too long, please help
velero backup get
NAME STATUS CREATED EXPIRES STORAGE LOCATION SELECTOR
mybackup New 29d
mybackup2 New 29d
Hi Anbu, thanks for watching. Is it just this namespace that you have problems backing up? Have you tried any other namespace or any other backup options? None of you backups are completing?
It will be hard to troubleshoot remotely. I haven't had any of those problems. Its worth getting as much information as possible and ask in StackOverflow with much details. Sorry I couldn't be of any help here.
Deleting Backups
Use the following commands to delete Velero backups and data:
kubectl delete backup -n will delete the backup custom resource only and will not delete any associated data from object/block storage
velero backup delete will delete the backup resource including all data in object/block storage
We hardly see your words.. Bad.
velero backup create mybackup2 --include-namespaces nginxbkp --wait
Backup request "mybackup2" submitted successfully.
Waiting for backup to complete. You may safely press ctrl-c to stop waiting - your backup will continue in the background.
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Too long