I have been working on making a monitoring service by myself for Kubernetes worker nodes using Kafka and other setups (which I will suggest for the new learners that don't go on that route). Then one of my friends recommended me to get out of the exhausting approach and go for Prometheus setup with some visualizing tool Grafana, etc. for monitoring service purpose. After a week of searching, I always got the lengthy and exhausting tutorials of creating all lengthy configuration files by yourself which Nana is 100% absolutely right for if you miss one step, it can potentially lose your very precious time. This second method is intuitively very good. I will definitely try it out. Looking forward to good results
What an amazing video; I especially love the parts where you go beyond just installing like showing what the pods created are actually used for. Kudos also for the time spent in showing the different Grafana dashboards automatically created!
Dear Nana, please make tutorial, how to setup Istio in Kubernetes, and how all that works. Your tutorials are super clear and professional. Thank you 🙏🏼
Amazingly clear for operator and Prometheus deployment in minikube Question: * why the port-forward is done in deployment for grafana, while it is on pod for prometheus ui Comments: * it will be good to state the version u demoed like helm/3.2.4, prometheus-operator/9.1.0, so users can repeat your exercise with the same version when needed * copy/paste command, it will be good to have related blog (even just git repo) with your each video, so we can copy paste for some commands. Well done! i like your series, short and clear introduction with demos
Hi Larry, thanks a lot for your great suggestions and feedback. To your question: it works for both, doesn't matter which one you take. if you have multiple pods, then you can do port-forward for deployment. As for your notes: sounds great! 👍 Will add the versions in the description and will put the commands in the dev.to blog and/or in git repo!
Thanks for the help Nana - you are a great teacher! BTW, here's the current helm command: helm install p1 prometheus-community/kube-prometheus-stack On WSL2 use: helm install p1 prometheus-community/kube-prometheus-stack --set prometheus-node-exporter.hostRootFsMount.enabled=false
20:00 you can also create a port-forward for a service, not only a deployment or pod ... i prefer services because its unlikely the service name changes and so its more likely to still works when you reuse the command from your history
love you thank you for keeping your videos up to date! The fact you added new GitHub repo to a non-depricated version amazes me you saved me enough time to leave you a positive comment. Thanks again!
Nana, fantastic. The way you are explaining each concept is very much impressive. I am not finding words. Of all I like the way you pronounce each word and how you use your words in explaining these technology. I am a big fan. Thank you so much!
Awesome video, super informative. But, just wanted to point out you spelled initiale wrong at 3:08. Do not mean to nit pick. Just though you might want to know... But probably the best Helm/K8s video I have seen yet. Keep the awesome work coming!
Thanks Nana for this video! I'd really love to see how to setup metrics and monitoring your application in a cluster with Prometheus. But thanks so much for this explanatory video!
Hi, I will cover this in the second part of the demo. Which I will create in the next weeks, so stay tuned for it :) Maybe turn on the bell to get notified
@@TechWorldwithNanaHello Nana, your videos are awesome videos. Did you make the video for the second part on setting up metrics? Could you please share the link?
Hi Nana, this is a amazing series so far - your explanations are very concise and easy to understand. If possible, would it be possible for you to do a video on metrics / monitoring tools such as Elastic / New Relic etc.
Hi, thank you so much, really appreciate your feedback :) I'll create a complete Elastic course and will release it in September on udemy. I will announce it here on my channel :)
very interesting and the whole thing can easily be transposed to any cloud environment. I experimented with Azure Cloud, the only small problem was that port forwarding to prometheus required the addition of a configuration file for load balancing.
Nana, you rock! Thanks for those vids. There is so much rubbish out there but these are some of the hard to find pearls!!! I always knew that I need Prometheus to keep an eye on my various clusters but never found the time to investigate deeper. Now I know how to start. :)
Thank you Nana. This is very helpful. Please let us know when you have Prometheus exporter sidecar tutorial to scrape metrics for DB or microservices running in pod.
Hi, currently working on recording part 2. Will be uploaded in 2 weeks. I think it will be super helpful, I needed to figure out much by myself becauseI didn't find any proper documentation about it.
As always, terrific video! Thank you so much for doing what you do! FYI: The helm chart was renamed and the links have changed. github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack hub.helm.sh/charts/prometheus-com/kube-prometheus-stack
If someone has troubles like me because the installing mode using 'helm install stable/...' is not installing nothing here is the new form: Link to official repo: github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack >helm repo add prometheus-community prometheus-community.github.io/helm-charts >helm repo update > helm install [RELEASE_NAME] prometheus-community/kube-prometheus-stack
Hey Thank you Nana for short tutorials. Very concise. Saves us from surfing lots of web pages! :D In next videos, are you planning to cover more of 'operator' operations like, scaling up nodes, taking backup of stateful application, upgrading, etc?
Hello Nana, I really enjoy your videos, very informative and well explained. I have a request for you , will yyou please make a video tutorial on Tracing using "Jaeger"?
This is absolutely spot on Fantastic stuff. Thanks a ton for your effort.Extremely helpful. Just one question : may be i am blatantly missing something here, but as per the prometheus statefulset description, it was mounting just the secret volume which had a secret, wondering from where is it getting all the scraping endpoints configurations. Was there another config volume which i missed or is it outsourced to config-reloader container, which is part of the same pod?
Thank you so much. You're right, it can be confusing. So the configuration file for Prometheus and alert manager is actually in the secret not configMap as you would expect. So that's where the configuration for all scraping endpoints come from. Let me know if this info helps :)
I have subscribed your channel and it’s simply super .. your explanation on each and every service is simple and very clear ... waiting for 2nd video thank you
yes because after reboot it all crashes... Warning FailedMount 3m19s (x2 over 14m) kubelet Unable to attach or mount volumes: unmounted volumes=[sc-dashboard-provider kube-api-access-wbnv6 config], unattached volumes=[storage sc-dashboard-provider sc-dashboard-volume kube-api-access-wbnv6 sc-datasources-volume config]: timed out waiting for the condition
Hi Nana, Thanks a lot for making videos for us and sharing knowledge :), i saw your other video on istio, and here I'm again.! So once the kubernetes setup is done is it a good idea to directly setup istio as it comes with grafana and prometheus and your favorit kiali
Sooper nana .wonderful and different which makes us dwelling in to lot of areas ...can u please make us understand how to install certificates to make a particular application to be secure protocol https...with any free domain for any open source application such as nexus in case ...for example ...
@@TechWorldwithNana yes nana ...for cluster it would be better if u really could enlighten us on that ...take for example if we want to keep Jenkins server behind ingress https ..like that...
@@jonnykopp Hi Rabble, just came across your comment again. I have announced a few video/course topics, which I create in the next weeks/months in the Communities tab of my channel. If you didn't already see it :)
Hi Nana, Great work. Do you have video which shows /explain how we deploy from github to Kubernetes using any of the pipeline which will also have build stage in it?
NOTE: Prometheus Operator shown in Video is Deprecated. See the git repo for new operator installation and other relevant commands: gitlab.com/nanuchi/youtube-tutorial-series/-/blob/master/prometheus-exporter/install-prometheus-commands.md Used versions in the demo: ► helm version: v3.2.1 ► prometheus-operator: v0.38.1 Prometheus Architecture explained ► th-cam.com/video/h4Sl21AKiDg/w-d-xo.html Kubernetes Operator explained ► th-cam.com/video/ha3LjlD6g7g/w-d-xo.html ▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬ 0:00 - Intro 0:05 - Recap Prometheus architecture 0:52 - How to deploy all the parts into K8s cluster - 3 options 3:10 - Setup with Prometheus Operator using Helm 4:10 - Understand what components were created and what they do? 10:00 - What's inside Prometheus, Operator? 19:13 - Access Grafana UI 23:30 - Access Prometheus UI 24:52 - Summarize
For People who had the same issue than me by deploying at Jan. 2021: Error: failed to download "stable/prometheus-operator" (hint: running `helm repo update` may help) The Prometheus Stack was changed to "kube-prometheus-stack" you must add the helm repo "prometheus-community.github.io/helm-charts" and install it from there. "helm install prometheus stable/prometheus-operator"
Thanks you showing the demo, can you please show us how to configure nginx-ingress controller and in production cluster we can not do port forward. Currently I am trying to do it but facing challenges.
Hi, where is your cluster running. Depending on that, nginx-ingress will be configured differently. I have shown configuring Nginx-ingress in Minikube and also in LKE cluster. So you can check one of those, maybe it will helpful for you.
hi, thanks for the great video, but have a small question: is there an explanation how to configure several kuberenetes clusters to be monitored from a centralized prometheus/grafana server?
Hi Nana, What is difference Prom+Grafana vs Kubernetes Dashboard if we want to monitor k8s cluster? Or in which scenarios Prom+Grafana should be used over Kubernetes Dashboard
![[MV] A leap of faith...ความเชื่อใจครั้งสุดท้าย (From "Petrichor the series")](http://i.ytimg.com/vi/U1piZH2CNXA/mqdefault.jpg)
I have been working on making a monitoring service by myself for Kubernetes worker nodes using Kafka and other setups (which I will suggest for the new learners that don't go on that route). Then one of my friends recommended me to get out of the exhausting approach and go for Prometheus setup with some visualizing tool Grafana, etc. for monitoring service purpose. After a week of searching, I always got the lengthy and exhausting tutorials of creating all lengthy configuration files by yourself which Nana is 100% absolutely right for if you miss one step, it can potentially lose your very precious time. This second method is intuitively very good. I will definitely try it out. Looking forward to good results
The most thoughtful, in-depth yet concise explanation of how Prometheus is! Great work!
What an amazing video; I especially love the parts where you go beyond just installing like showing what the pods created are actually used for.
Kudos also for the time spent in showing the different Grafana dashboards automatically created!
Yes, exactly. Nana rocks!
Dear Nana, please make tutorial, how to setup Istio in Kubernetes, and how all that works. Your tutorials are super clear and professional. Thank you 🙏🏼
Glad my tutorials are helpful for you! Istio is on my list 👍:)
Amazingly clear for operator and Prometheus deployment in minikube
Question:
* why the port-forward is done in deployment for grafana, while it is on pod for prometheus ui
Comments:
* it will be good to state the version u demoed like helm/3.2.4, prometheus-operator/9.1.0, so users can repeat your exercise with the same version when needed
* copy/paste command, it will be good to have related blog (even just git repo) with your each video, so we can copy paste for some commands.
Well done! i like your series, short and clear introduction with demos
Hi Larry, thanks a lot for your great suggestions and feedback.
To your question: it works for both, doesn't matter which one you take. if you have multiple pods, then you can do port-forward for deployment.
As for your notes: sounds great! 👍 Will add the versions in the description and will put the commands in the dev.to blog and/or in git repo!
Thanks for the help Nana - you are a great teacher!
BTW, here's the current helm command: helm install p1 prometheus-community/kube-prometheus-stack
On WSL2 use: helm install p1 prometheus-community/kube-prometheus-stack --set prometheus-node-exporter.hostRootFsMount.enabled=false
Thanks a lot :)
20:00 you can also create a port-forward for a service, not only a deployment or pod ... i prefer services because its unlikely the service name changes and so its more likely to still works when you reuse the command from your history
love you thank you for keeping your videos up to date! The fact you added new GitHub repo to a non-depricated version amazes me you saved me enough time to leave you a positive comment. Thanks again!
Nana, really learning a lot with these videos related to k8s. Please consider adding tutorials on istio and spinnaker.
Hi Abdul, thanks for your suggestions! Istio will come in a few weeks 👍
Nana, fantastic. The way you are explaining each concept is very much impressive. I am not finding words. Of all I like the way you pronounce each word and how you use your words in explaining these technology. I am a big fan. Thank you so much!
One of the best K8S channel tutorials keep it up
Thank you so much! :D
Finally my 20% project is completed. Please make video specific to grafana and how to write it's ini file like configuring SMTP etc
Are you using the helm chart for prometheusoperator?
Awesome video, super informative. But, just wanted to point out you spelled initiale wrong at 3:08. Do not mean to nit pick. Just though you might want to know... But probably the best Helm/K8s video I have seen yet. Keep the awesome work coming!
Thank you very much for your feedback greg :)
This is a great channel for all Devops content. Kudos for the effort in creating such an amazing content.
Thanks Nana for this video! I'd really love to see how to setup metrics and monitoring your application in a cluster with Prometheus. But thanks so much for this explanatory video!
Hi, I will cover this in the second part of the demo. Which I will create in the next weeks, so stay tuned for it :) Maybe turn on the bell to get notified
@@TechWorldwithNana Bells turned on!!
@@TechWorldwithNanaHello Nana, your videos are awesome videos. Did you make the video for the second part on setting up metrics? Could you please share the link?
This is very useful information to understand how to setup Prometheus /Grafana with Kubernetes. Thank you Nana for wonderful videos on your channel.
Really appreciate your effort (Y). Just saw this one and the theoretical one and they are great and very helpful. Keep the great work (Y)
Thanks a ton Haitham! Happy you liked the videos :)
Once again a brilliant video. Clear concise and very easy to understand. So far I am through all of the Docker and Kubernates videos. Prometheus next!
Hi Nana, this is a amazing series so far - your explanations are very concise and easy to understand.
If possible, would it be possible for you to do a video on metrics / monitoring tools such as Elastic / New Relic etc.
Hi, thank you so much, really appreciate your feedback :) I'll create a complete Elastic course and will release it in September on udemy. I will announce it here on my channel :)
very interesting and the whole thing can easily be transposed to any cloud environment. I experimented with Azure Cloud, the only small problem was that port forwarding to prometheus required the addition of a configuration file for load balancing.
How amazing you are. Everything was clear. I understood the concept. We are lucky you are sharing your knowledge
We Are expecting a part 2 of this Video Soon.
Yes will come soon!
Part 2 is released: th-cam.com/video/mLPg49b33sA/w-d-xo.html
@@TechWorldwithNanaCould you adjust it in description? I get a 404 code on your description link.
@@Mauglus Thanks for pointing it out, it should work now. You meant the part 2 link right?
Yes, thank you 😊
Nana, you rock! Thanks for those vids. There is so much rubbish out there but these are some of the hard to find pearls!!! I always knew that I need Prometheus to keep an eye on my various clusters but never found the time to investigate deeper. Now I know how to start. :)
Thank you Nana. This is very helpful. Please let us know when you have Prometheus exporter sidecar tutorial to scrape metrics for DB or microservices running in pod.
Hi, I will create part 2 of this video in a few weeks
awesome, thank you for this video 🔥
Yes, pls make a separate Video about Operators ♥️
You're welcome :) Video for Operators coming soon ✨
I believe it is here th-cam.com/video/ha3LjlD6g7g/w-d-xo.html
Thank You, I am waiting for the part2 demo
Hi, currently working on recording part 2. Will be uploaded in 2 weeks. I think it will be super helpful, I needed to figure out much by myself becauseI didn't find any proper documentation about it.
TechWorld with Nana I recently did the setup on our gke cluster, your part1 gave me a good idea on how to approach.
As always, terrific video! Thank you so much for doing what you do! FYI: The helm chart was renamed and the links have changed.
github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack
hub.helm.sh/charts/prometheus-com/kube-prometheus-stack
installation does not show any error. But: kubectl get pod shows: prometheus pod/prome-prometheus-node-exporter-s4p94 0/1 CreateContainerError
great content :) looking forward to 9:44 for concept video on CRDs
If someone has troubles like me because the installing mode using 'helm install stable/...' is not installing nothing here is the new form:
Link to official repo: github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack
>helm repo add prometheus-community prometheus-community.github.io/helm-charts
>helm repo update
> helm install [RELEASE_NAME] prometheus-community/kube-prometheus-stack
Nana, you are the best. How do we update say the Alerts or configuration of Alert Manager? Something like that would be immensely helpful.
Thx Nana, I Found my issue in Targets after this video!
Searched for like button couple of times. TH-cam have only one and once allowed. Thanks.
Thanks 😄
nana you rock. very clear and simple explanations of concepts. Love to collaborate with you
Thank you Nana, you make learning very interesting. thank you for your time 👏👏. i am definitely smashing the bell icon🏃🏃
Really best videos in my opinion for Devops practice. Thanks a lot
Hi Nana!I am very grateful this video to help me understand some problems has confused me a couple of days!Thank you!
Hey Thank you Nana for short tutorials. Very concise. Saves us from surfing lots of web pages! :D
In next videos, are you planning to cover more of 'operator' operations like, scaling up nodes, taking backup of stateful application, upgrading, etc?
Thank you very much Miss Nana! Really great video!
You're welcome :)
Thank you for such an amazing video. I keep coming back to this.
I really admire the way you explain everything... dazzled ... Can you please share, how can we use prometheus API to get deployment info
Wonderful presentation Nana. Can you make video for importing Prometheus libraries into applications.
hi mss Nana, thank you again , much love, you realy won our hearts ♥♥
Hello Nana, I really enjoy your videos, very informative and well explained. I have a request for you , will yyou please make a video tutorial on Tracing using "Jaeger"?
Thanks a lot for this wonderful video. Could you please make a dedicated video on Thanos as well?
Amazing tutorials...loved it...
May I know what presentation software you use for this..?? I am curious please tell me..
Hi thank you 🙂 I use Screenflow for the animations.
This is absolutely spot on Fantastic stuff. Thanks a ton for your effort.Extremely helpful. Just one question : may be i am blatantly missing something here, but as per the prometheus statefulset description, it was mounting just the secret volume which had a secret, wondering from where is it getting all the scraping endpoints configurations. Was there another config volume which i missed or is it outsourced to config-reloader container, which is part of the same pod?
Thank you so much. You're right, it can be confusing. So the configuration file for Prometheus and alert manager is actually in the secret not configMap as you would expect. So that's where the configuration for all scraping endpoints come from. Let me know if this info helps :)
@@TechWorldwithNana sure that helps, thanks for the response. 🙂
I can't describe how great your videos are 💯
Thanks so much William 🙏
I have subscribed your channel and it’s simply super .. your explanation on each and every service is simple and very clear ... waiting for 2nd video thank you
Great video Nana, thank you! :)
You're welcome, hope you check out the other videos too! :)
Been waiting for this. Thank you very much. Love from ph
Hi nana You're Tutorials are Wonderfull
Thank you! Curious to see the "Motivation" folder... :)
Thanks Nana.. the video is very helpful..it give us better understanding of topic
That's great, glad I can help in understanding the prometheus stack better!
Thank you so much, you're helping me a lot to understand all this complex world
I'm your fan Nana, kudos from Austin Tx
Happy to hear Alejandro! :D Greetings to Austin
Great series ! cant believe all this is for free ! Thanks a lot !
Looking forward to part 2 😃
Brilliant video, it explains it all so well. Thanks.
Thanks Andy 😊 Great to hear!
Hello Nana, tank you again! Its awesome.
Thanks, happy you liked it :)
love you your teaching style
Loving these videos, do you have a course covering topics in the CKA/CKAD exams?
Thanks a lot, happy to hear! No, but I think I will create one within a few months as it seems to be a topic many viewers would like :)
Wow! This is deep!!!!! thanks
Hi Nana, this is amazing video but could you please tell me how to attach persistent volume to this ?
yes because after reboot it all crashes... Warning FailedMount 3m19s (x2 over 14m) kubelet Unable to attach or mount volumes: unmounted volumes=[sc-dashboard-provider kube-api-access-wbnv6 config], unattached volumes=[storage sc-dashboard-provider sc-dashboard-volume kube-api-access-wbnv6 sc-datasources-volume config]: timed out waiting for the condition
simple amazing video .. Thanks Nana
Superb video production. Bravo!
Amazing Video, would be great if we test an app deployment and integrate it with Prometheus using Service Monitors.
You are awesome and so good at teaching this stuff.
keep it up.
Very clear! Thank you, Nana!
Hi Nana, Thanks a lot for making videos for us and sharing knowledge :), i saw your other video on istio, and here I'm again.! So once the kubernetes setup is done is it a good idea to directly setup istio as it comes with grafana and prometheus and your favorit kiali
Sooper nana .wonderful and different which makes us dwelling in to lot of areas ...can u please make us understand how to install certificates to make a particular application to be secure protocol https...with any free domain for any open source application such as nexus in case ...for example ...
Hi thank you for your nice feedback 🙂 Do you mean installing certificates in the cluster? for ingress https configuration? or in general?
@@TechWorldwithNana yes nana ...for cluster it would be better if u really could enlighten us on that ...take for example if we want to keep Jenkins server behind ingress https ..like that...
Hii Nana, can you make videos on Terraform? It really helpful to people
Hi
Nice explanation. Have you deployed kube-prometheus on dynamic persistent volume using helm.
Regards
Zaheer
Great stuff!! Is Terratest coming down the pipeline?
I didn't plan it, but I will look into it. Thanks for your suggestion! :)
@@TechWorldwithNana No issues either way, I just glad to have found your channel. Do you have somewhere you roadmap your video ideas/plans?
@@jonnykopp Hi Rabble, just came across your comment again. I have announced a few video/course topics, which I create in the next weeks/months in the Communities tab of my channel. If you didn't already see it :)
Hi Nana, Great work.
Do you have video which shows /explain how we deploy from github to Kubernetes using any of the pipeline which will also have build stage in it?
Wonderfully explained 😊. How much CPUs and memory Prometheus consumes? And any limitations with minicube?
NOTE: Prometheus Operator shown in Video is Deprecated. See the git repo for new operator installation and other relevant commands: gitlab.com/nanuchi/youtube-tutorial-series/-/blob/master/prometheus-exporter/install-prometheus-commands.md
Used versions in the demo:
► helm version: v3.2.1
► prometheus-operator: v0.38.1
Prometheus Architecture explained ► th-cam.com/video/h4Sl21AKiDg/w-d-xo.html
Kubernetes Operator explained ► th-cam.com/video/ha3LjlD6g7g/w-d-xo.html
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
0:00 - Intro
0:05 - Recap Prometheus architecture
0:52 - How to deploy all the parts into K8s cluster - 3 options
3:10 - Setup with Prometheus Operator using Helm
4:10 - Understand what components were created and what they do?
10:00 - What's inside Prometheus, Operator?
19:13 - Access Grafana UI
23:30 - Access Prometheus UI
24:52 - Summarize
Hi NANA, Could you please explain how to achieve auto scaling ?
Please make part 2 soon
Will do!
Thanks a Lot Nana. This is really helpful. Do you have any vedio for Postgresql exporter monitoring in Prometheus/Grafana.
This video is amazing and so helpful!!
thanks for the good explanation!
Thanks Tom, glad you liked it!
Really great demo and explanations!
Thank you Nana. Amazing content
Great work, it helps a lot! Thank you very much!
This was very well done!
The best video so far!
helm install prometheus stable/prometheus-operator is deprecated and the installation fails. Can you please update the video?
For People who had the same issue than me by deploying at Jan. 2021:
Error: failed to download "stable/prometheus-operator" (hint: running `helm repo update` may help)
The Prometheus Stack was changed to "kube-prometheus-stack" you must add the helm repo "prometheus-community.github.io/helm-charts" and install it from there. "helm install prometheus stable/prometheus-operator"
Thanks you showing the demo, can you please show us how to configure nginx-ingress controller and in production cluster we can not do port forward. Currently I am trying to do it but facing challenges.
Hi, where is your cluster running. Depending on that, nginx-ingress will be configured differently. I have shown configuring Nginx-ingress in Minikube and also in LKE cluster. So you can check one of those, maybe it will helpful for you.
Hi , thank you for the great work ♥️
You're welcome :)
hi, thanks for the great video, but have a small question: is there an explanation how to configure several kuberenetes clusters to be monitored from a centralized prometheus/grafana server?
Your videos are awesome
Thanks Sagar! 😇
Thanks for the wonderful session
Why Prometheus GuI was not enhanced similar line Grafana? We would not have needed additional Tool right ?
Good tutorial, please how can i make prometheus and grafana to automatically always run after starting i dont want my monitoring stack always down
Hi Nana,
What is difference Prom+Grafana vs Kubernetes Dashboard if we want to monitor k8s cluster?
Or in which scenarios Prom+Grafana should be used over Kubernetes Dashboard
Great tutorials. You are awesome
Good tutorial. Thank you 😊
This was awesome. Thank you. was like watching an episode of GoT :)
Thank you. That's a very big compliment! 😀
excellent Nana
Superb !! The best !!