Setup Prometheus Monitoring on Kubernetes using Helm and Prometheus Operator | Part 1
ฝัง
- เผยแพร่เมื่อ 11 ก.ค. 2024
- ► Part of the DevOps Bootcamp 🚀 More infos here: bit.ly/3WrhlUp
Learn how to setup Prometheus Monitoring and Grafana on Kubernetes cluster using Helm chart for Prometheus Operator
NOTE: Prometheus Operator shown in video is Deprecated. See the git repo for new operator installation and other relevant commands:
gitlab.com/nanuchi/youtube-tu...
Missed the theoretic part? Prometheus Architecture explained ► • How Prometheus Monitor...
Demo Part 1: Setup Prometheus Monitoring with Helm chart for Prometheus Operator (this video)
Demo Part 2: In the 2nd part we will actually configure Prometheus to expose /metrics endpoint and configure Prometheus to scrape it. ► • Prometheus Monitoring ... 🤓
In the demo I show you the third way. We will easily deploy Prometheus and Grafana using Helm chart for Prometheus Operator and I walk you through the different components, which were created. So that you have a good understanding 💡 of what they are and what they do.
Used versions in the demo:
► helm version: v3.2.1
► prometheus-operator: v0.38.1
In general there are 3 ways to do the setup:
1. Create all the configuration files yourself 👩🏻💻
This way is pretty inefficient and it's a lot of effort.
2. Using a Kubernetes Operator 😎
In this option you would go and find an operator for Prometheus and deploy it in the cluster using the configuration files of the operator. It is more efficient.
3. Using Helm chart to deploy the Prometheus Operator 🚀
This is the most efficient way. Prometheus Operator has a Helm chart that is maintained by the Helm community. You can use this Helm chart to deploy the operator.
So, Helm will do the initial setup. Operator will then manage the running Prometheus setup
#prometheusmonitoring #kubernetes #devops #techworldwithnana
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
0:00 - Intro
0:05 - Recap Prometheus architecture
0:52 - How to deploy all the parts into K8s cluster - 3 options
3:10 - Setup with Prometheus Operator using Helm
4:10 - Understand what components were created and what they do?
10:00 - What's inside Prometheus Operator?
19:13 - Access Grafana UI
23:30 - Access Prometheus UI
24:52 - Summarize
▬▬▬▬▬▬ Useful Links 🔗 ▬▬▬▬▬▬
Prometheus Operator Helm chart: ► github.com/helm/charts/tree/m...
Awesome operators: ► github.com/operator-framework...
▬▬▬▬▬▬ Want to learn more? 🚀 ▬▬▬▬▬▬
Kubernetes Operator explained ► • Kubernetes Operator si...
Full Kubernetes and Docker tutorial ► bit.ly/2YGeRp9
DevOps Tools, like Ansible, Prometheus ► bit.ly/2W9UEq6
Jenkins Pipeline Tutorials ► bit.ly/2Wunx08
▬▬▬▬▬▬ Courses & Bootcamp & Ebooks 🚀 ▬▬▬▬▬▬
► Become a DevOps Engineer - full educational program 👉🏼 bit.ly/45mXaer
► High-Quality and Hands-On Courses 👉🏼 bit.ly/3BNS8Kv
► Kubernetes 101 - compact and easy-to-read ebook bundle 👉🏼 bit.ly/3Ozl28x
▬▬▬▬▬▬ Connect with me 👋 ▬▬▬▬▬▬
Join private Facebook group ► bit.ly/32UVSZP
Don't forget to subscribe ► bit.ly/3mO4jxT
DEV ► bit.ly/3h2fqiO
INSTAGRAM ► bit.ly/2F3LXYJ
TWITTER ► bit.ly/3i54PUB
LINKEDIN ► bit.ly/3hWOLVT
![[UNCUT] ที่นี่ที่แรก ปู - หาญส์ พูดถึงมหากาพย์หนี้สิ้น I คนดังนั่งเคลียร์ I 10 ก.ค.67](http://i.ytimg.com/vi/KDNA9DZ0p4U/mqdefault.jpg)
![โจทย์โหดเหมือนโกรธเป็ดถีบ [อะไรอยู่บนหัวกูวะ ... EP.4]](http://i.ytimg.com/vi/Dqlb7EZ9PGk/mqdefault.jpg)
What an amazing video; I especially love the parts where you go beyond just installing like showing what the pods created are actually used for.
Kudos also for the time spent in showing the different Grafana dashboards automatically created!
Yes, exactly. Nana rocks!
love you thank you for keeping your videos up to date! The fact you added new GitHub repo to a non-depricated version amazes me you saved me enough time to leave you a positive comment. Thanks again!
Nana, fantastic. The way you are explaining each concept is very much impressive. I am not finding words. Of all I like the way you pronounce each word and how you use your words in explaining these technology. I am a big fan. Thank you so much!
Once again a brilliant video. Clear concise and very easy to understand. So far I am through all of the Docker and Kubernates videos. Prometheus next!
This is a great channel for all Devops content. Kudos for the effort in creating such an amazing content.
I have been working on making a monitoring service by myself for Kubernetes worker nodes using Kafka and other setups (which I will suggest for the new learners that don't go on that route). Then one of my friends recommended me to get out of the exhausting approach and go for Prometheus setup with some visualizing tool Grafana, etc. for monitoring service purpose. After a week of searching, I always got the lengthy and exhausting tutorials of creating all lengthy configuration files by yourself which Nana is 100% absolutely right for if you miss one step, it can potentially lose your very precious time. This second method is intuitively very good. I will definitely try it out. Looking forward to good results
This is very useful information to understand how to setup Prometheus /Grafana with Kubernetes. Thank you Nana for wonderful videos on your channel.
Nana, you rock! Thanks for those vids. There is so much rubbish out there but these are some of the hard to find pearls!!! I always knew that I need Prometheus to keep an eye on my various clusters but never found the time to investigate deeper. Now I know how to start. :)
Really appreciate your effort (Y). Just saw this one and the theoretical one and they are great and very helpful. Keep the great work (Y)
Thanks a ton Haitham! Happy you liked the videos :)
Been waiting for this. Thank you very much. Love from ph
nana you rock. very clear and simple explanations of concepts. Love to collaborate with you
hi mss Nana, thank you again , much love, you realy won our hearts ♥♥
One of the best K8S channel tutorials keep it up
Thank you so much! :D
Really best videos in my opinion for Devops practice. Thanks a lot
Hi Nana!I am very grateful this video to help me understand some problems has confused me a couple of days!Thank you!
How amazing you are. Everything was clear. I understood the concept. We are lucky you are sharing your knowledge
Great series ! cant believe all this is for free ! Thanks a lot !
Thank you for such an amazing video. I keep coming back to this.
You are awesome and so good at teaching this stuff.
keep it up.
I can't describe how great your videos are 💯
Thanks so much William 🙏
Thank you so much, you're helping me a lot to understand all this complex world
Thank you Nana, you make learning very interesting. thank you for your time 👏👏. i am definitely smashing the bell icon🏃🏃
I have subscribed your channel and it’s simply super .. your explanation on each and every service is simple and very clear ... waiting for 2nd video thank you
Really great demo and explanations!
Thank you very much Miss Nana! Really great video!
You're welcome :)
Another expert explanation. Thank you 👍
Your videos are incredibly amazing, thanx
awesome, thank you for this video 🔥
Yes, pls make a separate Video about Operators ♥️
You're welcome :) Video for Operators coming soon ✨
I believe it is here th-cam.com/video/ha3LjlD6g7g/w-d-xo.html
Very clear! Thank you, Nana!
Thx Nana, I Found my issue in Targets after this video!
This video is amazing and so helpful!!
This was very well done!
Superb video production. Bravo!
Hi nana You're Tutorials are Wonderfull
simple amazing video .. Thanks Nana
love you your teaching style
Hey Thank you Nana for short tutorials. Very concise. Saves us from surfing lots of web pages! :D
In next videos, are you planning to cover more of 'operator' operations like, scaling up nodes, taking backup of stateful application, upgrading, etc?
Brilliant video, it explains it all so well. Thanks.
Thanks Andy 😊 Great to hear!
Looking forward to part 2 😃
Thank you Nana. Amazing content
Great work, it helps a lot! Thank you very much!
The best video so far!
Great video Nana, thank you! :)
You're welcome, hope you check out the other videos too! :)
Thank You, I am waiting for the part2 demo
Hi, currently working on recording part 2. Will be uploaded in 2 weeks. I think it will be super helpful, I needed to figure out much by myself becauseI didn't find any proper documentation about it.
TechWorld with Nana I recently did the setup on our gke cluster, your part1 gave me a good idea on how to approach.
Nana, really learning a lot with these videos related to k8s. Please consider adding tutorials on istio and spinnaker.
Hi Abdul, thanks for your suggestions! Istio will come in a few weeks 👍
awesome explanation!! thank you...
Hello Nana, tank you again! Its awesome.
Thanks, happy you liked it :)
great content :) looking forward to 9:44 for concept video on CRDs
I'm your fan Nana, kudos from Austin Tx
Happy to hear Alejandro! :D Greetings to Austin
Thanks for the help Nana - you are a great teacher!
BTW, here's the current helm command: helm install p1 prometheus-community/kube-prometheus-stack
On WSL2 use: helm install p1 prometheus-community/kube-prometheus-stack --set prometheus-node-exporter.hostRootFsMount.enabled=false
Thanks a lot :)
Good tutorial. Thank you 😊
Superb !! The best !!
Great tutorials. You are awesome
Thanks Nana.. the video is very helpful..it give us better understanding of topic
That's great, glad I can help in understanding the prometheus stack better!
Wow! This is deep!!!!! thanks
excellent Nana
Great job. Thank's for your job.
Thanks Nana for this video! I'd really love to see how to setup metrics and monitoring your application in a cluster with Prometheus. But thanks so much for this explanatory video!
Hi, I will cover this in the second part of the demo. Which I will create in the next weeks, so stay tuned for it :) Maybe turn on the bell to get notified
@@TechWorldwithNana Bells turned on!!
@@TechWorldwithNanaHello Nana, your videos are awesome videos. Did you make the video for the second part on setting up metrics? Could you please share the link?
Dear Nana, please make tutorial, how to setup Istio in Kubernetes, and how all that works. Your tutorials are super clear and professional. Thank you 🙏🏼
Glad my tutorials are helpful for you! Istio is on my list 👍:)
Amazingly clear for operator and Prometheus deployment in minikube
Question:
* why the port-forward is done in deployment for grafana, while it is on pod for prometheus ui
Comments:
* it will be good to state the version u demoed like helm/3.2.4, prometheus-operator/9.1.0, so users can repeat your exercise with the same version when needed
* copy/paste command, it will be good to have related blog (even just git repo) with your each video, so we can copy paste for some commands.
Well done! i like your series, short and clear introduction with demos
Hi Larry, thanks a lot for your great suggestions and feedback.
To your question: it works for both, doesn't matter which one you take. if you have multiple pods, then you can do port-forward for deployment.
As for your notes: sounds great! 👍 Will add the versions in the description and will put the commands in the dev.to blog and/or in git repo!
Excelent video. Thanks a lot!
thanks for the good explanation!
Thanks Tom, glad you liked it!
Great video, thank you 🙏
20:00 you can also create a port-forward for a service, not only a deployment or pod ... i prefer services because its unlikely the service name changes and so its more likely to still works when you reuse the command from your history
Hi , thank you for the great work ♥️
You're welcome :)
Your videos are awesome
Thanks Sagar! 😇
Thank you very much!
Hi Nana, this is a amazing series so far - your explanations are very concise and easy to understand.
If possible, would it be possible for you to do a video on metrics / monitoring tools such as Elastic / New Relic etc.
Hi, thank you so much, really appreciate your feedback :) I'll create a complete Elastic course and will release it in September on udemy. I will announce it here on my channel :)
Thank you!
Searched for like button couple of times. TH-cam have only one and once allowed. Thanks.
Thanks 😄
Great jobs :)
Awesome video, super informative. But, just wanted to point out you spelled initiale wrong at 3:08. Do not mean to nit pick. Just though you might want to know... But probably the best Helm/K8s video I have seen yet. Keep the awesome work coming!
Thank you very much for your feedback greg :)
Thanks Nana!!!!
Thank you for the great video. =)
You're welcome, glad you like it Max! :)
This was awesome. Thank you. was like watching an episode of GoT :)
Thank you. That's a very big compliment! 😀
thanks for sharing
As always, terrific video! Thank you so much for doing what you do! FYI: The helm chart was renamed and the links have changed.
github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack
hub.helm.sh/charts/prometheus-com/kube-prometheus-stack
installation does not show any error. But: kubectl get pod shows: prometheus pod/prome-prometheus-node-exporter-s4p94 0/1 CreateContainerError
Wonderful presentation Nana. Can you make video for importing Prometheus libraries into applications.
Thank you Nana. This is very helpful. Please let us know when you have Prometheus exporter sidecar tutorial to scrape metrics for DB or microservices running in pod.
Hi, I will create part 2 of this video in a few weeks
Hello Nana, I really enjoy your videos, very informative and well explained. I have a request for you , will yyou please make a video tutorial on Tracing using "Jaeger"?
Thanks a lot
Thanks a lot for this wonderful video. Could you please make a dedicated video on Thanos as well?
Thank you! Curious to see the "Motivation" folder... :)
Wonderful
Thank you for this series (the whole channel actually!). I'm having trouble with the new repo as it fails to scrape k8s resources under the "kube-system" namespaces and gets a "Connection refused" error. Any ideas on the cause?
NOTE: Prometheus Operator shown in Video is Deprecated. See the git repo for new operator installation and other relevant commands: gitlab.com/nanuchi/youtube-tutorial-series/-/blob/master/prometheus-exporter/install-prometheus-commands.md
Used versions in the demo:
► helm version: v3.2.1
► prometheus-operator: v0.38.1
Prometheus Architecture explained ► th-cam.com/video/h4Sl21AKiDg/w-d-xo.html
Kubernetes Operator explained ► th-cam.com/video/ha3LjlD6g7g/w-d-xo.html
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
0:00 - Intro
0:05 - Recap Prometheus architecture
0:52 - How to deploy all the parts into K8s cluster - 3 options
3:10 - Setup with Prometheus Operator using Helm
4:10 - Understand what components were created and what they do?
10:00 - What's inside Prometheus, Operator?
19:13 - Access Grafana UI
23:30 - Access Prometheus UI
24:52 - Summarize
Nana, you are the best. How do we update say the Alerts or configuration of Alert Manager? Something like that would be immensely helpful.
helm install prometheus stable/prometheus-operator is deprecated and the installation fails. Can you please update the video?
I really admire the way you explain everything... dazzled ... Can you please share, how can we use prometheus API to get deployment info
Hi Nana, Great work.
Do you have video which shows /explain how we deploy from github to Kubernetes using any of the pipeline which will also have build stage in it?
Thanks
Thanks a Lot Nana. This is really helpful. Do you have any vedio for Postgresql exporter monitoring in Prometheus/Grafana.
Hi, thanks a lot for your great videos) i have a question in 20:50 why do you port-forward a deployment not a service?
hi, thanks for the great video, but have a small question: is there an explanation how to configure several kuberenetes clusters to be monitored from a centralized prometheus/grafana server?
Wonderfully explained 😊. How much CPUs and memory Prometheus consumes? And any limitations with minicube?
Finally my 20% project is completed. Please make video specific to grafana and how to write it's ini file like configuring SMTP etc
Are you using the helm chart for prometheusoperator?
Hi Nana your videos were really helpful to understand the k8s concept ,I got one doubt . can we create entire infra ( aks, helm, Prometheus And granfa ) using terraform? Actually I have one task where I have to configure aks with Prometheus using terraform. I am not sure about that if we can ? Waiting for your reply. Thanks in advance.
Hi Nana, Thanks a lot for making videos for us and sharing knowledge :), i saw your other video on istio, and here I'm again.! So once the kubernetes setup is done is it a good idea to directly setup istio as it comes with grafana and prometheus and your favorit kiali
Good tutorial, please how can i make prometheus and grafana to automatically always run after starting i dont want my monitoring stack always down
Loving these videos, do you have a course covering topics in the CKA/CKAD exams?
Thanks a lot, happy to hear! No, but I think I will create one within a few months as it seems to be a topic many viewers would like :)