► Prometheus explained: th-cam.com/video/h4Sl21AKiDg/w-d-xo.html ► Demo Part 1: Setup Prometheus Monitoring on Kubernetes using Prometheus Operator: th-cam.com/video/QoDqxm7ybLc/w-d-xo.html ► To follow along, Git Repo: gitlab.com/nanuchi/kubernetes-tutorial-series-youtube/-/tree/master/prometheus-exporter ▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬ 0:00 - Intro 0:13 - Steps to monitor MongoDB (or any other third party application) metrics 2:06 - Prometheus Operator deployed - recap of part 1 5:13 - Service Monitor - How Prometheus discovers new targets? 8:10 - Deploy MongoDB application (Deployment and Service component) 8:56 - MongoDB Exporter - exposing MongoDB metrics 09:28 - What is a Exporter? 12:32 - 3 components you need when deploying an Exporter 13:40 - Deploy MongoDB Exporter using Helm Chart 19:37 - Check /metrics endpoint of MongoDB Exporter 20:35 - See new target in Prometheus UI 21:17 - See MongoDB metrics data in Grafana UI
thank you, it was elaborate, seems like it needed lot of work :).. also, can this same be applied if the database is not in the cluster but it is hosted outside the kubernetes cluster. i actually tried to do this to a postgre exporter, added values for service monitor in values file. but i couldnt get metrics exposed to prometheus. can you pls tell me how to get same done in postgreSQL exporter. thank you
If it's Prometheus in kubernetes, then u can assign a persistent volume block to store the metrics. The default retention period for Prometheus is 15 days , ofcourse u can increase by modifying the configuration. There is another solution, called 'thanos'. You can store metrics in cloud storage this is more useful if you want to store metrics for more than an year
The ServiceMonitor of the values.yaml of the mongodb exporter is disabled by default in new versions. You need to override this value too in order to be discovered by Prometheus. serviceMonitor: enabled: true additionalLabels: release: prometheus
This Prometheus series is realy the best out there in youtube.. Prometheus was always to me a dark spot, but now I can say that I know how to handel monitoring within my clusters. Many thanks NaNa
@@TechWorldwithNana Hi guys, I have Prometheus-grafana set up in a axur kubernetes cluster. Grafana set is have three replica.also, I has a ingress set to a internal ip address and port300. I am able to access the grafana with ip and port number. But when I scale down grafana pods to 1, i'm unable to see grafana. Can someone explain why??
I am getting fan of yours thanks. I am developer mostly build monolithic application in career and now learning micro service architecture and tools. and your videos are are very much helpful thank you
First of all thanks for the great content. Just wanted to understand why for grafana we use port-forwarding on deployment while on others we used port-forwarding on service
Thank you so much: this is a real life-saver video to really understand how all those moving parts fit together. Now off to experimenting and putting all this into practice.
Great tutorial. Thank you very much. Is it possible to make another video on "how to scale Prometheus, long term prometheus data storage and use single Grafana to view all Prometheus metrics; all on k8s", please ?
Hi Nana, your series are awesome as always, may I suggest you make another video about setting up Alert Manager and sending alert to Slack or Teams with Prometheus
As Always, Nana with the best content, Thanks for this video It helped me a lot. I am sorry I am watching this one a bit late as I was occupied with some other stuff.
Thanks for tutorial. But I have 1 question , Pods dashboard doesnt have mongodb exporter metrics, its have only node exporter metrics (and work without mongodb exporter). Where we can see mongodb exporter metrics in Grafana?
Wie immer, Teil 2 geschaut und live auf meinen minikube ausgeführt. Läuft alles gleich wie bei Nana, ich musste nur das mongodb-without-exporter.yaml selber schreiben da nicht gefunden. Aber gute Übung. Danke für dies. Gut habe ich alles bisher notiert da ein paar Details zu schnell gingen, und so habe ich mein eigenes Wiki :-)
Hello Nana, really like this series, i just have a question, what if the question i want to monitor doesnt have an exporter like mongodb exporter, what should i do in that case? how do i scrape metrics from it?
Great video, quick question.. Why in the previous video with Grafana you used port-forward towards the deployment and now you use port-forward towards the service? Could you explain the difference please?
Hi just one comment: at 6:39 you are explaining "release: prometheus" label and how it is important. It doesnt have to have string "prometheus" its release name of the kube-prometheus-stack chart
Hello, I have a question, I have my deployment and service yamel of my app created in go, my question is: with the helm that I installed in part1 of your prometheus video, I understood that there is the kube-metrics export that what you do obtains the information of all the kubernetes objects including the pods, so my question is for my app to work in go, do I necessarily need to implement the monitor service as seen in this video or is it not necessary? Thank you
hi dear Nana, good morning, firstly i have to thank you for taking the time to put up such a great video....its been 3 years since this video was posted , and it may be strange for you to see that its still helping some one today. well, i am a fresher in devops,... Dear Nana, my Prometheus was un able to scrap the data from mongodb exporter. is there something i missed out?, but the data is available in my mongodb exporter/ metrics end point... but the Prometheus ui just cant give me the metrics..
Hi Nana I Have a ingress controller running on my cluster, I have installed the prometheus & grafana installed using the helm how can we integrate the prometheus & grafana to existing ingress controller instead of port-foward to localhost.
I am working on a project where I need to monitor the k8 cluster metrics as well as an msk cluster metrics. Can you provide some info on if/how I can use the kube-prometheus to get the job done?
how to setup monitoring with alertmanager helm chart I am updating the .yml file but my helm chart of premetheus is getting replaced and the updates are also not visible from the yml file.
Hey Nana! Thanks for the amazing tutorial! I was trying to add exporter for postgres. But it doesn't have any such parameter as mongo uri. What changes to make in that case?
I do not understand the cpu part, firstly kubernetes recommends 2 cpus and in this tutorial you use 4, I'm using my PC which runs on one cpu, just like most local systems correct ? I tried google but am still lost. Please explain
This was quite useful 😃, but I am looking for video in which telegraf will push matrics to pushgateway and them Prometheus will pull those metrics(k8) from there.. Could you pls create a video with live coding?? Thanks in advance.
Hi Nana, I have set-up an cluster in my local laptop using Virtual Box. I have 1 master and 1 worker Node. And I have followed and created the env. But how can I access the Grafana/Prometheus dashboards from my VM.
Hi Anushree, what application is it? If it's a third party application, you should search for an exporter and check in the docs what metrics get exported from that service, similar to the process in this video.
@@TechWorldwithNana Hello, I understood that with only the metrics that the helm prometheus operator installs, I already obtained the information of all the pods that are in the kubernetes in all the namespaces, including custom applications, for example, created with go . Or is it that I necessarily have to install an exporter for go and a service monitor?
It would be great to know how to setup the MongoDb exporter when someone followed your "Complete Application Deployment using Kumbernetes Components" Tutorial
Awesome Tutorial! I'm facing an issue where Grafana UI is not pulling any metrics for most of the dashboards and also the mongodb pod whereas the Prometheus targets are up and working without any errors
Hi do you plan to or could point to a K8S for dummies series? There are many beginner type questions one has. Or do you plan to host a live session where we could ask questions? Please suggest which video to start with and if there is a series to follow to get to a decent level. Goal is CKA. However a bit challenging (for me). TY in advance and a great job!
I am not going to lie, I really wish you had created a custom app to use as the example instead of mongoDB (that or shown off both). It took me 2 days of debugging to fully understand everything. I was VERY confused by the exporter vs the serviceMonitor, and through that the former was the latter. I totally thought that Prometheus would just look for pods that had "release: Prometheus" and work. The lack of an up to date collection of documentation or tutorial really didnt help either. THank you for the video, as it basically was the only thing that gave mea reasonable example. (once I realized what to look for anyway.)
Hi Nana, in my project mongodb is installed in aws server and prometheus is deployed in pod .. can you please let me know how to take metrics from mongodb server to prometheus ?
Hello Nana, these videos are good,but I have an important question, I was looking in the internet and I really could not find any video on website that shows how to edit prometheus files or creating alerts ON prometheus when the prometheus was installed using helm, can you share a website link or a video link where you or anyone shows how to create alerts on prometheus or how to edit prometheus confiuguration files using helm? , thank you
Hi, a question, how can I add any linux server (outside of k8s) to prometheus? Should I add a servicemonitor to the direct ip of the server or something like that for the service discovery to see it?
Hi, I followed your steps exactly and everything works except that I get "no data" in grafana. I enabled servicemontor in the config as mentioned in previous comments, it did not solve the problem though. Do you have any suggestions?
Hello, Nice tutorial like always. I have a doubt in this. Even without using `mongodb-exporter` I am able to see everything related to mongodb deployment's CPU/memory etc. So, I am curious that why do we even need `mongodb-exporter`? Is it to see if internals of mongodb application is working fine or not? If yes, then even after deploying why I wasn't seeing any sharding etc metrics in Grafana? Any suggestions would be welcome.
Great tutorial nana, you made many concepts clear. I have one doubt, I have deployed my REST Service manager with the help of kubernetes. I want prometheus to monitor the rest calls, can you please suggest which exporter I should use?
► Prometheus explained: th-cam.com/video/h4Sl21AKiDg/w-d-xo.html
► Demo Part 1: Setup Prometheus Monitoring on Kubernetes using Prometheus Operator: th-cam.com/video/QoDqxm7ybLc/w-d-xo.html
► To follow along, Git Repo: gitlab.com/nanuchi/kubernetes-tutorial-series-youtube/-/tree/master/prometheus-exporter
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
0:00 - Intro
0:13 - Steps to monitor MongoDB (or any other third party application) metrics
2:06 - Prometheus Operator deployed - recap of part 1
5:13 - Service Monitor - How Prometheus discovers new targets?
8:10 - Deploy MongoDB application (Deployment and Service component)
8:56 - MongoDB Exporter - exposing MongoDB metrics
09:28 - What is a Exporter?
12:32 - 3 components you need when deploying an Exporter
13:40 - Deploy MongoDB Exporter using Helm Chart
19:37 - Check /metrics endpoint of MongoDB Exporter
20:35 - See new target in Prometheus UI
21:17 - See MongoDB metrics data in Grafana UI
thank you, it was elaborate, seems like it needed lot of work :).. also, can this same be applied if the database is not in the cluster but it is hosted outside the kubernetes cluster. i actually tried to do this to a postgre exporter, added values for service monitor in values file. but i couldnt get metrics exposed to prometheus. can you pls tell me how to get same done in postgreSQL exporter.
thank you
Could you please tell :
How to collect Prometheus metrics and store them?
If it's Prometheus in kubernetes, then u can assign a persistent volume block to store the metrics. The default retention period for Prometheus is 15 days , ofcourse u can increase by modifying the configuration. There is another solution, called 'thanos'. You can store metrics in cloud storage this is more useful if you want to store metrics for more than an year
If we want to restric some of the metrics not to consume by Prometheus, how can we do this?
The ServiceMonitor of the values.yaml of the mongodb exporter is disabled by default in new versions. You need to override this value too in order to be discovered by Prometheus. serviceMonitor:
enabled: true
additionalLabels:
release: prometheus
This Prometheus series is realy the best out there in youtube..
Prometheus was always to me a dark spot, but now I can say that I know how to handel monitoring within my clusters.
Many thanks NaNa
It has arrived! Instantly watched this when I saw it!
Thanks as always Nana for the quality videos and explanations!
Great video. People like you are what humanity really is. Kind, helping and thank you.
Have been watching your videos on various topics Nana. Just one word to describe them - "Awesome !!!" Thank You :)
I was waiting for it keep it up .
One of the best channels on youtube
Yes many were waiting for part 2 :) Thanks so much 🙏
I created the same structure on the 2 node cluster of 2 GB RAM, and 1 CPU, 50GB storage each.
Thank you for making this seem so simple, really appreciate your effort to make such fantastic videos.
Very cool! Adding the exporter without changing the target pod to add a sidecar container. Very, very nice. Thx.
Your videos are very good in terms of details and knowledge. Thank you so much for putting them together and helping others.
Made my day, learnt exporter deployment and service monitor 👏👏
You're a life saver in IT World 👌👌👌
This is a good video description of monitoring 3rd party applications. I will try to use it.
Your contents and tutorials are amazing, I've been enjoying and learn a lot. Thank you so much for this channel Nana.
Hi Lucas, appreciate your feedback thank you! :)
Excellent Demo!!!! Another feather in the cap. You go lady!!!!!
So well explained! You saved me a lot of time, rlly appreciate your work :)
Thanks, really happy to hear that it was helpful for you :)
@@TechWorldwithNana Hi guys, I have Prometheus-grafana set up in a axur kubernetes cluster. Grafana set is have three replica.also, I has a ingress set to a internal ip address and port300. I am able to access the grafana with ip and port number. But when I scale down grafana pods to 1, i'm unable to see grafana. Can someone explain why??
Awesome video, Nana. Useful to deploy and understand how metric exporters works.
Thanks for you great work
I am getting fan of yours thanks. I am developer mostly build monolithic application in career and now learning micro service architecture and tools. and your videos are are very much helpful thank you
Nana, you are awesome....this is what i was looking for and found in this video of yours... Thanks for sharing......
Really appreciate your efforts Nana. Keep rocking ...
First of all thanks for the great content.
Just wanted to understand why for grafana we use port-forwarding on deployment while on others we used port-forwarding on service
Nice! I've been waiting for this video. Thank you, Nana!
Hope you liked it :)
Thank you so much: this is a real life-saver video to really understand how all those moving parts fit together. Now off to experimenting and putting all this into practice.
Another super solid video, thank you again for all of your contributions in this space.
Thank you Nana for all of those well explained videos!!
It's really helpful @Nana ❤
Nice tutorials! Thanks for your effort! 🙂
Great tutorial. Thank you very much. Is it possible to make another video on "how to scale Prometheus, long term prometheus data storage and use single Grafana to view all Prometheus metrics; all on k8s", please ?
Help a lot, thanks for resume all this information in this series. Thank you again!!!
Hi Nana, your series are awesome as always, may I suggest you make another video about setting up Alert Manager and sending alert to Slack or Teams with Prometheus
As Always, Nana with the best content, Thanks for this video It helped me a lot. I am sorry I am watching this one a bit late as I was occupied with some other stuff.
Love tools. Thanks for sharing it.
Thanks for tutorial.
But I have 1 question , Pods dashboard doesnt have mongodb exporter metrics, its have only node exporter metrics (and work without mongodb exporter).
Where we can see mongodb exporter metrics in Grafana?
Thank you so much. Really, I am learning a lot through your channel
Thanks a ton again!! very helpful
Wie immer, Teil 2 geschaut und live auf meinen minikube ausgeführt. Läuft alles gleich wie bei Nana, ich musste nur das mongodb-without-exporter.yaml selber schreiben da nicht gefunden. Aber gute Übung. Danke für dies. Gut habe ich alles bisher notiert da ein paar Details zu schnell gingen, und so habe ich mein eigenes Wiki :-)
Many thanks for your content! It's simple and brilliant explanation of basic monitoring setup! You just got new subscriber :)
15:30 if you are already in the git repo, just open the values.yml to see the possible parameters and their defaults!
Good. I have implemented mongodb exporter metrics in our environment.
This is just beautiful. Thank you so much!
Thanks for the Great Video . The content explains separate pods to collect metrics . Please post content with istio promethus integration .
So high quality channel.. Thanks for your contribution !!!!
Hello Nana, really like this series, i just have a question, what if the question i want to monitor doesnt have an exporter like mongodb exporter, what should i do in that case? how do i scrape metrics from it?
Great tutorial !!!! 👍
excellent video, thank you Nana
thank you for such a wonderful video
Brilliant !! Many thanks !!
Thank you Nana! just one Q: why we did port forward on deployment for Grafana and not on service line
Great video, quick question..
Why in the previous video with Grafana you used port-forward towards the deployment and now you use port-forward towards the service? Could you explain the difference please?
Thank you, this is excellent!
Hi just one comment: at 6:39 you are explaining "release: prometheus" label and how it is important. It doesnt have to have string "prometheus" its release name of the kube-prometheus-stack chart
Really good tutorial! Thank you so much.
You should do a video with this but integrating Grafana tools into a full web app (Prometheus, Tempo and Loki)
great explanation
Can you d oa video about alertmanager of this helmchart
Awesome, thanks 🔥
Thanks... Much helpful to me
Glad the video was helpful for you Shakeer :)
Thank you so much.
Thank you very much!!! ☺☺☺
Hello, I have a question, I have my deployment and service yamel of my app created in go, my question is: with the helm that I installed in part1 of your prometheus video, I understood that there is the kube-metrics export that what you do obtains the information of all the kubernetes objects including the pods, so my question is for my app to work in go, do I necessarily need to implement the monitor service as seen in this video or is it not necessary? Thank you
great info! thank you!
You are a life saver
hi dear Nana, good morning, firstly i have to thank you for taking the time to put up such a great video....its been 3 years since this video was posted , and it may be strange for you to see that its still helping some one today. well, i am a fresher in devops,...
Dear Nana, my Prometheus was un able to scrap the data from mongodb exporter. is there something i missed out?, but the data is available in my mongodb exporter/ metrics end point... but the Prometheus ui just cant give me the metrics..
same happen with me
For the values.yaml. Please add the following line to enable to service monitoring in mongodb exporter
serviceMonitor:
enabled: true
Great explanation , it will be great if you make a new tutorial for Helm and it's commands
Thanks :) Yes, I will definitely make a Helm demo video with all the main commands.
For springboot service we no need to install any external exporter right
Hi Nana
I Have a ingress controller running on my cluster, I have installed the prometheus & grafana installed using the helm how can we integrate the prometheus & grafana to existing ingress controller instead of port-foward to localhost.
I am working on a project where I need to monitor the k8 cluster metrics as well as an msk cluster metrics. Can you provide some info on if/how I can use the kube-prometheus to get the job done?
you are doing an awesome job (Y)
how to setup monitoring with alertmanager helm chart I am updating the .yml file but my helm chart of premetheus is getting replaced and the updates are also not visible from the yml file.
What is the Difference of Service Discovery or Service Monitor and when we use each of them . Any advise please .
Hey Nana! Thanks for the amazing tutorial! I was trying to add exporter for postgres. But it doesn't have any such parameter as mongo uri. What changes to make in that case?
How to figure out the URI for any service? is there a standard way?
I do not understand the cpu part, firstly kubernetes recommends 2 cpus and in this tutorial you use 4, I'm using my PC which runs on one cpu, just like most local systems correct ?
I tried google but am still lost. Please explain
This was quite useful 😃, but I am looking for video in which telegraf will push matrics to pushgateway and them Prometheus will pull those metrics(k8) from there.. Could you pls create a video with live coding?? Thanks in advance.
Great guide
Hi Nana,
I have set-up an cluster in my local laptop using Virtual Box.
I have 1 master and 1 worker Node. And I have followed and created the env.
But how can I access the Grafana/Prometheus dashboards from my VM.
this amazing and helpful, may you make a video for mongodb as a statefulset as well by Operator? and Thanks for your amazing series
Thanks a lot Mohamed :) will consider your suggestion
What changes do I need to make to an existing golang service to monitor the status (400, 200 etc) of the endpoints in the service?
Hi Anushree, what application is it? If it's a third party application, you should search for an exporter and check in the docs what metrics get exported from that service, similar to the process in this video.
@@TechWorldwithNana Hello, I understood that with only the metrics that the helm prometheus operator installs, I already obtained the information of all the pods that are in the kubernetes in all the namespaces, including custom applications, for example, created with go . Or is it that I necessarily have to install an exporter for go and a service monitor?
It would be great to know how to setup the MongoDb exporter when someone followed your "Complete Application Deployment using Kumbernetes Components" Tutorial
Awesome Tutorial! I'm facing an issue where Grafana UI is not pulling any metrics for most of the dashboards and also the mongodb pod whereas the Prometheus targets are up and working without any errors
you ever get this fixed? Working through the same thing
Hi do you plan to or could point to a K8S for dummies series? There are many beginner type questions one has. Or do you plan to host a live session where we could ask questions? Please suggest which video to start with and if there is a series to follow to get to a decent level. Goal is CKA. However a bit challenging (for me).
TY in advance and a great job!
can we run the port-forward command inside putty and run it as localhost?
Should i install prometheus on each namespace of k8s cluster? Or it can collect metrics from others namespaces also.
Hi Nana, Good video. Do you have a video for java exporter?
Really nice :)
The video is based on the cluster IP svc. But, I have deployed MongoDB using statefulset, and having headless svc What to do in that case
I am not going to lie, I really wish you had created a custom app to use as the example instead of mongoDB (that or shown off both). It took me 2 days of debugging to fully understand everything. I was VERY confused by the exporter vs the serviceMonitor, and through that the former was the latter.
I totally thought that Prometheus would just look for pods that had "release: Prometheus" and work. The lack of an up to date collection of documentation or tutorial really didnt help either. THank you for the video, as it basically was the only thing that gave mea reasonable example. (once I realized what to look for anyway.)
In your case its necesary implement the service monitor? or only is necesary the kube-metrics that instaled helm ?
Hi Nana, in my project mongodb is installed in aws server and prometheus is deployed in pod .. can you please let me know how to take metrics from mongodb server to prometheus ?
Hello Nana, these videos are good,but I have an important question, I was looking in the internet and I really could not find any video on website that shows how to edit prometheus files or creating alerts ON prometheus when the prometheus was installed using helm, can you share a website link or a video link where you or anyone shows how to create alerts on prometheus or how to edit prometheus confiuguration files using helm? , thank you
Hi, a question, how can I add any linux server (outside of k8s) to prometheus? Should I add a servicemonitor to the direct ip of the server or something like that for the service discovery to see it?
Nice! But I wish you showed how to create an exporter from scratch, for homegrown pods.
Hi, I followed your steps exactly and everything works except that I get "no data" in grafana. I enabled servicemontor in the config as mentioned in previous comments, it did not solve the problem though. Do you have any suggestions?
You are awesome!
I need to create mongo db exporter svc and pod under namespace "abc" what should I add in values.yaml file.
Thanks for tutorial, 👍👍
My question, how i can scrape my application using prometheus?
I must create deploymeny, service and servicemonitor too?
Hello, Nice tutorial like always.
I have a doubt in this. Even without using `mongodb-exporter` I am able to see everything related to mongodb deployment's CPU/memory etc.
So, I am curious that why do we even need `mongodb-exporter`? Is it to see if internals of mongodb application is working fine or not? If yes, then even after deploying why I wasn't seeing any sharding etc metrics in Grafana? Any suggestions would be welcome.
Great tutorial nana, you made many concepts clear. I have one doubt, I have deployed my REST Service manager with the help of kubernetes. I want prometheus to monitor the rest calls, can you please suggest which exporter I should use?
mam can you make a tutorial on how to monitor the clickhouse and clickhouse-exporter with prometheus and grafana please
Suppose there are more than one replica's of mongodb pod, then how to monitor them ?
how write in values.yaml of nginx exporter for nginx deployment metrics