Please be aware: update to the Git Repo: github.com/xcad2k/boilerplates I now separated the docker-compose files for Grafana and Prometheus in two separate folders!
@@giftcp82 In case you wanted to set them up standalone. Not a problem for somebody who's familiar with docker compose YAML files but for somebody just starting out it could get confusing having it all together. This way it narrows the focus and doesn't get everything potentially confused for the new user.
What is the difference between grafana/grafana and granfana/grafana-oss as your updated Git Repo refers to the latter while video refers to the former?
With time any updates like this will be harder to find in the Comments section. I was lucky I found just when I was wondering the video shows a combined docker-compose.yaml but the actual repo has them separated. Maybe update the main Description section with a dated update about the repo? You know, just like a code description update :-) Anyways, loved your video so far, the presentation. Great Job!
Absolutely invaluable. I have gone through a few of your other videos as well, and everything is essentially easily digestible essential knowledge that would otherwise take me weeks to search and figure out on my own. A huge plus is that the scripts and snippets provided actually work out of the box and everything is explained on an almost line by line basis. Thank you for your amazing work
@@adeelhashmi145 It's weird that it means what it does (with the prefix in- that normally means the opposite), but it actually means "incredibly valuable" or "more valuable than valuable"
Before going to watch this video .. i really appreciate you for making this video .. i was struggling to learn the basics of Prometheus and grafana , you really helped me by putting this video.. Thx in advance
Used cockpit for the last 2 years. I am very happy how it works. I have 7 servers in total i have to manage, and cockpit allows me to do just that by logging in on one single server adding others to there and watching there progress
Yep after turning on Cockpit this is exactly what I needed, but if you have more that one server with multiple instances of things then I can see Prometheus/Granafa shine.
for anyone who cannot get the prometheus or grafana container to start or they keep restarting (which is what happened to me), use the details below: the volumes that your container accesses, run this command on them: sudo chown -R 65534:65534 prometheus_example/ replace "prometheus_example" with the folder name that you provided to your volume(s) 65534 is the user and group id of the user/group that runs prometheus in the container. for me, grafana also had permission issues in the logs of the container, too. the user and group id is 472 so you'd replace "65534" with "472" in the command above. this issue occurs due to the user inside each container not having the correct permissions set. to my knowledge, most people here shouldn't have a problem if you followed the steps provided in the video correctly (which i didn't and i changed a few things with the volumes which is probably why i had this issue)
I watched your video and set up home server monitoring for Docker containers-Grafana is fantastic! Thanks to your guide, I now have two dashboards for monitoring, and they look great. I’ve subscribed to your channel and will keep an eye out for more Docker-related content.
Get hit with a firehose of information! I have found it difficult to find quality tutorials on setting up a Grafana/Prometheus dashboard. Thanks for the wealth of resources and information!
If you are using Ubuntu 22.04 and missing memory stats in grafana to monitor your docker containers, you'll need to change the version tag on cadvisor to: v0.44.1-test
Thanks a lot. There is so much ressources, sometimes ununderstandable, it's difficult to find the information hidden in the noise. Your video is very very helpful. Thanks a lot!
Happy to see this video particularly by "The Digital Life" Thanks sir cause i have seen many videos already but here we can get exact points to remember and its basically on point
Great tutorial, thank you! For any beginers out there. if your like me.. im trying to learn YML syntax... Linux and docker/portainer all at the same time.. Make sure your syntax in your prometheus.yml file is correct or else it wont start... I also had to identify the user: root in my stack editor for prometheus so that /etc/prometheus/prometheus.yml could be read.. im sure thats not secure.
the volumes that your container accesses, run this command on them: sudo chown -R 65534:65534 prometheus_example/ replace "prometheus_example" with the folder name that you provided to your volume(s) 65534 is the user and group id of the user/group that runs prometheus in the container. for me, grafana also had permission issues in the logs of the container, too. the user and group id is 472 so you'd replace "65534" with "472" in the command above.
I don't know why I try to go anywhere else when I need something installed in Docker. These videos always give more information than what is needed and everything is explained very well
Thank you, Christian, for this ultra-high quality content. Learned a lot. One thing tho, as for me, frequently i found it difficult to keep up with your pace.
Thanks for the instructions! As a noob some frustrating moments as your big camera overlay blocks a lot of content and the zoom blocks off urls and other elements. Appreciated!
@@christianlempa can you please make another full video when you got your proxmox up and running especially monitoring on LXC and etc. Im sure it will benefits alot of us!! 😭😍
Wow, there is so much information in this Video i have to look that when im not tired :D But i can say already: Great Video mate! Also i really like the "on camera writing" presentation uve done at 3:46-5:00 since i also learned a lot stuff from Networkchuck when he was doing that. Atleast of course i can also see the small improvements (round corners) youve done at the cam-picture implementation and improvements in structure of your presentation.
Great tutorial, which I used today. It also might be helpful to show max cpu core utilization and overall cpu utilization alerts. While I was trying to setup alerts for home lab, I discovered that Sys Load is showing 170% and CPU Busy 85% when top shows about 10% utilization when I go to the 6 core debian virtualbox node for dashboard 1860 Node Explorer Full. Those stats on that dashboard seem misleading to me, and looking at another dashboard.
Great video as usual. There's just one thing though that I'm curious about and that is missing here. Notifications, for example when a service goes offline or when a specific event happens. I've seen that Grafana has an Alerts feature. I would really appreciate if you could make a video on just something like that for real life scenarios where a notification is useful
Amazing video! You might have already answered this elsewhere but what do you think about socket-proxy for docker. I noticed your portainer/portainer-agent compose files do not use the socket proxy. I have found other folks suggest using the proxy but I am not sure if it totally necessary. Would love your thoughts!
Hello Christian, Thank you for the fantastic video. I have a question about Prometheus. The cadvisor and node_exporter targets are not showing up on the Prometheus page for me. I can see that the web interface is functioning when I log into node_exporter.
Thanks very much for the content. It's very informative. I have a question. If I have n nodes in my cluster. will node exporter give metrics for all of these node machines OR do I need to run node_exporter on each on these nodes
Awesome!. I would like to work on a solution that would visualize various metrics from Palo Alto firewalls. I saw an exporter for Fortigate firewalls. Could you please suggest a way forward? How would I customize an integration option for Palo Alto firewalls? Thanks:)
Hey, I'm being tasked with setting up a monitoring tool for my company which will be configured to scrape data from many servers and applications. Do you think this method is the best to move forward with or is there another you think would be better suited? Please not trying to use the most inexpensive option! Thanks :) and your videos are awesome
Thanks. nice video i upload the dashboard 1860 but can't see the CPU metrics all metrics work on dashboard except the CPU, i try to look for metrics in prometheus, they appear there
Great video ! Just one tiny question: I intend to install Prometheus and Grafana on a RPI4 with 2GB of RAM. Is it enough to monitor about 5 containers and system metrics ?
I've got both up and running but not talking to each other. I added that "Node Explorer Full" but all my displays only show N/A. I can choose the data source at the top but node and host I can only select "None"?
Is there a way to have the graphs show the hostname that the data is for? Say I have 3 servers with node-exporter and cadvisor on them. Will I be able to tell them apart in the dashboards?
@@christianlempa True. Right now I just have one physical server running docker containers , it is named "dockerhost01". In both dashboards from the video, it's "host" name appears as "cadvisor:8080" and "node-exporter:9100" respectively. I'd prefer is show as "dockerhost01" so that I know which physical server the data is from. That way, when I have several docker hosts ( dockerhost02, dockerhost03, etc ) I can identify them by name in the 'Host" drop down table.
I think that I got it. I mapped the container ports to the host and changed the exporter job targets to the host's name. Now I see the correct hostname in the host dropdown menu. It still includes the port in the name, but my google searches haven't revealed a method of removing that from the host's name. i.e. it's dockerhost01:(port) on both dashboards now.
Please be aware: update to the Git Repo: github.com/xcad2k/boilerplates
I now separated the docker-compose files for Grafana and Prometheus in two separate folders!
why. is there any advantage to doing this or were there challenges with the first configuration.
@@giftcp82 In case you wanted to set them up standalone. Not a problem for somebody who's familiar with docker compose YAML files but for somebody just starting out it could get confusing having it all together. This way it narrows the focus and doesn't get everything potentially confused for the new user.
What is the difference between grafana/grafana and granfana/grafana-oss as your updated Git Repo refers to the latter while video refers to the former?
With time any updates like this will be harder to find in the Comments section. I was lucky I found just when I was wondering the video shows a combined docker-compose.yaml but the actual repo has them separated. Maybe update the main Description section with a dated update about the repo? You know, just like a code description update :-) Anyways, loved your video so far, the presentation. Great Job!
The exporters folder seems to be missing also.
Edit: Its in the dir is the prometheus folder not within it.
Absolutely invaluable. I have gone through a few of your other videos as well, and everything is essentially easily digestible essential knowledge that would otherwise take me weeks to search and figure out on my own.
A huge plus is that the scripts and snippets provided actually work out of the box and everything is explained on an almost line by line basis.
Thank you for your amazing work
wait what? invaluable?
@@adeelhashmi145 It's weird that it means what it does (with the prefix in- that normally means the opposite), but it actually means "incredibly valuable" or "more valuable than valuable"
@@adeelhashmi145 priceless
Before going to watch this video .. i really appreciate you for making this video .. i was struggling to learn the basics of Prometheus and grafana , you really helped me by putting this video.. Thx in advance
You're welcome!
Awesome man, a youtube guide that doesn't start with notepad on windows, but immediately gives you the github repo. Love it, great guide!
Thank you so much! :)
Man, I can't thank you enough!! all your videos are so easy to follow and actually understand what I'm doing!! You are awesome!!
Thank you so much :)
今天边学习，边自己服务器配置了监视系统，谢谢Christian Lempa。
Used cockpit for the last 2 years. I am very happy how it works. I have 7 servers in total i have to manage, and cockpit allows me to do just that by logging in on one single server adding others to there and watching there progress
Nice, yeah cockpit is pretty cool, I also use it sometimes ;)
Yep after turning on Cockpit this is exactly what I needed, but if you have more that one server with multiple instances of things then I can see Prometheus/Granafa shine.
for anyone who cannot get the prometheus or grafana container to start or they keep restarting (which is what happened to me), use the details below:
the volumes that your container accesses, run this command on them:
sudo chown -R 65534:65534 prometheus_example/
replace "prometheus_example" with the folder name that you provided to your volume(s)
65534 is the user and group id of the user/group that runs prometheus in the container.
for me, grafana also had permission issues in the logs of the container, too. the user and group id is 472 so you'd replace "65534" with "472" in the command above.
this issue occurs due to the user inside each container not having the correct permissions set. to my knowledge, most people here shouldn't have a problem if you followed the steps provided in the video correctly (which i didn't and i changed a few things with the volumes which is probably why i had this issue)
Thank you so much for this.
@@trekydeky glad this helped you!
Awesome introduction into Grafana using Prometheus!
I watched your video and set up home server monitoring for Docker containers-Grafana is fantastic! Thanks to your guide, I now have two dashboards for monitoring, and they look great. I’ve subscribed to your channel and will keep an eye out for more Docker-related content.
Thank you so much! I’m glad you enjoyed the video 🙏
Thanks!
Many thanks for your support 🥰
Get hit with a firehose of information! I have found it difficult to find quality tutorials on setting up a Grafana/Prometheus dashboard. Thanks for the wealth of resources and information!
If you are using Ubuntu 22.04 and missing memory stats in grafana to monitor your docker containers, you'll need to change the version tag on cadvisor to: v0.44.1-test
Thanks a lot. There is so much ressources, sometimes ununderstandable, it's difficult to find the information hidden in the noise. Your video is very very helpful. Thanks a lot!
You've been an essential piece of the puzzle in setting this up.
Happy to see this video particularly by "The Digital Life" Thanks sir cause i have seen many videos already but here we can get exact points to remember and its basically on point
So nice of you!
Great tutorial, thank you! For any beginers out there. if your like me.. im trying to learn YML syntax... Linux and docker/portainer all at the same time.. Make sure your syntax in your prometheus.yml file is correct or else it wont start... I also had to identify the user: root in my stack editor for prometheus so that /etc/prometheus/prometheus.yml could be read.. im sure thats not secure.
the volumes that your container accesses, run this command on them:
sudo chown -R 65534:65534 prometheus_example/
replace "prometheus_example" with the folder name that you provided to your volume(s)
65534 is the user and group id of the user/group that runs prometheus in the container.
for me, grafana also had permission issues in the logs of the container, too. the user and group id is 472 so you'd replace "65534" with "472" in the command above.
I don't know why I try to go anywhere else when I need something installed in Docker. These videos always give more information than what is needed and everything is explained very well
Thank you! :)
Thanks Christian for all your videos, they are very informative!
All 24 minutes was useful and informative
simply amazing stuff!!
I really like 2 things about your videos
1. amazing and professional explanations
2. your German accent :DD
Thank you so much ☺️
Hey Christian, another amazing video! I set this up in my home lab, and it works great.
Such a great video! I've been developing a Grafana plugin at work and there is large void in high quality Grafana content.
Thank you so much! :)
Thank you bro, 2 years old but still extremely useful.
Thank you! Glad it's useful :)
Thank you, Christian, for this ultra-high quality content. Learned a lot.
One thing tho, as for me, frequently i found it difficult to keep up with your pace.
Just recently stumbled upon your channel and just needed to tell you your videos are awesome.
Subscribed!
Thank you so much 😃
Nice walkthrough man, very robust! Funny, I just did a small lab about these last night! So awesome!
Cool! That's great to hear, thank you btw 😄
Thanks for the instructions! As a noob some frustrating moments as your big camera overlay blocks a lot of content and the zoom blocks off urls and other elements. Appreciated!
Thanks, yeah I know.. hope to improve it in the future ;)
Quite informational video. Thank you for sharing your knowledge
Christian, thanks for great informative video. Would be great to see one video with more in depth steps by step instructions.
Thanks! I hope to make more videos about it next year
It's was a nice video about Prometheus and grafana
great video. I have been looking for months for a solution like this.
Thanks!
Great video, it help us to understand very easily. Nice work.
Always waiting for your new videos to upgrade ourself
Thank you so much 😊
Thank you for this detailed explanation.
Glad it was helpful!
Great video! Going to try and set this up now that I have my Proxmox server up and running
Awesome! I'm currently working on getting this running on proxmox as well 😁
@@christianlempa can you please make another full video when you got your proxmox up and running especially monitoring on LXC and etc. Im sure it will benefits alot of us!! 😭😍
@@keyshine5769 I guess that I will replace Proxmox at some day and focus more on Docker than LXC, there will be a big change in my Homelab next year 😁
It's your pacing. It's just perfect, despite the level of detail you move through at a quick pace, but not so quick that I cannot follow.
Thank you so much! What a nice compliment
Great Explanation sir, you have earned another follower :)
Welcome aboard!
Good explanation and got some new in this tut. Thanks for your great work.
Wow, there is so much information in this Video i have to look that when im not tired :D But i can say already: Great Video mate!
Also i really like the "on camera writing" presentation uve done at 3:46-5:00 since i also learned a lot stuff from Networkchuck when he was doing that.
Atleast of course i can also see the small improvements (round corners) youve done at the cam-picture implementation and improvements in structure of your presentation.
Thank you so much! Great to hear that all the small tweaks help you to get a better experience 😁
Thanks for the demo and info, have a great day
You're welcome! :)
@@christianlempa which extension did you use for visual studio code to enable ssh editing on the server? Remote ssh by Microsoft? Thank you
the channel is incredible, thanks!
Thanks! You're welcome ;)
Great video and super helpful as always! Thx for all your great content!
Great video as usual. Thanks !
Thank you :)
How have i only just seen your channel now! Awesome video, i enjoyed your ad too lol.
Sub gained :)
Awesome, nice to hear you're liking the content 😁
Hey Christian, this was a fantastic video and I learned a ton. I was wondering, how did you setup Portainer?
Thank you! I think there's a tutorial for portainer on my channel :)
I just ended up adding Portainer to the docker-compose.yaml file and this appears to work.
thank you so much! your videos and content are super useful!
Glad you like them!
Bro excellent teaching
Thank you mate! :)
2021 and you show grafana ? Thats "excellent"
Amazing. Thanks so much for this excellent walkthrough
Thank you! :)
Me -> where can I find a good tutorial about Grafana and Prometheus?
Christian -> here you go!
:D
Thanks for all you do for the community!
Haha thanks 😊
Awesome. Will put this on my test lab asap.
Thanks mate that sounds great!
Great tutorial, which I used today. It also might be helpful to show max cpu core utilization and overall cpu utilization alerts. While I was trying to setup alerts for home lab, I discovered that Sys Load is showing 170% and CPU Busy 85% when top shows about 10% utilization when I go to the 6 core debian virtualbox node for dashboard 1860 Node Explorer Full. Those stats on that dashboard seem misleading to me, and looking at another dashboard.
Oh yes, that's another project I want to look at next year :D
@@christianlempayou mean by change grafana to another dashboard?
Could you do a video on how to set up alertmanager on top of this setup? Its a missing piece to this AMAZING tutorial!
Great suggestion, however I'm still working on so many projects. But at some point I'll make a video about Grafana Alerts maybe, we'll see ;)
hi,
perfect video.
i use prtg monitoring for the servers etc.
Primary windows servers and vcenter hyper-v etc.
I love your content, you the teacher I never had
Thank you so much :)
Great video as usual. There's just one thing though that I'm curious about and that is missing here. Notifications, for example when a service goes offline or when a specific event happens. I've seen that Grafana has an Alerts feature. I would really appreciate if you could make a video on just something like that for real life scenarios where a notification is useful
Such a great idea! I'm planning a new video about that, but that's a bit down my list for next year.
@@christianlempa Looking forward to it :)
Nice Explanation, It will be more beneficial if you set up Alert manager, How we can do?
I'm very new to this -- I see that both containers are separate now. How would I go about deploying them now?
Amazing video! You might have already answered this elsewhere but what do you think about socket-proxy for docker. I noticed your portainer/portainer-agent compose files do not use the socket proxy. I have found other folks suggest using the proxy but I am not sure if it totally necessary. Would love your thoughts!
Thanks a lot for sharing with us
Hello Christian, Thank you for the fantastic video. I have a question about Prometheus. The cadvisor and node_exporter targets are not showing up on the Prometheus page for me. I can see that the web interface is functioning when I log into node_exporter.
Thank you :) maybe check the config and docker network routing, otherwise maybe someone on discord can help you
this is the great video, very helpfull. thanks man.
Thanks
Dude! It helped a lot, many thanks!
Glad you liked it!
Great video akhi
Appreciated
Thanks very much for the content. It's very informative.
I have a question. If I have n nodes in my cluster. will node exporter give metrics for all of these node machines OR do I need to run node_exporter on each on these nodes
you have to run node_exporter on all nodes as far as I know
Thank you so mush ❤ Fantastic tutorial 👏
Thank you so much ;)
Hi can you make a video using elasticsearch and grafana ?
Very nice! Thank you very much!
Thank you too!
Very useful, thanks a ton!
I got an error during running all staff: Error response from daemon: path / is mounted on / but it is not a shared or slave mount
any ideas?
Awesome!. I would like to work on a solution that would visualize various metrics from Palo Alto firewalls. I saw an exporter for Fortigate firewalls. Could you please suggest a way forward? How would I customize an integration option for Palo Alto firewalls? Thanks:)
Thanks for sharing, that's helpful.
You’re welcome ☺️
Wow. Thank you very much. That was great.
Glad you enjoyed it!
Thank you so much, it's so understandable nd clear
Great Help!💯💥💥
Glad it helped!
Amazing, thank you very much for your time
excelente material!
thank you!
would be great if you could update the video. volume mounting for prometheus yaml config file seems to no longer work.
Hii How can I Basic understanding Garafana and how can add multiple server on Dashboard graphic and how can monitor
thanks for this tutorial man, super helpful!
Glad you liked it!
Thanks for making the video can you please let me know how Prometheus monitoring is different from Splunk monitoring
+ Good video with deep thoughts as usual
Very useful!
Glad you think so!
I would also add u can use InfluxDB for persistant data
Beautiful Tutorial, thanks!!!!
Glad you liked it!
great video thanks for sharing
He Christian we need to complete this course with Prometheus Alert Manager and Grafana Alters
That's a great idea, unfortunately I can only get to it somewhere next year, but I'm looking into it
@@christianlempa Thanks 🫥🫡
thank you for this amazing video very helpful 👍🏻
Thanks!
content of high standards!!
Great job! Thank you!
Hey, I'm being tasked with setting up a monitoring tool for my company which will be configured to scrape data from many servers and applications. Do you think this method is the best to move forward with or is there another you think would be better suited? Please not trying to use the most inexpensive option! Thanks :) and your videos are awesome
Thank you for sharing
Thanks. nice video
i upload the dashboard 1860 but can't see the CPU metrics
all metrics work on dashboard except the CPU, i try to look for metrics in prometheus, they appear there
Do you have any video how can i configure Prometheus to send data collected via email as a CVS or PDF file ?
Great video ! Just one tiny question: I intend to install Prometheus and Grafana on a RPI4 with 2GB of RAM. Is it enough to monitor about 5 containers and system metrics ?
I've got both up and running but not talking to each other. I added that "Node Explorer Full" but all my displays only show N/A. I can choose the data source at the top but node and host I can only select "None"?
I have no data with the imported Dashboards. What can i do?
Collect some data
Is there a way to have the graphs show the hostname that the data is for? Say I have 3 servers with node-exporter and cadvisor on them. Will I be able to tell them apart in the dashboards?
Yes, there is a dropdown box where you can select one, or more, or all machines
@@christianlempa True. Right now I just have one physical server running docker containers , it is named "dockerhost01". In both dashboards from the video, it's "host" name appears as "cadvisor:8080" and "node-exporter:9100" respectively. I'd prefer is show as "dockerhost01" so that I know which physical server the data is from.
That way, when I have several docker hosts ( dockerhost02, dockerhost03, etc ) I can identify them by name in the 'Host" drop down table.
I think that I got it. I mapped the container ports to the host and changed the exporter job targets to the host's name. Now I see the correct hostname in the host dropdown menu. It still includes the port in the name, but my google searches haven't revealed a method of removing that from the host's name. i.e. it's dockerhost01:(port) on both dashboards now.
Thank you so much! It's so easy to understand and keep following.
Awesome content!!
Glad you think so!