Тёмный

Best Server Monitoring with Prometheus and Grafana using Node Exporter and cAdvisor 

VirtualizationHowto
Подписаться 54 тыс.
Просмотров 59 тыс.
0% 0

A complete walkthrough of completely free and open source solutions to monitor your Linux, Windows, and Docker servers. In the view we see how we can setup and configure Prometheus, Node Exporter, Grafana, and cAdvisor to monitor servers in our environment and how you can easily configure these.
Clone down the examples in this video from the following Git repository:
github.com/brandonleegit/Open...
Subscribe to the channel: / @virtualizationhowto
My blog:
www.virtualizationhowto.com
_____________________________________________________
Social Media:
/ vspinmaster
LinkedIn:
/ brandon-lee-vht
Github:
github.com/brandonleegit
Introduction to Prometheus, Node Exporter, Grafana, and cAdvisor - 0:00
Looking at how everything fits together - 1:15
Node Exporter details and written for Linux - 2:15
Windows Exporter to expose metrics for monitoring Windows machines - 2:28
cAdvisor for monitoring Docker containers - 2:56
Looking at the Linux host serving as the Docker container host - 3:26
Installing Docker Compose - 3:51
Verifying Docker Compose installation - 4:12
Looking at our Linux user used to run Docker on the Docker host - 4:27
Creating the local folder structure for the local volume mounts - 5:05
Using a crude bash script to create the folder structure - 5:23
Running the command to create the folders - 6:29
Overview of installing the monitoring stack with Docker Compose - 7:08
Editing the Docker Compose file for creating the monitoring stack - 8:03
Stepping through the Docker Compose configuration - 8:18
Talking through permissions and adding the User ID to avoid permissions issues with Prometheus - 9:22
Looking at cAdvisor and odd ports used - 10:47
Redis dependency 11:10
Saving the Docker Compose YAML file - 11:34
Running the Docker Compose UP command - 11:53
The provisioning of the containers finishes, checking everything to see if it is up and running - 12:18
Talking through troubleshooting if a container is crashing - 12:58
Containers are healthy and ready to move forward - 13:13
Talking about configuring Prometheus and getting metrics into Grafana - 13:23
Beginning the configuration of Prometheus - 13:43
Adding configuration to the Prometheus YAML file - 14:18
Stop and start Prometheus container to pick up the new YAML file - 14:43
Browsing out to port 3000 on Docker host to login to Grafana - 15:08
Change your password - 15:18
Navigate to settings and adding a data source - 15:30
Populating the address of our Prometheus installation - 15:48
Save and test the new data source - 16:06
Looking at the Explore dashboard icon - 16:17
Importing a community dashboard - 16:40
Getting the JSON file or ID from the Grafana community dashboards site - 17:00
Downloading the JSON or copy ID to clipboard - 17:30
Paste in the ID of the community dashboard - 17:42
Immediately you see the new dashboard imported to view metrics - 18:15
Looking at Windows Exporter to import metrics from a Windows host - 18:50
Download the Windows Exporter file and copy out to Windows host - 19:16
Running the Exporter installation and viewing Windows Exporter service - 19:30
Adding the Windows Exporter host to our Prometheus configuration - 19:50
Restarting Prometheus to pick up the new Windows host - 20:23
Download a Windows Exporter community dashboard - 20:37
Viewing the new Windows Exporter dashboard and information - 21:18
Talking about adding Docker to monitoring with Prmetheus and Grafana - 21:47
Looking at the Prometheus configuration and the cAdvisor configuration we have in place - 22:04
Concluding and wrapping up thoughts on Prometheus, Node Exporter, Grafana, and cAdvisor - 22:53
A written walkthrough of Prometheus Node Exporter monitoring:
www.virtualizationhowto.com/2...
Best docker containers for Synology NAS:
www.virtualizationhowto.com/2...

Хобби

Опубликовано:

 

5 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 52   
@damadorpl
@damadorpl Год назад
a little hint with today docker 23 update :) docker-compose up -d become docker compose up -d - wthout dash in the middle :)
@guapoforastero2668
@guapoforastero2668 Год назад
First off all thanks for the excellent vidéo it has helped me in my project.
@ThrottleScotty
@ThrottleScotty Год назад
Excellent tutorial. Thanks for this! I'm just getting started with Prometheus and Grafana. Have two questions: 1) Have you seen any dashboards that aggregate Linux, Windows and Docker monitoring into a single (perhaps very simplified) view? 2) Do you have recommendations for alerting? Meaning, if a docker container is reporting as unhealthy, or a specific Linux OS metric is reporting above/below a set threshold, an alert is sent via email/sms to admins...
@guidoricioppo7759
@guidoricioppo7759 Год назад
Hello, great video! From what I understand Redis is not actual dependency. It is used on the prometheus guide just as "reference container" for examples
@VirtualizationHowto
@VirtualizationHowto Год назад
Thank you for your comment! Good point!
@Synthel98
@Synthel98 Год назад
Great tutorial! Do you have some guide to read better logs of all containers? Currently I'm using Dozzle, but I saw some solutions like ELK (Elastic Search, Logstash and Kibana) , any chance to you bring some tutorial to implement in docker-compose?
@itsmendyou
@itsmendyou 7 месяцев назад
Thank you. It's very helpful.
@NetBandit70
@NetBandit70 Год назад
Heavy on the configuration. You'd think that a monitoring agent would be able to push metrics out instead of listening. So now you have to install the agent (Windows Exporter), configure the Windows firewall, and setup Prometheus to pull metrics. Anyway, a great video even if the configuration is cumbersome.
@andreaquentino1068
@andreaquentino1068 Год назад
nice!!! Very handy!!!
@VirtualizationHowto
@VirtualizationHowto Год назад
Thank you Andrea!
@guapoforastero2668
@guapoforastero2668 Год назад
I have a question what would the configuration of the exporters and the Prometheus server be like if the servers were AT the company's office and the Prometheus server was AT home. Basically a remote monitoring. Thanks
@janupriyo2096
@janupriyo2096 Год назад
so easy turotial, Good job thanks bro
@VirtualizationHowto
@VirtualizationHowto Год назад
Janu thanks for the comment! So glad it was helpful.
@janupriyo2096
@janupriyo2096 Год назад
@@VirtualizationHowto you are welcome bro
@victormacedo4080
@victormacedo4080 6 месяцев назад
Great video! Does anyone knows how much CPU and memory this monitoring stack uses?
@RolandTutorials
@RolandTutorials 6 месяцев назад
i love this, thanks
@VirtualizationHowto
@VirtualizationHowto 5 месяцев назад
Thank you too!
@MrInvalidnick
@MrInvalidnick Год назад
Thank you for share. Greetings
@VirtualizationHowto
@VirtualizationHowto Год назад
Thank you for your comment! Take care.
@filipfedorisin3457
@filipfedorisin3457 Год назад
Hello, i am unable to hit node exporter and cadvisor metrics endpoints via prometheus. It gives me context deadline exceeded error. However when i try to curl it works like charm. Can you please help me with this?
@aoczon
@aoczon 8 месяцев назад
Not sure if this has been asked already. Can you add how also how install the snmp exporter. Thanks
@leolomonosov4021
@leolomonosov4021 Год назад
Hello! Perfect tutorial. The only problem for me, where do you get the IP for grafana? Should I go by localhost or I need to find grafana's IP?
@opozicijanajednommestu5682
@opozicijanajednommestu5682 7 месяцев назад
ifconfig
@mathewcampisi7594
@mathewcampisi7594 11 месяцев назад
How do I add other servers to prometheus? Like 2 linode and a digital ocean server? I'm running prometheus locally, so would i need to create cloudflare tunnels???? Also can you make a video on running grafana and prometheus on trunas?
@md.ishfakurrahman8457
@md.ishfakurrahman8457 Год назад
How do you decided ip address for targets? There is docker ip address too!
@squalazzo
@squalazzo Год назад
i beg you pardon in case you already explained this in the video (i'm still at the beginning), or you can maybe make a video on this in the future, please: having BOTH metrics AND logs combined in a grafana dashboard, so to have a complete monitoring solutions, scrolling both "targets" in sync/parallel, to have a full view on what, how and when something happened... thanks!
@squalazzo
@squalazzo Год назад
ok, saw full video, probably what i asked is related more to kubernetes and less to docker, really... but, in case, a video covering this "extended" setup would be much appreciated :D
@bayuwiratmo2820
@bayuwiratmo2820 10 месяцев назад
how to add target if I have 5 VM running on premise server? Just newbie
@vasiliynet3425
@vasiliynet3425 Год назад
Thanks! Looks more pretty than Zabbix.
@VirtualizationHowto
@VirtualizationHowto Год назад
Vasilly, I definitely prefer PRTG for its capabilities, look, and feel...
@typingaddict1319
@typingaddict1319 Год назад
It doesnt seem like grafana can see the nodes i have from cAdvsior. My Docker container dashboard has no data. What steps can I take to troubleshoot this?
@witblack
@witblack 5 месяцев назад
i have this problem too. Did you find any answers for fix this issue? Can anybody help us?
@daiben2004
@daiben2004 7 месяцев назад
nice, But how to monitor VMware ESXI and True Nas Core Storage?
@VirtualizationHowto
@VirtualizationHowto 6 месяцев назад
@daiben2004 Thank you for your comment! Sign up on the forums and I can give more personalized help here: www.virtualizationhowto.com/community. Thank you again.
@886609769
@886609769 Год назад
need some assistance: Prometheus is up and working, I have node exporters loaded on few server. Prometheus is able to identify them and scrape them. Installed Grafana and connected to Prometheus but Grafana is not able to show any data in dashboard any recommendations?
@VirtualizationHowto
@VirtualizationHowto Год назад
Hello and thanks for the comment! Does grafana see the prometheus data source when you add it in settings?
@shamshershaikh17
@shamshershaikh17 6 месяцев назад
Can we create a metrics to monitor service status like ntpd, chronyd, auditd in Prometheus
@VirtualizationHowto
@VirtualizationHowto 6 месяцев назад
@shamshershaikh17 thank you for the comment! Sign up for the forums here: www.virtualizationhowto.com/community and let's discuss it in more detail there.
@sadesguy1152
@sadesguy1152 8 месяцев назад
mkdir: can't create directory '/var/lib/grafana/plugins': Permission denied
@MarkConstable
@MarkConstable День назад
Nope, not interested in a docker based solution... moving on.
@rainbowforest09
@rainbowforest09 Год назад
I am having an issue with prometheus. When I try docker-compose up -d there is one error that occurs. Cannot start service prometheus: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error mounting "/root/monitorsvr/prometheus/prometheus.yml" to rootfs at "/etc/prometheus/prometheus.yml": mount /root/monitorsvr/prometheus/prometheus.yml:/etc/prometheus/prometheus.yml (via /proc/self/fd/6), flags: 0x5000: not a directory: unknown: Are you trying to mount a directory onto a file (or vice-versa)? How to solve this?
@VirtualizationHowto
@VirtualizationHowto Год назад
erefem make sure you created a directory and not a file in your Linux environment. Also, check out permissions. Let me know if this helps.
@rainbowforest09
@rainbowforest09 Год назад
@@VirtualizationHowto I follow every step carefully but have had no success. I also add user to docker group. Is there something I am missing here?
@fortypanda
@fortypanda Год назад
@@rainbowforest09 1. Switch your user to root and run everything from there. 2. Check the user id (id -u) then change it to match accordingly in the docker-compose.yml file as in the video. Then proceed with the steps as he has done. It will work.
@TerryMcKnight1
@TerryMcKnight1 Год назад
I have exactly the same issue as erefem. lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 22.10 Release: 22.10 Codename: kinetic /promgrafnode$ sudo docker compose up -d [+] Running 4/5 ⠿ Container redis Started 1.2s ⠿ Container cadvisor Started 2.4s ⠿ Container node-exporter Running 0.0s ⠿ Container grafana Started 0.0s ⠼ Container prometheus Starting 2.4s Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error mounting "/root/promgrafnode/prometheus/prometheus.yml" to rootfs at "/etc/prometheus/prometheus.yml": mount /root/promgrafnode/prometheus/prometheus.yml:/etc/prometheus/prometheus.yml (via /proc/self/fd/6), flags: 0x5000: not a directory: unknown: Are you trying to mount a directory onto a file (or vice-versa)? Check if the specified host path exists and is the expected type
@khisanthxanadu2192
@khisanthxanadu2192 Год назад
I get the same error
Далее
Guess The Drawing! ✍️✨🧐 #shortsart
00:14
Просмотров 3 млн
Server Monitoring with Grafana Prometheus and Loki
51:44
This web UI for Ansible is so damn useful!
20:07
Просмотров 458 тыс.
Don’t run Proxmox without these settings!
25:45
Просмотров 124 тыс.
Proxmox 10 tweaks you need to know
9:48
Просмотров 37 тыс.
😍😂❤️ #shorts
0:12
Просмотров 1,9 млн
Surprised 😳🤩🤩❤️🔥🥳
0:35
Просмотров 32 млн