seatgeek/nomad-firehose
Nomad-firehose is a tool that streams real-time HashiCorp Nomad cluster events such as job, allocation, node, and evaluation changes to various messaging systems and sinks for enhanced observability and automation.
Awesome Nomad › Monitoring and Logging
The project "nomad-monitoring" is a comprehensive collection of jobspecs and Grafana dashboards designed specifically for end-to-end monitoring of HashiCorp Nomad clusters. It provides a robust solution to monitor the health, resource usage, and performance metrics of Nomad servers, clients, and allocations. The dashboards included in the project allow users to visualize critical metrics such as CPU, memory, disk usage, Raft usage, and RPC usage, offering a detailed insight into the operational status of Nomad clusters. The project leverages Nomad's built-in metrics publication capabilities, which simplifies the collection of monitoring data without the need for third-party tools. It uses Prometheus metrics enabled through Nomad's telemetry configuration, allowing for efficient and standardized metrics collection. The repository demonstrates the use of "vmagent," a lightweight metrics collection agent from VictoriaMetrics, chosen for its user-friendly configuration and low resource consumption. This agent collects Prometheus metrics and forwards them to VictoriaMetrics, a time-series database optimized for handling large volumes of active time series data with efficient storage and configurable retention periods. The project also addresses service discovery challenges within Nomad namespaces, highlighting current limitations and suggesting solutions such as using Consul for service discovery or deploying vmagent instances per namespace. It provides practical instructions for running a local Nomad agent and deploying the full monitoring stack, including Grafana, VictoriaMetrics, and vmagent. Overall, "nomad-monitoring" is a valuable toolset for administrators and operators of Nomad clusters who need detailed, real-time monitoring and visualization of their infrastructure's performance and health. It integrates seamlessly with existing Nomad telemetry features and enhances observability through well-designed dashboards and efficient metrics collection and storage mechanisms.
https://github.com/mr-karan/nomad-monitoring
Nomad-firehose is a tool that streams real-time HashiCorp Nomad cluster events such as job, allocation, node, and evaluation changes to various messaging systems and sinks for enhanced observability and automation.
Nomad-vector-logger is a daemon that monitors Nomad cluster jobs and generates Vector configuration files to collect logs enriched with Nomad metadata for improved centralized logging and observability.
Deadman Check is a monitoring tool for HashiCorp Nomad periodic jobs that alerts users if jobs fail to run at their expected intervals, using Consul for tracking and supporting Slack and AWS SNS for notifications.
Nomad Events Sink is an event collection agent that processes HashiCorp Nomad events and forwards them to external sink providers like HTTP for monitoring, alerting, and analysis.
Nomad Toast is an open-source tool that provides real-time notifications based on HashiCorp Nomad events, enhancing observability and operational awareness through Slack integration.
Rootstacks Devfactory is a solution that provides a secure, observable, and integrated runtime environment for containers, native applications, and VMs using HashiCorp Nomad and related tools.
A project for monitoring HashiCorp Nomad clusters using InfluxDB, Telegraf, and Grafana with Prometheus metrics telemetry.