seatgeek/nomad-firehose
Nomad-firehose is a tool that streams real-time HashiCorp Nomad cluster events such as job, allocation, node, and evaluation changes to various messaging systems and sinks for enhanced observability and automation.
Awesome Nomad › Monitoring and Logging
mr-karan/nomad-vector-logger
The project "nomad-vector-logger" is a daemon designed to enhance log collection in HashiCorp Nomad clusters by continuously monitoring running jobs and generating configuration files for Vector, a log collection tool. It addresses a key limitation in Nomad's native logging system, where logs stored in the allocation directories lack metadata that identifies the task, job, or allocation, making it difficult to distinguish logs from multiple deployments on the same host. This is particularly problematic for deployments using the raw_exec and exec task drivers, which do not have built-in logging configuration like the docker driver. The daemon works by polling for allocations on the node and dynamically generating a Vector configuration file that collects logs from the allocation's log directory. It enriches each log event with detailed Nomad metadata, including the namespace, node name, job name, group name, task name, and allocation ID. This metadata annotation enables centralized log collection agents to uniquely identify and process logs from different deployments. Vector is run with a watch-config flag that allows it to automatically reload its configuration whenever there are changes, such as when allocations are created, stopped, or restarted. This ensures that the log collection setup stays up to date with the current state of the Nomad cluster. The project provides sample configuration files and deployment examples, including running the daemon as a system job within the Nomad cluster with appropriate ACL policies for secure access to allocation events. It supports multiple deployment methods, including running the binary directly, deploying via Nomad job specifications, or using Docker images. Overall, nomad-vector-logger significantly improves log management in Nomad environments by enabling enriched, metadata-aware log collection for tasks that otherwise lack this capability, facilitating better observability and troubleshooting.
https://github.com/mr-karan/nomad-vector-logger
Also in Monitoring and Logging
mr-karan/nomad-monitoring
A collection of jobspecs and Grafana dashboards for comprehensive end-to-end monitoring of HashiCorp Nomad clusters, utilizing Prometheus metrics and VictoriaMetrics for efficient data collection and storage.
sepulworld/deadman-check
Deadman Check is a monitoring tool for HashiCorp Nomad periodic jobs that alerts users if jobs fail to run at their expected intervals, using Consul for tracking and supporting Slack and AWS SNS for notifications.
mr-karan/nomad-events-sink
Nomad Events Sink is an event collection agent that processes HashiCorp Nomad events and forwards them to external sink providers like HTTP for monitoring, alerting, and analysis.
jrasell/nomad-toast
Nomad Toast is an open-source tool that provides real-time notifications based on HashiCorp Nomad events, enhancing observability and operational awareness through Slack integration.
kangaroot/rootstack-devfactory
Rootstacks Devfactory is a solution that provides a secure, observable, and integrated runtime environment for containers, native applications, and VMs using HashiCorp Nomad and related tools.
burdandrei/nomad-monitoring
A project for monitoring HashiCorp Nomad clusters using InfluxDB, Telegraf, and Grafana with Prometheus metrics telemetry.