seatgeek/nomad-firehose
Nomad-firehose is a tool that streams real-time HashiCorp Nomad cluster events such as job, allocation, node, and evaluation changes to various messaging systems and sinks for enhanced observability and automation.
Awesome Nomad › Monitoring and Logging
mr-karan/nomad-events-sink
Nomad Events Sink is an event collection agent designed specifically for HashiCorp Nomad clusters. It leverages the Nomad Events SDK to fetch real-time events emitted by Nomad, which are crucial for debugging cluster states and alerting operators about important occurrences such as new deployments, failing allocations, and node updates. The primary purpose of this tool is to ingest these events and forward them to various external sink providers for further analysis, visualization, or alerting. The architecture of Nomad Events Sink involves creating subscriptions for each event topic and watching for new events. When an event is received, it is added to a sink channel where multiple background workers process these events in a first-in-first-out (FIFO) manner. These workers batch the events and push them to configured upstream providers such as HTTP endpoints or S3 storage. To ensure reliability, the tool commits the event index state to disk, allowing it to resume processing from the last known state after a restart. To optimize performance and reduce overhead, the tool employs two batching strategies: an idle timeout that flushes batches after a certain duration and an event count threshold that triggers a flush when enough events accumulate. This design makes it efficient in handling high volumes of events without overwhelming the sink providers. Nomad Events Sink supports multiple deployment options including running as a binary, within Docker containers, or directly on a Nomad cluster using a job specification. Configuration is flexible, allowing settings to be provided via configuration files or environment variables, including those required for Nomad API client authentication. Currently, the tool supports an HTTP sink provider with examples demonstrating integration with Vector and Loki for event ingestion and storage. The project encourages contributions for additional sink providers and features, making it a versatile and extensible solution for managing Nomad event streams.
https://github.com/mr-karan/nomad-events-sink
Also in Monitoring and Logging
mr-karan/nomad-vector-logger
Nomad-vector-logger is a daemon that monitors Nomad cluster jobs and generates Vector configuration files to collect logs enriched with Nomad metadata for improved centralized logging and observability.
mr-karan/nomad-monitoring
A collection of jobspecs and Grafana dashboards for comprehensive end-to-end monitoring of HashiCorp Nomad clusters, utilizing Prometheus metrics and VictoriaMetrics for efficient data collection and storage.
sepulworld/deadman-check
Deadman Check is a monitoring tool for HashiCorp Nomad periodic jobs that alerts users if jobs fail to run at their expected intervals, using Consul for tracking and supporting Slack and AWS SNS for notifications.
jrasell/nomad-toast
Nomad Toast is an open-source tool that provides real-time notifications based on HashiCorp Nomad events, enhancing observability and operational awareness through Slack integration.
kangaroot/rootstack-devfactory
Rootstacks Devfactory is a solution that provides a secure, observable, and integrated runtime environment for containers, native applications, and VMs using HashiCorp Nomad and related tools.
burdandrei/nomad-monitoring
A project for monitoring HashiCorp Nomad clusters using InfluxDB, Telegraf, and Grafana with Prometheus metrics telemetry.