Awesome Nomad › Monitoring and Logging

kangaroot/rootstack-devfactory

⭐ 40 Jinja added to this list on 2024-12-11 repository created 2022-03-21

Rootstacks Devfactory is a comprehensive solution designed to provide teams with a quick and efficient runtime environment that supports containers, native applications, and virtual machines. The project leverages the HashiCorp toolset to deliver a robust service discovery and service mesh infrastructure, enabling seamless runtime environments for various workloads including VMs, containers, native applications, and Spring Boot services. Key features include secure and transparent routing, built-in auditability and logging with minimal configuration, and a monitored environment to ensure operational visibility and reliability. The architecture of the Devfactory requires a minimum of four virtual machines for deployment, with recommendations to start with five or six for upgrade flexibility. The runtime stack operates natively on Linux systems, providing the foundation for the Nomad runtime and observability components. The solution integrates several open-source tools such as HashiCorp Nomad for workload orchestration, HashiCorp Consul for service mesh and internal DNS, Docker for container runtime, Promtail and Grafana Loki for log collection and indexing, Grafana for metrics visualization, Minio for S3-compatible storage, Prometheus for monitoring, and Traefik as an ingress controller. Nomad is configured with three master nodes and three clients, supporting namespaces for administrative and client workloads. Consul is deployed with three servers and provides service mesh capabilities and key/value storage. Docker is configured with enhanced logging and security features, including support for privileged containers and volume management. Promtail scrapes logs and forwards them to Loki, which indexes and stores logs using Minio as the backend. Grafana provides dashboards for monitoring logs and metrics, integrating data sources like Loki and Prometheus. Prometheus is deployed as a Nomad job for metrics scraping, while Traefik manages ingress traffic with support for Let's Encrypt certificates and custom TLS configurations. The project is initially focused on Azure deployment but is designed to be flexible for other environments. Installation requires setting up an inventory and dependencies such as VirtualBox, Vagrant, and Python3 for local development. Overall, Rootstacks Devfactory offers a well-integrated, secure, and observable runtime environment leveraging HashiCorp Nomad and related technologies to streamline application deployment and management.

https://github.com/kangaroot/rootstack-devfactory

auditabilityazure-deploymentconsulcontainerdockergrafanagrafana-lokihashicorp-consulhashicorp-nomadlogginglokiminiomonitoringnomadprometheuspromtailruntime-environmentsecure-routingservice-discoveryservice-meshspring-boottraefikvirtual-machine