Awesome Nomad › Automation and Infrastructure Management

cosmonic-labs/netreap

⭐ 142 Go added to this list on 2024-12-11 repository created 2023-05-02

Netreap is a specialized controller designed to manage Cilium networking within a Nomad cluster environment, providing functionality similar to the Cilium Operator used in Kubernetes but tailored for non-Kubernetes setups. It was initially created to clean up orphaned Cilium Endpoints, hence the name "Netreap," but has since expanded to include broader cluster management capabilities. The project addresses the limitation that the official Cilium Operator is deeply integrated with Kubernetes, making it unsuitable for use with Nomad. Netreap helps maintain cluster health by cleaning up nodes that no longer exist from the key-value store and deleting endpoints that no longer have associated services. Netreap requires a running Nomad cluster, a Consul cluster or server (though etcd can also be used as a KV store), and Cilium versions 1.12.x or 1.13.x. It also requires the installation of CNI plugins alongside Cilium. Due to Nomad's current fingerprinting method, Cilium cannot be run as a system job to provide the CNI plugin, so it must be manually configured and run on each agent node, typically using systemd with Docker to run the Cilium agent container. Proper iptables configuration on the host is necessary for network functionality. The project includes detailed instructions for setting up the CNI configuration, ensuring no IP CIDR conflicts with Docker, and deploying Netreap as a system job within Nomad. Netreap uses leader election to allow multiple instances to run concurrently for high availability. It also supports integration with Nomad and Consul ACLs for secure operation. A key feature of Netreap is syncing Cilium network policies across all nodes in the mesh, which is essential since Nomad does not support Kubernetes CRDs used by Cilium for policy management. Netreap watches for changes in policy stored in Consul and applies them cluster-wide, enabling effective network security and policy enforcement in Nomad environments. Overall, Netreap fills a critical gap for users running Cilium networking in Nomad clusters by providing essential cluster management and policy synchronization capabilities outside of Kubernetes, making it a valuable tool for cloud-native networking in Nomad-based infrastructures.

https://github.com/cosmonic-labs/netreap

ciliumcilium-cluster-meshcilium-operatorcilium-policiescloud-native-networkingcluster-managementcni-pluginsconsulconsul-aclscosmonicdockeretcdiptableskv-storeleader-electionnetreapnetwork-policiesnetwork-securitynomadnomad-aclsorphaned-endpointssystemd