{"repo":"116davinder/kafka-cluster-ansible","free":true,"listed":false,"github":"https://github.com/116davinder/kafka-cluster-ansible","clone":"git clone https://github.com/116davinder/kafka-cluster-ansible.git","description":"Fully Managed Apache Kafka Cluster with Ansible & Terraform.","language":"Python","stars":38,"topics":["kafka","production-ready","ansible","ansible-playbook","managed","cmak","kafka-manager","aws","cloudwatch-logs","terraform"],"license":"GPL-2.0","category":"deployment-docker-iac","readme_excerpt":"Apache Kafka Ansible It is a group of playbooks to manage apache kafka. Requirements Download Apache Kafka Tar on Ansible Server ( Mandatory ) vagrant (optional) Any OS with SystemD Ansible Notes Extra Open Source Web-UI https://github.com/yahoo/kafka-manager Zookeeper Installation https://github.com/116davinder/zookeeper-cluster-ansible Development Setup with Vagrant Vagrant PreSetup for cluster It will update /etc/hosts with required dns names. Development with Cloud Infra Setup for Apache Kafka Using Terraform terraform/aws terraform/oci AWS Cloud PreSetup for cluster It will enable following things on all nodes. 1. /kafka mount point from ebs created by terraform. 2. Install and configure awslogs agent for kafka-logs. 3. Install python3 packages Update Required vars in . Update Required vars in . Production Environment Setup To start new cluster Update Required vars in . Update Required vars in . Monitoring for Kafka & Mirror Maker Cluster To add Custom monitoring to cluster roles/jmxMonitor/files/kafka-input.txt roles/jmxMonitor/files/kafka-mirror-input.txt To add Custom Consumer Group monitoring to cluster It will monitor consumer groups mentioned in below file. roles/jmxMonitor/files/kafka-consumer-group-metric-input.txt Sample Splunk Dashboards To add newrelic monitoring to cluster Sample NewRelic Dashboards To add new broker to cluster Update Required vars in . Update Required vars in . To Upgrade Kafka Version download kafka tar in your local ansible box. Update Req","default_branch":null,"files":null,"tree":[],"storefront":"/r/116davinder","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/116davinder/kafka-cluster-ansible/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}