{"repo":"bakdata/kpops","free":true,"listed":false,"github":"https://github.com/bakdata/kpops","clone":"git clone https://github.com/bakdata/kpops.git","description":"Deploy Kafka pipelines to Kubernetes","language":"Python","stars":15,"topics":["kafka","kafka-connect","kafka-streams","kubernetes","pipelines","stream-processing"],"license":"MIT","category":"data-pipelines","readme_excerpt":"KPOps Key features - Deploy Kafka apps to Kubernetes : KPOps allows to deploy consecutive Kafka Streams applications and producers using an easy-to-read and -write pipeline definition. - Manage Kafka Connectors : KPOps connects with your Kafka Connect cluster and deploys, validates, and deletes your connectors. - Configure multiple pipelines and steps : KPOps has various abstractions that simplify configuring multiple pipelines and steps within pipelines by sharing common configuration between different components, such as producers or streaming applications. - Handle your topics and schemas : KPOps not only creates and deletes your topics but also registers and deletes your schemas. - Clean termination of Kafka components : KPOps removes your pipeline components (i.e., Kafka Streams applications) from the Kubernetes cluster and cleans up the component-related states (i.e., removing/resetting offset of Kafka consumer groups). - Preview your pipeline changes : With the KPOps dry-run, you can ensure your pipeline definition is set up correctly. This helps to minimize downtime and prevent potential errors or issues that could impact your production environment. Documentation For detailed usage and installation instructions, check out the documentation. Install KPOps KPOps comes as a PyPI package. You can install it with pip: GitHub action Please refer to the GitHub Actions section for the documentation. Contributing We are happy if you want to contribute to this project. If you ","default_branch":null,"files":null,"tree":[],"storefront":"/r/bakdata","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bakdata/kpops/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}