{"repo":"quixio/quix-streams","free":true,"listed":false,"github":"https://github.com/quixio/quix-streams","clone":"git clone https://github.com/quixio/quix-streams.git","description":"Python Streaming DataFrames for Kafka","language":"Python","stars":1567,"topics":["kafka","python","stream-processing","data-engineering","data-science","machine-learning","real-time-data-processing","streaming-data","streaming-data-pipelines","streaming-data-processing"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"\\ Open source Python framework for reliable data engineering Quix Streams is an end-to-end framework for real-time Python data engineering, operational analytics and machine learning on Apache Kafka data streams. Extract, transform and load data reliably in fewer lines of code using your favourite Python libraries. Build data pipelines and event-driven microservice architectures leveraging Kafka's low-level scalability, resiliency and durability features in a lightweight library without server-side clusters to manage. Key Features 💎 Quix Streams provides the following features to make your life easier: - Pure Python, meaning no wrappers around Java and no cross-language debugging. - Streaming DataFrame API for building tabular data processing pipelines. - Sources & Sinks API for building custom connectors that integrate data with Kafka. - Serializers API supporting JSON, Avro, Protobuf & Schema Registry. - Fault-tolerant stateful operations. - Operators for common processing tasks like Windowing, Branching and Group By. - Exactly-once processing guarantees via Kafka transactions. - Streaming Joins. Use Quix Streams to build simple Kafka producer/consumer applications or leverage stream processing to build complex event-driven systems, real-time data pipelines and AI/ML products. Getting Started 🏄 Install Quix Streams Requirements Python 3.9+, Apache Kafka 0.10+ See requirements.txt for the full list of requirements Documentation Quix Streams Docs Example Here's an example o","default_branch":null,"files":null,"tree":[],"storefront":"/r/quixio","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/quixio/quix-streams/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}