{"repo":"faust-streaming/faust","free":true,"listed":false,"github":"https://github.com/faust-streaming/faust","clone":"git clone https://github.com/faust-streaming/faust.git","description":"Python Stream Processing. A Faust fork","language":"Python","stars":1883,"topics":["asyncio","python-streaming","kafka","redis","distributed-systems"],"license":null,"category":"data-pipelines","readme_excerpt":"Python Stream Processing Fork Installation pip install faust-streaming Documentation - introduction : https://faust-streaming.github.io/faust/introduction.html - quickstart : https://faust-streaming.github.io/faust/playbooks/quickstart.html - User Guide : https://faust-streaming.github.io/faust/userguide/index.html Why the fork We have decided to fork the original Faust project because there is a critical process of releasing new versions which causes uncertainty in the community. Everybody is welcome to contribute to this fork , and you can be added as a maintainer. We want to: - Ensure continues release - Code quality - Use of latest versions of kafka drivers (for now only aiokafka) - Support kafka transactions - Update the documentation and more... Usage Faust is a stream processing library, porting the ideas from Kafka Streams to Python. It is used at Robinhood to build high performance distributed systems and real-time data pipelines that process billions of events every day. Faust provides both stream processing and event processing , sharing similarity with tools such as Kafka Streams , Apache Spark , Storm , Samza , Flink , It does not use a DSL, it's just Python! This means you can use all your favorite Python libraries when stream processing: NumPy, PyTorch, Pandas, NLTK, Django, Flask, SQLAlchemy, ++ Faust requires Python 3.6 or later for the new async/await syntax, and variable type annotations. Here's an example processing a stream of incoming orders: The Agent d","default_branch":null,"files":null,"tree":[],"storefront":"/r/faust-streaming","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/faust-streaming/faust/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}