{"repo":"argoproj-labs/old-argo-dataflow","free":true,"listed":false,"github":"https://github.com/argoproj-labs/old-argo-dataflow","clone":"git clone https://github.com/argoproj-labs/old-argo-dataflow.git","description":"Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.","language":"Go","stars":274,"topics":["kubernetes","pipeline","kafka","jetstream","data"],"license":"Apache-2.0","category":"deployment-docker-iac","readme_excerpt":"Dataflow NOTICE Argo Dataflow has been reimplemented in the scope of a broader project focussed on real-time data processing and analytics. Please checkout the new numaflow project. Summary Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines. Each pipeline is specified as a Kubernetes custom resource which consists of one or more steps which source and sink messages from data sources such Kafka, NATS Streaming, or HTTP services. Each step runs zero or more pods, and can scale horizontally using HPA or based on queue length using built-in scaling rules. Steps can be scaled-to-zero, in which case they periodically briefly scale-to-one to measure queue length so they can scale a back up. Learn more about features. Use Cases Real-time \"click\" analytics Anomaly detection Fraud detection Operational (including IoT) analytics Screenshot Example Documentation Read in order: Beginner: Quick start Concepts Sources Processors Sinks Examples Intermediate: Handlers Git usage Expression syntax Garbage collection Scaling Command line Kubectl Events interop Workflow interop Meta-data Idempotence Advanced Configuration Features Limitations Reliability Metrics Image contract Jaeger tracing Reading material Security Dataflow vs X Contributing Architecture Diagram","default_branch":null,"files":null,"tree":[],"storefront":"/r/argoproj-labs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/argoproj-labs/old-argo-dataflow/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}