{"repo":"nshkrdotcom/flowstone","free":true,"listed":false,"github":"https://github.com/nshkrdotcom/flowstone","clone":"git clone https://github.com/nshkrdotcom/flowstone.git","description":"Asset-first data orchestration for Elixir/BEAM. Dagster-inspired with OTP fault tolerance, LiveView dashboard, lineage tracking, checkpoint gates, and distributed execution via Oban.","language":"Elixir","stars":31,"topics":["asset-management","beam","chaos-engineering","dag","data-lineage","data-orchestration","data-pipeline","ecto","elixir","fault-tolerance"],"license":"MIT","category":"data-pipelines","readme_excerpt":"FlowStone Asset-first data orchestration for the BEAM. FlowStone is an orchestration library for Elixir that treats assets (named data artifacts) as the primary abstraction. It's designed for building reliable, auditable data pipelines where persistence, lineage tracking, and operational visibility matter. Quick Start v0.5.2 adds maintenance and resilience improvements, building on the HTTP client from v0.5.1: No explicit registration, no server configuration needed. FlowStone auto-registers pipelines and uses in-memory storage by default. Installation Add to your mix.exs : When to Use FlowStone FlowStone is the right choice when you need: Use Case Why FlowStone ---------- --------------- ETL/ELT pipelines Partition-aware materialization, dependency tracking Data warehouse orchestration Scheduled jobs, backfill support, lineage queries Audit-sensitive workflows Comprehensive audit logging, approval gates Durable job execution Oban-backed persistence, jobs survive restarts Multi-format data storage Pluggable I/O managers (PostgreSQL, S3, Parquet) Ideal Workloads - Daily/hourly batch processing with date-partitioned data - Data transformation pipelines with explicit dependencies - Workflows requiring human approval checkpoints - Systems where \"what produced this data?\" matters (lineage) - Long-running jobs that must not be lost on node failure When to Use Something Else FlowStone is not the best fit for: Use Case Better Alternative ---------- ------------------- Real-time distr","default_branch":null,"files":null,"tree":[],"storefront":"/r/nshkrdotcom","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/nshkrdotcom/flowstone/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}