{"repo":"patterns-app/patterns-devkit","free":true,"listed":false,"github":"https://github.com/patterns-app/patterns-devkit","clone":"git clone https://github.com/patterns-app/patterns-devkit.git","description":"Data pipelines from re-usable components","language":"Python","stars":107,"topics":["data-science","data-analysis","pipelines","etl","etl-pipeline","etl-framework","functional-reactive-programming","data-engineering","sql","immutability"],"license":"BSD-3-Clause","category":"data-pipelines","readme_excerpt":"    Patterns - Build data systems from re-usable sql and python components --- What is the Patterns Devkit? The Patterns Devkit is a CLI and lightweight SDK to build, version, and deploy data graphs made of reusable SQL and Python nodes. It helps you: - Scaffold apps (graphs) and nodes quickly - Define connections between nodes and storage tables in graph.yml - Manage secrets and configuration - Upload, list, and trigger runs in the Patterns platform Documentation: https://www.patterns.app/docs/devkit Features - Create graphs and nodes ( python , sql , subgraphs) from the CLI - Describe graph topology declaratively in graph.yml - Write nodes using patterns.Table , patterns.Parameter , and patterns.State - Manage secrets, auth, and uploads to the Patterns platform - Trigger and inspect graphs remotely Installation pip install patterns-devkit Quickstart: Build a Leads Ingestion and Scoring Graph 1) Create an app (graph) This creates: 2) Add two Python nodes This adds: 3) Wire the graph in graph.yml Open graph.yml and connect node inputs/outputs to tables: 4) Implement the nodes ingest leads.py (writes raw leads): score leads.py (reads raw leads, writes scored leads): 5) Visualize the example graph topology 6) Authenticate and upload - Sign up or sign in at https://studio.patterns.app - Authenticate the CLI: - Upload your graph: 7) Trigger runs Command overview - patterns create app : scaffold a new app directory with graph.yml - patterns create node : add a function n","default_branch":null,"files":null,"tree":[],"storefront":"/r/patterns-app","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/patterns-app/patterns-devkit/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}