{"repo":"DataSQRL/sqrl","free":true,"listed":false,"github":"https://github.com/DataSQRL/sqrl","clone":"git clone https://github.com/DataSQRL/sqrl.git","description":"Agentic Data Engineering Harness for building data pipelines, data products, data APIs, and data lakes autonomously","language":"Java","stars":221,"topics":["streaming","data-pipeline","api","event-driven","data-engineering","harness","harness-framework"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"DataSQRL: Agentic Data Engineering Harness DataSQRL is an open-source data engineering harness that provides guardrails and feedback for AI coding agents to build reliable data pipelines, data APIs, and data products. DataSQRL ensures coding agents meet the non-functional requirements of production data systems for data quality, scalability, governance, and reliability. DataSQRL provides deep-inspection of SQL, relational validators, and deterministic event-replay simulation to ensure agent-generated code meets these requirements through iterative feedback loops. Key Capabilities DataSQRL provides three capabilities that coding agents need to produce production-grade data systems: 1. Conceptual Framework : A SQL-based logical layer grounded in relational algebra and stream processing, with a physical layer that maps to execution engines. Gives agents a precise vocabulary for reasoning about data transformations. 2. Comprehensive Validation : Verification at every level across syntax, schema, data flow semantics, physical plans, and deployment assets, with actionable error messages that guide agents toward correct solutions. 3. Real-World Feedback : A simulator for local testing with timestamp-accurate replay, plus production telemetry hooks that correlate runtime behavior back to source code for autonomous troubleshooting. DataSQRL compiles SQL scripts into deployment artifacts for PostgreSQL, Apache Kafka, Apache Flink, and Apache Iceberg—running on your existing infrastruct","default_branch":null,"files":null,"tree":[],"storefront":"/r/DataSQRL","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/DataSQRL/sqrl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}