{"repo":"PastorGL/datacooker-etl","free":true,"listed":false,"github":"https://github.com/PastorGL/datacooker-etl","clone":"git clone https://github.com/PastorGL/datacooker-etl.git","description":"ETL processing toolset with SQL-like language and GIS capabilities, built on core Spark. Extensible and modular. REPL included","language":"Java","stars":16,"topics":["etl","sql","apache-spark","columnar-format","data-transformation","geospatial","geospatial-data","gis","schema-less","etl-tool"],"license":null,"category":"data-pipelines","readme_excerpt":"About this project Data Cooker is a batch and interactive ETL processor that provides simple yet powerful dialect of SQL (as well as JSON configs) to perform transformations of Columnar and/or Structured data, which doesn't require strict schema nor data catalog. Built on Apache Spark core with minimal dependencies. Historically it was used in a GIS project, so it has geospatial extensions to its type system, and has been extensively tested and proven reliable by years and petabytes of transformed data in production. Your contributions are welcome. Official GitHub repo is at https://github.com/PastorGL/datacooker-etl Goals Provide first class ETL processing with simple, human-friendly, highly imperative SQL. No Python nor Scala code required. Run not only on the Spark cluster, but as a local standalone application too. Be callable from any CI/CD or scheduler. Require no schema . Require no data catalog . Every field could be defined if needed ad hoc and in place, all data types are inferred by default, and can be explicitly cast if necessary. Provide batch processing for production, interactive debugging for development. Provide a rich REPL with remote connection support. Provide base external storage adapters out of the box. Support extensibility via Java API. Keep framework core as small as possible, and write as less code as possible. Allow white-labeling for customized distributions. Provide a companion tool with machine-friendly JSON configurations. What Data Cooker is N","default_branch":null,"files":null,"tree":[],"storefront":"/r/PastorGL","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/PastorGL/datacooker-etl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}