{"repo":"geopython/stetl","free":true,"listed":false,"github":"https://github.com/geopython/stetl","clone":"git clone https://github.com/geopython/stetl.git","description":"Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.","language":"Python","stars":88,"topics":["etl-framework","transformations","streaming-etl","python","gml","gis","osgeo","data-conversion","etl","inspire"],"license":"GPL-3.0","category":"data-pipelines","readme_excerpt":"Stetl - Streaming ETL Stetl, streaming ETL, pronounced \"staedl\", is a lightweight ETL-framework for geospatial data conversion. Notice: the Stetl GH repo is now at the GeoPython GH organization. License Stetl is released under a GNU GPL v3 license (see LICENSE.txt). Documentation The Stetl website and documentation can be found via http://stetl.org. For a quick overview read the 5-minute Stetl-introduction, or a more detailed presentation. Stetl was presented at several events like the FOSS4G 2013 in Nottingham and GeoPython 2016. Concepts Stetl basically glues together existing parsing and transformation tools like GDAL/OGR, Jinja2 and XSLT with custom Python code. By using native libraries like libxml2 and libxslt (via Python lxml ) Stetl is speed-optimized. A configuration file, in Python config .ini format, specifies a chained sequence of transformation steps: typically an Input connected to one or more Filters , and finally to an Output . At runtime, this sequence is instantiated and run as a linked series of Python objects. These objects are symbolically specified (by their module/class name) and parameterized in the config file. Via the stetl -c command, the transformation is executed. Stetl has been proven to handle 10's of millions of GML objects without any memory issues. This is achieved through a technique called \"streaming and splitting\". For example: using the OgrPostgisInput module an GML stream can be generated from the database. A component called the GmlSpli","default_branch":null,"files":null,"tree":[],"storefront":"/r/geopython","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/geopython/stetl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}