{"repo":"worldbank/OvertureLink-Data-Pipeline","free":true,"listed":false,"github":"https://github.com/worldbank/OvertureLink-Data-Pipeline","clone":"git clone https://github.com/worldbank/OvertureLink-Data-Pipeline.git","description":"This ETL pipeline allows you to query and extract Overture Maps data (such as roads, buildings) to upload to ArcGIS Online, download as different file types for any GIS software, or save as a local dump for continual use.","language":"Python","stars":14,"topics":["data-engineering","gis-data","global","overturemaps","worldbank"],"license":"MPL-2.0","category":"data-pipelines","readme_excerpt":"OvertureLink Flexible Overture data ingestion for AGOL and export workflows Purpose Choose your Overture query, specify the country, then you're done! This ETL pipeline allows you to query and extract Overture Maps data (such as roads, buildings) to upload to ArcGIS Online, download as different file types for any GIS software, or save as a local dump for continual use. This pipeline supports 176 countries worldwide with its country/ISO database, allows you to use pre-built queries or your own custom queries, and is designed to align with Overture's monthly releases. This pipeline was originally built to support the World Bank's distributed data across ArcGIS Hubs, but should work for other work flows. Commands There are three main commands when using this pipeline. - overture-dump - This command caches Overture dumps with a local caching system, which is useful for multiple country uploads. - arcgis-upload - Publish processed data to ArcGIS Online feature layers as a one off. - export - Export data to GeoJSON, GeoPackage, or File Geodatabase formats without uploading to ArcGIS Online. This is useful if you just need to grab specific queried data from Overture. Key Features - Automatic AGOL discovery: The pipeline will either create a new feature layer or use truncate and append based on whether or not a feature layer already exists. - Online and cache query: Query from Overture directly, or download a dump for consecutive uses. - Large files can be run in batch mode to assis","default_branch":null,"files":null,"tree":[],"storefront":"/r/worldbank","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/worldbank/OvertureLink-Data-Pipeline/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}