{"repo":"konturio/geocint-runner","free":true,"listed":false,"github":"https://github.com/konturio/geocint-runner","clone":"git clone https://github.com/konturio/geocint-runner.git","description":"Kontur's open source geodata ETL/CI/CD pipeline designed for ease of maintenance and high single-node throughput.","language":"Shell","stars":20,"topics":["postgresql","parallel","etl-framework","openstreetmap"],"license":"MIT","category":"databases-storage","readme_excerpt":"geocint-runner geocint processing pipeline Geocint is Kontur's open source geodata ETL/CI/CD pipeline designed for ease of maintenance and high single-node throughput. Writing the code as Geocint target makes sure that it is fully recorded, can be run autonomously, can be inspected, reviewed and tested by other team members, and will automatically produce new artifacts once new input data comes in. Geocint structure: Geocint consists of 3 different parts: - geocint-runner - a core part of the pipeline, includes utilities and initial Makefile - geocint-openstreetmap - a chain of targets for downloading, updating and uploading to database OpenStreetMap planet dump - [geocint-private] any repository that contains your additional functionality Technology stack: - A high-performance computer. OS: the latest Ubuntu version (not necessarily LTS). - Bash (Linux shell) is used for scripting one-liners that get data into the database for further processing or get data out of the database for deployment. https://tldp.org/LDP/abs/html/ - GNU Make is used as job server. We do not use advanced features like variables and wildcards, using simple explicit \"file-depends-on-file\" mode. Make takes care of running different jobs concurrently whenever possible. https://makefiletutorial.com/ - make-profiler is used as linter and preprocessor for Make that outputs a network diagram of what is getting built when and why. The output chart allows to see what went wrong and quickly get to logs. https:/","default_branch":null,"files":null,"tree":[],"storefront":"/r/konturio","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/konturio/geocint-runner/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}