{"repo":"netwerk-digitaal-erfgoed/ld-workbench","free":true,"listed":false,"github":"https://github.com/netwerk-digitaal-erfgoed/ld-workbench","clone":"git clone https://github.com/netwerk-digitaal-erfgoed/ld-workbench.git","description":"A CLI tool for transforming large RDF datasets using pure SPARQL","language":"TypeScript","stars":10,"topics":["etl","etl-pipeline","linked-open-data","lod","sparql"],"license":"EUPL-1.2","category":"data-pipelines","readme_excerpt":"LD Workbench LD Workbench is a command-line tool for transforming large RDF datasets using pure SPARQL. [!NOTE] Although LD Workbench is stable, we consider it a proof of concept. Please use the software and report any issues you encounter. Approach Components Users define LD Workbench pipelines . An LD Workbench pipeline reads data from SPARQL endpoints, transforms it using SPARQL queries, and writes the result to a file or triple store. A pipeline consists of one or more stages . Each stage has: - an iterator , which selects URIs from a dataset using a paginated SPARQL SELECT query, binding each URI to a $this variable - one or more generators , which generate triples about each URI using SPARQL CONSTRUCT queries. Stages can be chained together, with the output of one stage becoming the input of the next. The output of each stage combined becomes the final output of the pipeline. Design principles The main design principes are scalability and extensibility. LD Workbench is scalable due to its iterator/generator approach, which separates the selection of URIs from the generation of triples. LD Workbench is extensible because it uses pure SPARQL queries (instead of code or a DSL) for configuring transformation pipelines. The SPARQL query language is a widely supported W3C standard, so users will not be locked into a proprietary tool or technology. Usage To get started with LD Workbench, you can either use the NPM package or a Docker image. Node To use the NPM package, install","default_branch":null,"files":null,"tree":[],"storefront":"/r/netwerk-digitaal-erfgoed","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/netwerk-digitaal-erfgoed/ld-workbench/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}