{"repo":"opensanctions/nomenklatura","free":true,"listed":false,"github":"https://github.com/opensanctions/nomenklatura","clone":"git clone https://github.com/opensanctions/nomenklatura.git","description":"Framework and command-line tools for integrating FollowTheMoney data streams from multiple sources","language":"Python","stars":260,"topics":["data-integration","deduplication","record-link"],"license":"MIT","category":"data-pipelines","readme_excerpt":"nomenklatura Nomenklatura de-duplicates and integrates different Follow the Money entities. It serves to clean up messy data and to find links between different datasets. Usage You can install nomenklatura via PyPI: Command-line usage Much of the functionality of nomenklatura can be used as a command-line tool. In the following example, we'll assume that you have a file containing Follow the Money entities in your local directory, named entities.ijson . If you just want try it out, you can use the file tests/fixtures/donations.ijson in this repository for testing (it contains German campaign finance data). With the file in place, you will cross-reference the entities to generate de-duplication candidates, then run the interactive de-duplication UI in your console, and eventually apply the judgements to generate a new file with merged entities: The resolver graph database location can be customised by setting the environment variable NOMENKLATURA DB URL Programmatic usage The command-line use of nomenklatura is targeted at small datasets which need to be de-duplicated. For more involved scenarios, the package also offers a Python API which can be used to control the semantics of de-duplication. nomenklatura.Dataset - implements a basic dataset for describing a set of entities. nomenklatura.Store - a general purpose access mechanism for entities. By default, a store is used to access entity data stored in files as an in-memory cache, but the store can be subclassed to work with","default_branch":null,"files":null,"tree":[],"storefront":"/r/opensanctions","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/opensanctions/nomenklatura/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}