{"repo":"networktocode/diffsync","free":true,"listed":false,"github":"https://github.com/networktocode/diffsync","clone":"git clone https://github.com/networktocode/diffsync.git","description":"A utility library for comparing and synchronizing different datasets.","language":"Python","stars":188,"topics":["source-of-truth","synchronization","diffsync","data-synchronization","python","etl","extract-transform-load"],"license":null,"category":"data-pipelines","readme_excerpt":"DiffSync DiffSync is a utility library that can be used to compare and synchronize different datasets. For example, it can be used to compare a list of devices from 2 inventory systems and, if required, synchronize them in either direction. Primary Use Cases DiffSync is at its most useful when you have multiple sources or sets of data to compare and/or synchronize, and especially if any of the following are true: - If you need to repeatedly compare or synchronize the data sets as one or both change over time. - If you need to account for not only the creation of new records, but also changes to and deletion of existing records as well. - If various types of data in your data set naturally form a tree-like or parent-child relationship with other data. - If the different data sets have some attributes in common and other attributes that are exclusive to one or the other. Overview of DiffSync DiffSync acts as an intermediate translation layer between all of the data sets you are diffing and/or syncing. In practical terms, this means that to use DiffSync, you will define a set of data models as well as the “adapters” needed to translate between each base data source and the data model. In Python terms, the adapters will be subclasses of the Adapter class, and each data model class will be a subclass of the DiffSyncModel class. Once you have used each adapter to load each data source into a collection of data model records, you can then ask DiffSync to “diff” the two data sets, an","default_branch":null,"files":null,"tree":[],"storefront":"/r/networktocode","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/networktocode/diffsync/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}