{"repo":"datavane/datavines","free":true,"listed":false,"github":"https://github.com/datavane/datavines","clone":"git clone https://github.com/datavane/datavines.git","description":"Know your data better！Datavines is Next-gen Data Observability Platform, support metadata manage and data quality.","language":"Java","stars":757,"topics":["dataquality","datascience","doris","spark","dataobservability","dataprofile","metadata","cleandata","data-engineering","data-profilers"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Datavines --- Data quality is used to ensure the accuracy of data in the process of integration and processing. It is also the core component of DataOps. DataVines is an easy-to-use data quality service platform that supports multiple metric. Architecture Design Install Need: Maven 3.6.1 and later Metadata Database - The default datavines-server configuration uses PostgreSQL - Initialize a PostgreSQL metadata database with scripts/sql/datavines-postgresql.sql - If you want to run with MySQL , switch to the mysql Spring profile and initialize with scripts/sql/datavines-mysql.sql - The release package now contains both scripts in ${DATAVINES HOME}/scripts/ Features Data Catalog - Obtain data source metadata regularly to construct data directory - Regular monitoring of metadata changes - Tag management with support for metadata Data Quality - Built-in 27 data quality check rules - Support 4 data quality check rule types - Single Table-Column Check - Single Table Custom SQL check - Cross Table Accuracy Check - Two Table Value Comparison Check - Support schedule tasks for check - Support SLA for check result alert Data Profile - Support timing execution of data detection, output data profile report - Support automatically identify column types to automatically match appropriate data profile indicators - Support table row number trend monitoring - Support data distribution view Plug-in Design The platform is based on plug-in design, and the following modules support user-defined pl","default_branch":null,"files":null,"tree":[],"storefront":"/r/datavane","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/datavane/datavines/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}