{"repo":"ModelEngine-Group/DataMate","free":true,"listed":false,"github":"https://github.com/ModelEngine-Group/DataMate","clone":"git clone https://github.com/ModelEngine-Group/DataMate.git","description":"DataMate is an enterprise-level data processing platform designed for model fine-tuning and RAG retrieval.","language":"TypeScript","stars":366,"topics":["data-pipeline","rag","data-evaluation","data-synthesis"],"license":"MIT","category":"data-pipelines","readme_excerpt":"DataMate All-in-One Data Work Platform DataMate is an enterprise-level data processing platform for model fine-tuning and RAG retrieval, supporting core functions such as data collection, data management, operator marketplace, data cleaning, data synthesis, data annotation, data evaluation, and knowledge generation. 简体中文 English If you like this project, please give it a Star⭐️! 🌟 Core Features - Core Modules : Data Collection, Data Management, Operator Marketplace, Data Cleaning, Data Synthesis, Data Annotation, Data Evaluation, Knowledge Generation. - Visual Orchestration : Drag-and-drop data processing workflow design. - Operator Ecosystem : Rich built-in operators and support for custom operators. 🚀 Quick Start Prerequisites - Git (for pulling source code) - Make (for building and installing) - Docker (for building images and deploying services) - Docker-Compose (for service deployment - Docker method) - Kubernetes (for service deployment - k8s method) - Helm (for service deployment - k8s method) - K8s deployment additionally requires : Sealed Secrets Controller (for encrypted secret management) Secret Management (K8s deployment only) DataMate K8s deployment uses Bitnami Sealed Secrets to manage sensitive configuration such as database passwords and JWT secrets. All secrets are stored in encrypted form in Git ( deployment/kubernetes/sealed-secrets/ ) and automatically decrypted by the Sealed Secrets Controller in the cluster at deploy time. Online environment - install ","default_branch":null,"files":null,"tree":[],"storefront":"/r/ModelEngine-Group","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ModelEngine-Group/DataMate/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}