{"repo":"iesahin/xvc","free":true,"listed":false,"github":"https://github.com/iesahin/xvc","clone":"git clone https://github.com/iesahin/xvc.git","description":"A robust (🐢) and fast (🐇) MLOps tool for managing data and pipelines in Rust (🦀)","language":"Rust","stars":76,"topics":["command-line-tool","data","data-engineering","data-pipelines","data-science","devops","machine-learning","machine-learning-engineering","mlops","rust"],"license":"GPL-3.0","category":"data-pipelines","readme_excerpt":"xvc Manage your data next to code in Git repositories and run commands when they change. ⌛ Why Xvc? - You have image, audio, media, document or asset files to [track/version/backup][xvc-file-track] along with the code, but [don't want to copy][xvc-file-recheck] that huge data to all Git clones. - You want to [manage][xvc-file-list] files in multiple locations with [different subsets][xvc-file-copy], some (e.g. training data) being read-only and some (e.g. models, executables) change frequently, all versioned along with the code. - You want to [store][xvc-s-n] this data in [S3-compatible cloud storages][xvc-s-n-s3] or [local][xvc-s-n-local] directories, or your preconfigured [Rsync][xvc-s-n-rsync] and [Rclone][xvc-s-n-rclone] remotes to share with the repository. - You want to [specify commands][xvc-p-s-n] that [run][xvc-p-r] when only input data changes, define [pipelines][xvc-p-n] with steps that run when only their [dependencies][xvc-p-s-d] change. - You want to define these dependencies with [files][xvc-p-s-d-file], [globs][xvc-p-s-d-glob] spanning multiple files, text file lines defined by [ranges][xvc-p-s-d-line] or [regexes][xvc-p-s-d-line], [URLs][xvc-p-s-d-url], [parameters][xvc-p-s-d-params] in the YAML or JSON files, [SQLite queries][xvc-p-s-d-sqlite] or [any command][xvc-p-s-d-generic] that produces output. 🔽 Installation You can get the binary files for Linux, macOS, and Windows from [releases] page. Extract and copy the file to your $PATH . Alternatively, if you","default_branch":null,"files":null,"tree":[],"storefront":"/r/iesahin","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/iesahin/xvc/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}