{"repo":"backtrace-labs/verneuil","free":true,"listed":false,"github":"https://github.com/backtrace-labs/verneuil","clone":"git clone https://github.com/backtrace-labs/verneuil.git","description":"Verneuil is a VFS extension for SQLite that asynchronously replicates databases to S3-compatible blob stores.","language":"C","stars":524,"topics":["s3","sqlite"],"license":"MIT","category":"databases-storage","readme_excerpt":"Verneuil: streaming replication for SQLite ========================================== Verneuil[^verneuil-process] [[vɛʁnœj]](https://en.wikipedia.org/wiki/Auguste Victor Louis Verneuil) is a VFS (OS abstraction layer) for SQLite that accesses local database files like the default unix VFS while asynchronously replicating snapshots to S3-compatible blob stores. We wrote it to improve the scalability and availability of pre-existing services for which SQLite is a good fit, at least for single-node deployments. Backtrace relies on Verneuil to backup and replicate thousands of SQLite databases that range in size from 100KB to a few gigabytes, some of which see updates every second... for less than $40/day in S3 costs. It has been tested on linux/amd64, linux/aarch64 (little endian), and darwin/aarch64. The sqlite file format and the Verneuil replication data are all platform agnostic. [^verneuil-process]: The Verneuil process was the first commercial method of manufacturing synthetic gemstones... and DRH insists on pronouncing SQLite like a mineral, surely a precious one (: The primary design goal of Verneuil is to add asynchronous read replication to working single-node systems without introducing new catastrophic failure modes. Avoiding new failure modes takes precedence over all other considerations, including replication lag: there is no attempt to bound or minimise the staleness of read replicas. Verneuil read replicas should only be used when stale data is acceptable. In ke","default_branch":null,"files":null,"tree":[],"storefront":"/r/backtrace-labs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/backtrace-labs/verneuil/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}