{"repo":"toluaina/pgsync","free":true,"listed":false,"github":"https://github.com/toluaina/pgsync","clone":"git clone https://github.com/toluaina/pgsync.git","description":"Postgres, MySQL, or MariaDB to Elasticsearch/OpenSearch sync","language":"Python","stars":1414,"topics":["elasticsearch","elasticsearch-sync","postgresql","change-data-capture","sql","opensearch","python","etl","kibana","mariadb"],"license":"MIT","category":"databases-storage","readme_excerpt":"PGSync Real-time PostgreSQL to Elasticsearch/OpenSearch sync Keep your relational database as the source of truth while powering lightning-fast search Live Demo ↗ · Website · Documentation · Examples · Report Bug --- What is PGSync? PGSync is a change data capture tool that syncs data from PostgreSQL , MySQL , or MariaDB to Elasticsearch or OpenSearch in real-time. Define your document structure in JSON, and PGSync handles the rest — no custom code required. Django integration: Use django-pgsync to integrate PGSync with Django projects. PGSync Pro: Add real-time semantic and hybrid search to Elasticsearch or OpenSearch, with on-device or hosted embeddings that re-embed only when a document's meaning changes. ClickHouse connector: Stream PostgreSQL to ClickHouse in real time with pgsync-clickhouse, a change-data-capture sink that mirrors tables or builds denormalized wide tables on ReplacingMergeTree (one-to-one children flattened into typed columns, one-to-many into native Array(Tuple(...)) ), with exactly-once-on-replay keyed on the source WAL LSN. Key Features Feature Description --------- ------------- Real-time sync Changes propagate instantly via logical replication Zero code Define mappings in JSON — no ETL pipelines to build Nested documents Automatically denormalize complex relationships Fault tolerant Resumes from checkpoints after crashes Transactionally consistent Documents appear in commit order Minimal overhead Lightweight CDC with negligible database impact --- ","default_branch":null,"files":null,"tree":[],"storefront":"/r/toluaina","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/toluaina/pgsync/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}