{"repo":"Trendyol/go-dcp-elasticsearch","free":true,"listed":false,"github":"https://github.com/Trendyol/go-dcp-elasticsearch","clone":"git clone https://github.com/Trendyol/go-dcp-elasticsearch.git","description":"The Go implementation of the Couchbase to Elasticsearch with DCP.","language":"Go","stars":83,"topics":["couchbase","dcp","elasticsearch","go","golang","elasticsearch-connect-couchbase"],"license":"MIT","category":"databases-storage","readme_excerpt":"Go Dcp Elasticsearch Go implementation of the Elasticsearch Connect Couchbase. Go Dcp Elasticsearch streams documents from Couchbase Database Change Protocol (DCP) and writes to Elasticsearch index in near real-time. You can find more information by looking at our docs. Features Less resource usage and higher throughput (see Benchmarks). Custom routing support(see Example). Update multiple documents for a DCP event(see Example). Handling different DCP events such as expiration, deletion and mutation (see Example). Elasticsearch compression request body support. Managing batch configurations such as maximum batch size, batch bytes, batch ticker durations. Scale up and down by custom membership algorithms(Couchbase, KubernetesHa, Kubernetes StatefulSet or Static, see examples). Multiple Elasticsearch clusters — route actions via ClusterKey (see Multiple Elasticsearch clusters). Easily manageable configurations . Benchmarks The benchmark was made with the 1,001,006 Couchbase document, because it is possible to more clearly observe the difference in the batch structure between the two packages. Default configurations for Java Elasticsearch Connect Couchbase used for both connectors. Package Time to Process Events Elasticsearch Indexing Rate(/s) Average CPU Usage(Core) Average Memory Usage :-------------------------------------------- :----------------------: :-------------------------------: :-----------------------: :--------------------: Go Dcp Elasticsearch (Go 1.20) 50s 0.486","default_branch":null,"files":null,"tree":[],"storefront":"/r/Trendyol","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Trendyol/go-dcp-elasticsearch/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}