{"repo":"jin06/binlogo","free":true,"listed":false,"github":"https://github.com/jin06/binlogo","clone":"git clone https://github.com/jin06/binlogo.git","description":"Distributed、High availability、Simplicity、Visualized. Base on mysql binlog , process binlog into understandable message and send to kafka etc","language":"Go","stars":393,"topics":["mysql","binlog","golang","golang-application","canal"],"license":"MIT","category":"databases-storage","readme_excerpt":"Binlogo ===================================== Binlogo is the distributed, visualized application based on MySQL binlog. In short, binlogo is to process the data changes of MySQL into easily understand messages and output to different systems according to the user's configuration. Here are part of advantages: Distributed, multi node improves availability of the whole system. Visualization, can complete common operations and observe the status of the whole cluster in the control website It can be output to multiple queues or other applications, and new outputs are constantly added Get Started Install redis. Binlogo V2 relies on redis, so you must install redis first. Install binlogo. Binlogo's download address: Download Address Message Format： Data format of binlogo output Start binlogo. Edit config. ${binlogo-path}/etc/binlogo.yaml # ./binlogo server --config ./etc/binlogo.yaml Open up your browser to http://127.0.0.1:8081/console to view the console website Create Pipeline: config.go Follow the steps. Run pipeline. Click button to run the pipeline instance. Operation condition. You can see the operation condition of pipeline. See the output Insert some into mysql, watch the ouput on stdout. Configuration output to Kafka High performance, possible data loss. acks=1 enable.idempotence=false compression.type=snappy retries=0 For reliability performance: acks=-1 enable.idempotence=true retries=3 or larger one Docker Docker Hub # docker pull jin06/binlogo # docker run -e REDIS ADD","default_branch":null,"files":null,"tree":[],"storefront":"/r/jin06","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/jin06/binlogo/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}