{"repo":"linkedin/Hoptimator","free":true,"listed":false,"github":"https://github.com/linkedin/Hoptimator","clone":"git clone https://github.com/linkedin/Hoptimator.git","description":"Multi-hop declarative data pipelines","language":"Java","stars":128,"topics":["brooklin","cdc","data-pipelines","flink","kafka","kafka-connect"],"license":"BSD-2-Clause","category":"data-pipelines","readme_excerpt":"Hoptimator A SQL control plane for multi-system data pipelines Hoptimator turns SQL into running, multi-hop data pipelines that span Kafka, Flink, Venice, and anything else you plug in. You declare what you want — a materialized view from one system into another — and Hoptimator plans the topology, generates the specs, deploys them, and reconciles them. What that statement becomes depends on the templates and databases registered in your environment. With a typical Kafka + Flink setup, it expands into: - a View and a Pipeline resource, - a connector configuration on each side, - a Flink SQL job that maintains the result, - and any intermediate hops (e.g. CDC topics) the planner determined were needed to get from sources to sink. Swap in different templates and the same SQL can target a different stack. The deployment target is pluggable — the bundled deployers target Kubernetes, but hoptimator-api is the actual extension point. Why Hoptimator? - One SQL surface across many systems. Kafka, Flink, Venice, MySQL — and pluggable for the rest. The catalog is unified; joins span systems. - Multi-hop, declarative. You don't write Flink jobs and you don't request topics. The planner figures out the topology from a query. - Kubernetes out of the box, not as a hard requirement. The bundled deployers target Kubernetes, so pipelines show up as first-class custom resources and kubectl get pipelines Just Works. The Deployer interface is the actual extension point — anything that knows how ","default_branch":null,"files":null,"tree":[],"storefront":"/r/linkedin","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/linkedin/Hoptimator/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}