{"repo":"conduktor/kafka-connect-wikimedia","free":true,"listed":false,"github":"https://github.com/conduktor/kafka-connect-wikimedia","clone":"git clone https://github.com/conduktor/kafka-connect-wikimedia.git","description":"Kafka Connect Source connector for Wikimedia EventStreams","language":"Java","stars":55,"topics":["kafka","kafka-connect","streaming","wikimedia"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Kafka Connect Wikimedia A Kafka Connect Source connector that streams real-time events from Wikimedia's EventStreams into Kafka topics. Features - Streams Wikimedia recent changes (edits, new pages, etc.) in real-time - Configurable reconnection handling - Custom User-Agent header support (required by Wikimedia API) - Dead letter queue support for error handling Installation Download the JAR from Releases and place it in your Kafka Connect plugins directory. Configuration Property Required Default Description ---------- ---------- --------- ------------- topic Yes - Kafka topic to publish events to url Yes - Wikimedia EventStream URL reconnect.duration No 3000 Reconnection delay in milliseconds http.headers.user.agent No WikimediaKafkaConnector/1.0 User-Agent header for HTTP requests Example Configuration See connector/wikimedia.properties for a complete example. Building from Source Requires Java 11+. Output: build/libs/kafka-connect-wikimedia- -all.jar Local Development A Docker Compose setup is provided for local testing. Quick Start Endpoints Service URL --------- ----- Kafka (external) localhost:9092 Kafka Connect REST API http://localhost:8083 Related Resources - Awesome Kafka Connect - Curated list of Kafka Connect connectors - Wikimedia EventStreams - Documentation License Apache License 2.0 --- Built by Conduktor - Making Kafka accessible to everyone.","default_branch":null,"files":null,"tree":[],"storefront":"/r/conduktor","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/conduktor/kafka-connect-wikimedia/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}