{"repo":"ertis-research/kafka-ml","free":true,"listed":false,"github":"https://github.com/ertis-research/kafka-ml","clone":"git clone https://github.com/ertis-research/kafka-ml.git","description":"Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow and PyTorch!)","language":"Python","stars":206,"topics":["kafka","machine-learning","kubernetes","tensorflow","docker","data-stream","iot","keras-tensorflow","gpu-acceleration","deep-learning"],"license":"MIT","category":"machine-learning","readme_excerpt":"Kafka-ML: connecting the data stream with ML/AI frameworks Kafka-ML is a framework to manage the pipeline of Tensorflow/Keras and PyTorch (Ignite) machine learning (ML) models on Kubernetes. The pipeline allows the design, training, and inference of ML models. The training and inference datasets for the ML models can be fed through Apache Kafka, thus they can be directly connected to data streams like the ones provided by the IoT. ML models can be easily defined in the Web UI with no need for external libraries and executions, providing an accessible tool for both experts and non-experts on ML/AI. You can find more information about Kafka-ML and its architecture in the open-access publication below: C. Martín, P. Langendoerfer, P. Zarrin, M. Díaz and B. Rubio Kafka-ML: connecting the data stream with ML/AI frameworks Future Generation Computer Systems, 2022, vol. 126, p. 15-33 10.1016/j.future.2021.07.037 If you wish to reuse Kafka-ML, please properly cite the above mentioned paper. Below you can find a BibTex reference: Kafka-ML article has been selected as Spring 2022 Editor’s Choice Paper at Future Generation Computer Systems! :blush: :book: :rocket: Table of Contents - Changelog - Deploy Kafka-ML in a fast way - Requirements - Steps to run Kafka-ML - Troubleshooting - Usage - Single models - Distributed models - Semi-supervised learning - Incremental training - Federated learning - Installation and development - Requirements to build locally - Steps to build Kafka-ML - GP","default_branch":null,"files":null,"tree":[],"storefront":"/r/ertis-research","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ertis-research/kafka-ml/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}