{"repo":"Smart-Shaped/chaM3Leon","free":true,"listed":false,"github":"https://github.com/Smart-Shaped/chaM3Leon","clone":"git clone https://github.com/Smart-Shaped/chaM3Leon.git","description":"By Smart Shaped s.r.l. (https://www.smartshaped.com/)","language":"Java","stars":29,"topics":["apache-kafka","apache-sedona","apache-spark","big-data","data-engineering","data-pipeline","data-preprocessing","data-processing","hadoop-hdfs","java"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"chaM3Leon: A Modular Framework for Big Data and ML Applications New to chaM3Leon? Start with our Executive Summary for a quick overview, or dive into the Value Proposition to understand why chaM3Leon is the right choice for your Big Data projects. A modular and scalable framework based on Java, Python and Apache Spark, designed to support machine learning applications. ChaM3Leon emphasizes transparency, interoperability, and usability. It implements a custom Lambda Architecture for parallel real-time (Speed Layer) and batch (Batch Layer) data processing. This design ensures both data completeness (via HDFS) and low-latency analysis (via Cassandra), providing a resilient platform for Big Data and MLOps. ChaM3Leon emphasizes transparency, interoperability, and usability by leveraging: - Apache Kafka for high-throughput, decoupled data ingestion. - Apache Spark across all processing layers (Batch, Speed, Harvester) for scalable computation. - Cassandra for storing and unifying historical and real-time analytical results. - MLflow within the ML Runner component for seamless ML model serving and lifecycle management. - A Spring Boot-based Serving Layer for exposing clean, unified analytical APIs. The ChaM3Leon architecture is illustrated in the following image, highlighting the connections between layers: --- Complete Documentation For comprehensive guides, tutorials, and detailed explanations, visit our Documentation Hub which includes: - Executive Summary - Quick overview for de","default_branch":null,"files":null,"tree":[],"storefront":"/r/Smart-Shaped","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Smart-Shaped/chaM3Leon/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}