{"repo":"vuhuusy/data-lakehouse-platform","free":true,"listed":false,"github":"https://github.com/vuhuusy/data-lakehouse-platform","clone":"git clone https://github.com/vuhuusy/data-lakehouse-platform.git","description":"Scalable real-time fraud detection platform built on modern Data Lakehouse architecture","language":"Python","stars":10,"topics":["airflow","big-data","data-platform","devops","flink","fraud-detection","kafka","kubernetes","lakehouse","mlflow"],"license":"Apache-2.0","category":"deployment-docker-iac","readme_excerpt":"Scalable Real-time Fraud Detection Engine Built on Lakehouse Architecture Table of Contents - Scalable Real-time Fraud Detection Engine Built on Lakehouse Architecture - Table of Contents - 1. Overview - 2. Installation - 2.1 Install Ansible and Prepare Environment - 2.2 Run Rancher with Docker - 2.3 Create and Configure RKE2 Cluster - Create a new Kubernetes cluster in Rancher UI: - Select node roles in the Registration step - Register nodes with Ansible - Set up kubeconfig on your Rancher host - (Optional) Set useful kubectl aliases - 2.4 Install Prometheus Operator - 2.5 Install Longhorn - 2.6 Install Minio - 2.7 Install Airflow - 2.8 Install Kafka - 2.9 Install Spark Operator - 2.10 Install Flink Operator - 2.11 Install Hive Metastore - 2.12 Install sources - 2.13 Install Kafka Connect - 2.14 Install Trino - 2.15 Install Superset - 2.16 Install MLFlow - 2.17 Install Feast - 2.18 Install Datahub - 3. Run Applications - 4. License 1. Overview This project demonstrates a scalable real-time fraud detection system built on a modern Data Lakehouse architecture. It integrates batch and streaming data pipelines using open-source Big Data technologies such as Apache Flink, Kafka, Spark, Delta Lake, and MLflow. The system is designed for low-latency inference, feature enrichment, and end-to-end observability, supporting both operational analytics and machine learning in production environments. 2. Installation 2.1 Install Ansible and Prepare Environment Install Ansible on your Ranc","default_branch":null,"files":null,"tree":[],"storefront":"/r/vuhuusy","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vuhuusy/data-lakehouse-platform/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}