{"repo":"FareedKhan-dev/scalable-rag-pipeline","free":true,"listed":false,"github":"https://github.com/FareedKhan-dev/scalable-rag-pipeline","clone":"git clone https://github.com/FareedKhan-dev/scalable-rag-pipeline.git","description":"A scalable RAG platform combining LangGraph agents, hybrid retrieval (Vector+Graph), and Ray orchestration on Kubernetes.","language":"Python","stars":158,"topics":["ai-agents","aws","langchain","multi-agent-systems","python","rag-pipeline"],"license":"MIT","category":"ai-agents","readme_excerpt":"Enterprise Agentic RAG Platform Table of Contents 1. System Overview 2. RAG Methodologies & Agentic Logic 3. Prerequisites & Tooling 4. Phase 1: Infrastructure Initialization (Terraform) 5. Phase 2: Cluster Bootstrapping (Kubernetes) 6. Phase 3: The Data Plane (Ray & Databases) 7. Phase 4: The Control Plane (API Deployment) 8. Phase 5: Data Ingestion Pipeline 9. Validation & Testing 10. Cost Optimization & Scaling 11. Troubleshooting 1. System Overview This repository contains the source code and Infrastructure-as-Code (IaC) definitions for a production-grade Retrieval-Augmented Generation (RAG) system. Unlike standard RAG implementations, this platform utilizes an Agentic Architecture (via LangGraph) to perform multi-step reasoning, query expansion, and hybrid retrieval (Vector + Knowledge Graph). High-Level Architecture The system is decoupled into two primary processing planes: 1. Control Plane (The Brain): Handles HTTP requests, state management, agent orchestration, and business logic. Runs on low-cost CPU nodes. 2. Data Plane (The Muscle): Handles heavy compute tasks including LLM Inference, Embedding generation, and Graph Extraction. Runs on autoscaling GPU nodes via Ray . --- 2. RAG Methodologies & Agentic Logic This platform implements advanced RAG techniques to solve common failure modes (hallucination, retrieval misses). 2.1. The Planning Agent ( services/api/app/agents/ ) Instead of a linear chain, we use LangGraph to model the RAG process as a state machine. Plan","default_branch":null,"files":null,"tree":[],"storefront":"/r/FareedKhan-dev","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/FareedKhan-dev/scalable-rag-pipeline/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}