{"repo":"Azure-Samples/AI-Gateway","free":true,"listed":false,"github":"https://github.com/Azure-Samples/AI-Gateway","clone":"git clone https://github.com/Azure-Samples/AI-Gateway.git","description":"Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀","language":"Jupyter Notebook","stars":975,"topics":["apimanagement","azure","openai","openai-api","genai","agents","autogen","foundry","mcp","mcp-server"],"license":"MIT","category":"ai-agents","readme_excerpt":"✨ AI Gateway Labs Explore the enterprise-grade gateway for managing AI Models, Tools, and Agents 📰 New! The AI Gateway Dev Portal is now live — A starting point for building your own developer portal on top of Azure API Management AI Gateway's. Fork it, open it in VS Code with GitHub Copilot (or any coding agent), and shape it to fit your needs! Why AI Gateway? Building production-ready AI applications requires more than just calling model APIs. You need security , reliability , observability , and cost control —without slowing down innovation. AI Gateway powered by Azure API Management provides: - 🔐 Security — OAuth 2.0, managed identities, content safety filtering - ⚡ Performance — Load balancing, semantic caching, request routing - 📊 Observability — Token metrics, built-in logging, tracing - 💰 Cost Control — Rate limiting, quota management, FinOps framework - 🔌 Extensibility — MCP protocol support, function calling, multi-model routing 📚 Explore the Labs 🔗 Browse all 30+ labs at aka.ms/ai-gateway/labs Each lab is a hands-on Jupyter notebook with step-by-step instructions, Bicep infrastructure templates, and APIM policies you can deploy to your Azure subscription. 🧠 AI Gateway for Models Manage and control access to Large Language Models with enterprise-grade policies. Lab Description ----- ------------- Backend Pool Load Balancing Distribute requests across multiple model endpoints Token Rate Limiting Control token consumption with rate limiting policies Semantic C","default_branch":null,"files":null,"tree":[],"storefront":"/r/Azure-Samples","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Azure-Samples/AI-Gateway/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}