{"repo":"Azure-Samples/aisearch-openai-rag-audio","free":true,"listed":false,"github":"https://github.com/Azure-Samples/aisearch-openai-rag-audio","clone":"git clone https://github.com/Azure-Samples/aisearch-openai-rag-audio.git","description":"A simple example implementation of the VoiceRAG pattern to power interactive voice generative AI experiences using RAG with Azure AI Search and Azure OpenAI's gpt-4o-realtime-preview model.","language":"Python","stars":562,"topics":["azure","generative-ai","gpt","language-model","openai","rag","retrieval-augmented-generation","search","vector-database","azure-ai-search"],"license":"MIT","category":"ai-agents","readme_excerpt":"VoiceRAG: An Application Pattern for RAG + Voice Using Azure AI Search and the GPT-4o Realtime API for Audio This repo contains an example of how to implement RAG support in applications that use voice as their user interface, powered by the GPT-4o realtime API for audio. We describe the pattern in more detail in this blog post, and you can see this sample app in action in this short video. Features Architecture Diagram Getting Started GitHub Codespaces VS Code Dev Containers Local environment Deploying the app Development server Guidance Resources Getting help Features Voice interface : The app uses the browser's microphone to capture voice input, and sends it to the backend where it is processed by the Azure OpenAI GPT-4o Realtime API. RAG (Retrieval Augmented Generation) : The app uses the Azure AI Search service to answer questions about a knowledge base, and sends the retrieved documents to the GPT-4o Realtime API to generate a response. Audio output : The app plays the response from the GPT-4o Realtime API as audio, using the browser's audio capabilities. Citations : The app shows the search results that were used to generate the response. Architecture Diagram The RTClient in the frontend receives the audio input, sends that to the Python backend which uses an RTMiddleTier object to interface with the Azure OpenAI real-time API, and includes a tool for searching Azure AI Search. This repository includes infrastructure as code and a Dockerfile to deploy the app to Azure ","default_branch":null,"files":null,"tree":[],"storefront":"/r/Azure-Samples","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Azure-Samples/aisearch-openai-rag-audio/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}