{"repo":"microsoft/rag-experiment-accelerator","free":true,"listed":false,"github":"https://github.com/microsoft/rag-experiment-accelerator","clone":"git clone https://github.com/microsoft/rag-experiment-accelerator.git","description":"The RAG Experiment Accelerator is a versatile tool designed to expedite and facilitate the process of conducting experiments and evaluations using Azure Cognitive Search and RAG pattern.","language":"Python","stars":308,"topics":["acs","chunking","embedding","rag","evaluation","experiment","information-retrieval","openai","azure","genai"],"license":null,"category":"ai-agents","readme_excerpt":"RAG Experiment Accelerator Overview The RAG Experiment Accelerator is a versatile tool that helps you conduct experiments and evaluations using Azure AI Search and RAG pattern. This document provides a comprehensive guide that covers everything you need to know about this tool, such as its purpose, features, installation, usage, and more. Purpose The main goal of the RAG Experiment Accelerator is to make it easier and faster to run experiments and evaluations of search queries and quality of response from OpenAI. This tool is useful for researchers, data scientists, and developers who want to: - Test the performance of different Search and OpenAI related hyperparameters. - Compare the effectiveness of various search strategies. - Fine-tune and optimize parameters. - Find the best combination of hyperparameters. - Generate detailed reports and visualizations from experiment results. Latest changes 18 March 2024: Content sampling has been added. This functionality will allow the dataset to be sampled by a specified percentage. The data is clustered by content and then the sample percentage is taken across each cluster to attempt even distribution of the sampled data. This is done to ensure representative results in the sample that one would get across the entire dataset. Note : It is recommended to rebuild your environment if you have used this tool before due to new dependencies. Features The RAG Experiment Accelerator is config driven and offers a rich set of features to supp","default_branch":null,"files":null,"tree":[],"storefront":"/r/microsoft","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/microsoft/rag-experiment-accelerator/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}