{"repo":"raga-ai-hub/RagaAI-Catalyst","free":true,"listed":false,"github":"https://github.com/raga-ai-hub/RagaAI-Catalyst","clone":"git clone https://github.com/raga-ai-hub/RagaAI-Catalyst.git","description":"Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view","language":"Python","stars":16149,"topics":["agentneo","agents","ai-performance-optimization","llm-testing","llmops","agentic-ai-development","ai-agent-monitoring","ai-application-debugging","ai-evaluation-tools","ai-tool-interaction-monitoring"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"RagaAI Catalyst  RagaAI Catalyst is a comprehensive platform designed to enhance the management and optimization of LLM projects. It offers a wide range of features, including project management, dataset management, evaluation management, trace management, prompt management, synthetic data generation, and guardrail management. These functionalities enable you to efficiently evaluate, and safeguard your LLM applications. Table of Contents - RagaAI Catalyst - Installation - Configuration - Usage - Project Management - Dataset Management - Evaluation Management - Trace Management - Agentic Tracing - Prompt Management - Synthetic Data Generation - Guardrail Management - Red-teaming Installation To install RagaAI Catalyst, you can use pip: Configuration Before using RagaAI Catalyst, you need to set up your credentials. You can do this by setting environment variables or passing them directly to the RagaAICatalyst class: you'll need to generate authentication credentials: 1. Navigate to your profile settings 2. Select \"Authenticate\" 3. Click \"Generate New Key\" to create your access and secret keys Note : Authetication to RagaAICatalyst is necessary to perform any operations below. Usage Project Management Create and manage projects using RagaAI Catalyst: Dataset Management Manage datasets efficiently for your projects: For more detailed information on Dataset Management, including CSV schema handling and advanced usage, please refer to the Dataset Management documentation. Eva","default_branch":null,"files":null,"tree":[],"storefront":"/r/raga-ai-hub","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/raga-ai-hub/RagaAI-Catalyst/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}