{"repo":"tensorstax/agenttrace","free":true,"listed":false,"github":"https://github.com/tensorstax/agenttrace","clone":"git clone https://github.com/tensorstax/agenttrace.git","description":"AgentTrace is a lightweight observability library to trace and evaluate agentic systems.","language":"TypeScript","stars":80,"topics":["agentic-ai","agents","eval","evaluation-framework","observability","tracing"],"license":"MIT","category":"analytics","readme_excerpt":"AgentTrace AgentTrace is a lightweight and hackable tracing/evaluation framework for AI agents and language models by TensorStax . It provides local monitoring and debugging capabilities, making it easier to build reliable and performant AI systems. Web Dashboard AgentTrace includes a web dashboard for visualizing and analyzing your traces and evaluations. Installation You can install AgentTrace directly from PyPI: Or install from source: Quick Start Basic Tracing Tracing Async OpenAI API Calls with Tools Using the Evaluation Framework AgentTrace includes a powerful evaluation framework that allows you to assess the performance of your AI agents and models. The evaluation framework helps you: 1. Define test cases with expected outputs 2. Run your agent or model against these test cases 3. Score the outputs using custom evaluation functions 4. Track performance over time Here's a simple example of evaluating a model's ability to identify the capital of France: Web Interface agenttrace includes a web-based interface for visualizing traces and evaluation results. Starting the Web Interface This will start: - The backend API server on port 3033 - The frontend web interface on port 5173 Open your browser and go to http://localhost:5173 to access the interface. Customizing Trace Storage By default, AgentTrace stores traces in a SQLite database at traces.db in the current directory. You can customize this: Adding Custom Tags Tags help you categorize and filter traces: Contributing C","default_branch":null,"files":null,"tree":[],"storefront":"/r/tensorstax","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/tensorstax/agenttrace/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}