{"repo":"GoogleCloudPlatform/BigQuery-Agent-Analytics-SDK","free":true,"listed":false,"github":"https://github.com/GoogleCloudPlatform/BigQuery-Agent-Analytics-SDK","clone":"git clone https://github.com/GoogleCloudPlatform/BigQuery-Agent-Analytics-SDK.git","description":"An open-source Python SDK for analyzing, evaluating, and curating agent traces stored in BigQuery. Built on top of the BigQuery Agent Analytics, it provides a consumption-layer toolkit for agent observability, analysis, evaluation, and advanced capabilities like context graph at scale.","language":"Python","stars":39,"topics":["adk-python","agent","context-graph","evaluation","observability"],"license":"Apache-2.0","category":"analytics","readme_excerpt":"BigQuery Agent Analytics SDK An open-source Python SDK for analyzing, evaluating, and curating agent traces stored in BigQuery. Built on top of the BigQuery Agent Analytics, it provides a consumption-layer toolkit for agent observability, analysis, evaluation, and advanced capabilities like the Agent Context Graph — extracting decision traces from your agent's context graph — at scale. Overview The BigQuery Agent Analytics SDK connects your AI agent telemetry in BigQuery to a rich set of evaluation, observability, and analytics capabilities. It is designed for ML engineers, data scientists, and platform teams who run agents in production and need to understand agent behavior, measure quality, and detect regressions — all through BigQuery SQL or Python. Key Features Observability - Trace reconstruction and DAG visualization - Per-event-type BigQuery views - Observability dashboards (Looker Studio, SQL, and BigFrames) Evaluation - Code-based metrics (latency, turn count, error rate, token efficiency, cost) - LLM-as-Judge scoring (correctness, hallucination, sentiment) - Trajectory matching (exact, in-order, any-order) - Multi-trial evaluation with pass@k / pass^k - Grader composition (weighted, binary, majority strategies) - Eval suite lifecycle management with graduation and saturation detection - Static quality validation (ambiguous tasks, class imbalance, suspicious thresholds) AI/ML Integration - BigQuery AI.GENERATE, AI.EMBED, AI.CLASSIFY - Anomaly detection and latency fo","default_branch":null,"files":null,"tree":[],"storefront":"/r/GoogleCloudPlatform","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/GoogleCloudPlatform/BigQuery-Agent-Analytics-SDK/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}