{"repo":"graphsignal/graphsignal-profiler","free":true,"listed":false,"github":"https://github.com/graphsignal/graphsignal-profiler","clone":"git clone https://github.com/graphsignal/graphsignal-profiler.git","description":"Graphsignal Profiler","language":"Python","stars":242,"topics":["machine-learning","deep-learning","huggingface","inference","pytorch","debugging","monitoring","python","artificial-intelligence","langchain"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Graphsignal: Inference Profiler Graphsignal is a production-scale inference profiling platform that helps engineers optimize AI performance across models, engines, GPUs, and other accelerators. It provides essential visibility across the inference stack, including: Continuous, high-resolution profiling timelines exposing operation durations and resource utilization across inference workloads. LLM generation tracing with per-step timing, token throughput, and latency breakdowns for major inference frameworks. System-level metrics for inference engines and hardware (CPU, GPU, accelerators). Error monitoring for device-level failures and inference errors. Automatic engine flag optimization, AI chat for bottleneck investigation, and profiling context for AI coding agents. Learn more at graphsignal.com. Install Alternative: install into your workload environment If you prefer a single environment, or you use the graphsignal.watch() Python API (which requires graphsignal importable by your application), install it directly into your workload's environment instead: Profile Wrap your launch command with graphsignal-run : Environment variables read by the profiler: Variable Purpose ------------------------------------- ---------------------------------------------------------------------- GRAPHSIGNAL API KEY (required) Your account API key. GRAPHSIGNAL TAG = Arbitrary tag attached to all signals (e.g. GRAPHSIGNAL TAG DEPLOYMENT=us-prod ). Sign up for a free account at graphsignal.com;","default_branch":null,"files":null,"tree":[],"storefront":"/r/graphsignal","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/graphsignal/graphsignal-profiler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}