{"repo":"0xnyn/periscope","free":true,"listed":false,"github":"https://github.com/0xnyn/periscope","clone":"git clone https://github.com/0xnyn/periscope.git","description":"LLM Performance Testing | K6 + Grafana + InfluxDB | A tiny toolkit for load testing and benchmarking OpenAI-like inference endpoints using K6 + Grafana + InfluxDB","language":"JavaScript","stars":14,"topics":["grafana","influxdb","k6","llm-testing","performance-testing","vllm","vllm-production-stack"],"license":null,"category":"analytics","readme_excerpt":"Periscope Periscope K6 LLM Performance Testing Framework Explore the docs » View Scripts · Report Bug · Request Feature A comprehensive framework for load testing and benchmarking OpenAI API endpoints using K6, with a focus on measuring performance metrics for completions and embeddings. 📋 Table of Contents - Overview - Features - Prerequisites - Installation - Architecture - Usage - Makefile Reference - Configuration Options - Example Workflows - Scripts Explained - Custom Tests - Troubleshooting - Advanced Usage - License Overview This framework provides a Docker-based environment for performance testing of OpenAI API endpoints. It includes preconfigured K6, InfluxDB, and Grafana services, along with customized scripts designed specifically for testing various aspects of OpenAI's API services. The framework allows you to measure key metrics like response times, token usage efficiency, throughput, and error rates under different load scenarios. Features - Containerized Environment : Docker and Docker Compose based deployment - Metrics Visualization : Pre-configured Grafana dashboards for test results - Core API Testing : - Chat completions testing - Embeddings generation testing (single and batch) - Code completion with prefix caching - Performance Testing Patterns : - Smoke tests for basic functionality validation - Stress tests for identifying breaking points - Spike tests for sudden load surges - Soak tests for long-duration stability - Recovery tests for m","default_branch":null,"files":null,"tree":[],"storefront":"/r/0xnyn","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/0xnyn/periscope/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}