{"repo":"ErickWendel/monitoring-llms-langfuse-ollama","free":true,"listed":false,"github":"https://github.com/ErickWendel/monitoring-llms-langfuse-ollama","clone":"git clone https://github.com/ErickWendel/monitoring-llms-langfuse-ollama.git","description":"Examples of how to monitor the OpenAI SDK calls using Langfuse","language":"JavaScript","stars":20,"topics":["artificial-intelligence","docker","hostinger","langfuse","monitoring","ollama","openai"],"license":"MIT","category":"analytics","readme_excerpt":"Monitoring AI Calls with Langfuse This project demonstrates how to implement request tracing and monitoring for OpenAI SDK calls using Langfuse. It provides a ready-to-use setup with Docker Compose for easy deployment on VPS environments. ⚠️ Production Notice : This setup is intended for development and testing. For production environments: - Use Docker Swarm or Kubernetes instead of Docker Compose for better scalability and orchestration - Configure SSL/TLS certificates (not included in this setup) - Update all default credentials - Consider implementing proper load balancing 🎯 Overview Monitor and analyze your AI application's performance, costs, and behavior using Langfuse's powerful observability platform. This implementation uses the official Langfuse Docker Compose setup for self-hosting and includes Ollama integration for local LLM support. 🚀 Features - Self-hosted Langfuse instance - OpenAI SDK integration - Ollama integration with gemma:2b model - Request tracing and monitoring - Cost analysis - Performance metrics - Prompt management - Evaluation capabilities - Automatic model downloading 🛠 Prerequisites - Docker and Docker Compose installed - Basic understanding of Docker and containerization 📦 Installation 1. Clone this repository: 2. Configure environment variables: The project includes a default .env file with pre-configured settings: - Default Langfuse API keys (ready to use) - Ollama configuration (using gemma:2b model) - Pre-configured user credentials: -","default_branch":null,"files":null,"tree":[],"storefront":"/r/ErickWendel","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ErickWendel/monitoring-llms-langfuse-ollama/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}