{"repo":"byjlw/video-analyzer","free":true,"listed":false,"github":"https://github.com/byjlw/video-analyzer","clone":"git clone https://github.com/byjlw/video-analyzer.git","description":"Analyze videos using LLMs, Computer Vision and Automatic Speech Recognition","language":"Python","stars":1546,"topics":["asr","llms","video","video-processing"],"license":"Apache-2.0","category":"media-processing","readme_excerpt":"Video Analysis using vision models like Llama3.2 Vision and OpenAI's Whisper Models A video analysis tool that combines vision models like Llama's 11B vision model and Whisper to create a description by taking key frames, feeding them to the vision model to get details. It uses the details from each frame and the transcript, if available, to describe what's happening in the video. Table of Contents - Features - Requirements - System Requirements - Installation - Ollama Setup - OpenAI-compatible API Setup - Usage - Quick Start - Sample Output - Complete Usage Guide - Design - Detailed Design Documentation - Project Structure - Configuration - Output - Prompt Tuning - Uninstallation - License - Contributing Features - 💻 Can run completely locally - no cloud services or API keys needed - ☁️ Or, leverage any OpenAI API compatible LLM service (openrouter, openai, etc) for speed and scale - 🎬 Intelligent key frame extraction from videos - 🔊 High-quality audio transcription using OpenAI's Whisper - 👁️ Frame analysis using Ollama and Llama3.2 11B Vision Model - 📝 Natural language descriptions of video content - 🔄 Automatic handling of poor quality audio - 📊 Detailed JSON output of analysis results - ⚙️ Highly configurable through command line arguments or config file Design The system operates in three stages: 1. Frame Extraction & Audio Processing - Uses OpenCV to extract key frames - Processes audio using Whisper for transcription - Handles poor quality audio with confidence","default_branch":null,"files":null,"tree":[],"storefront":"/r/byjlw","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/byjlw/video-analyzer/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}