{"repo":"AEON-7/matrix-voip-agent","free":true,"listed":false,"github":"https://github.com/AEON-7/matrix-voip-agent","clone":"git clone https://github.com/AEON-7/matrix-voip-agent.git","description":"Headless Matrix WebRTC voice AND video agent — auto-answers calls, bridges audio to any AI agent via PipeWire, optional camera-frame vision for multimodal LLMs","language":"TypeScript","stars":19,"topics":["ai-agent","matrix","video-call","vision","voip","webrtc"],"license":"MIT","category":"ai-agents","readme_excerpt":"Matrix VoIP Voice and Video Calling Headless Matrix WebRTC voice and video call agent. Auto-answers (and initiates) Matrix VoIP calls with real-time voice conversation powered by local STT, direct LLM inference, and local or cloud TTS. Call your AI agent from any Matrix client. The agent hears you, thinks, and talks back — in 4 seconds with the whisper.cpp + ElevenLabs pipeline, or starting at 1 second with the local qwen3-asr-server + qwen3-tts-server sidecars and streaming TTS ( 2 s for a fully synthesized reply). Optional video add-on: share your camera during a classic 1:1 Element video call and the agent can see . Inbound VP8 frames are sampled into a small in-memory JPEG ring buffer (never written to disk), and the LLM gets a per-call look tool to pull frames on demand — ask \"what do you see?\" and a vision-capable model answers from live camera frames. Off by default; voice-only calls behave exactly as before. See the Video Calling QuickStart. ✨ Best fully-offline voice stack — recommended pairing For the lowest latency and zero cloud dependency, pair this agent with our three companion sidecars on a single GPU host (DGX Spark / Blackwell): sidecar image what it does --- --- --- qwen3-asr-server ghcr.io/aeon-7/qwen3-asr-server:latest Speech → text (Qwen3-ASR-0.6B, RTF 16× hot) — wired via OMNI ASR qwen3-tts-server ghcr.io/aeon-7/qwen3-tts-server:latest Text → speech (Qwen3-TTS-12Hz-1.7B VoiceDesign + Base voice-clone on the faster-qwen3-tts CUDA-graph engine — streams P","default_branch":null,"files":null,"tree":[],"storefront":"/r/AEON-7","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/AEON-7/matrix-voip-agent/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}