{"repo":"danieloquelis/Unity-QuestVisionStream","free":true,"listed":false,"github":"https://github.com/danieloquelis/Unity-QuestVisionStream","clone":"git clone https://github.com/danieloquelis/Unity-QuestVisionStream.git","description":"A Unity package that enables real-time computer vision operations on Meta Quest headsets using the Passthrough Camera API (PCA) with WebRTC streaming to external servers for AI inference.","language":"C#","stars":51,"topics":["ai","computer-vision","csharp","metaquest3","metasdk","passthrough-camera-api","unity"],"license":"MIT","category":"game-templates","readme_excerpt":"Unity QuestVisionStream 🚧 Beta Notice This package is currently in beta . I'm actively looking for feedback — please open an issue or discussion if you have suggestions! A Unity package that enables real-time computer vision operations on Meta Quest headsets using the Passthrough Camera API (PCA) with WebRTC streaming to external GPU servers for AI inference. This solution bypasses traditional HTTP request bottlenecks, delivering seamless real-time performance. Overview QuestVisionStream solves the performance limitations of running GPU-intensive computer vision operations directly on Meta Quest devices. Instead of processing AI models locally on the headset, it streams the passthrough camera feed in real-time to external machines (local or cloud) where powerful GPUs can run inference models. The results are sent back to the headset for spatial operations and interactive experiences. This approach eliminates the delays and server overload issues that come with traditional HTTP request-based solutions, providing truly real-time performance. This approach provides: - Real-time performance : Minimal latency with continuous streaming pipeline - GPU-agnostic : Works with both Vulkan and OpenGLES3 graphics APIs (fully tested with Vulkan) - OpenXR compatible : Unlike other solutions that require Oculus SDK Demos This is just an example use case for the library and is not intended to be limited to object detection. The 3D tags are inspired by the amazing work of Lucas Martinic YOLO ","default_branch":null,"files":null,"tree":[],"storefront":"/r/danieloquelis","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/danieloquelis/Unity-QuestVisionStream/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}