{"repo":"jmanhype/vggt-mps","free":true,"listed":false,"github":"https://github.com/jmanhype/vggt-mps","clone":"git clone https://github.com/jmanhype/vggt-mps.git","description":"VGGT 3D Vision Agent optimized for Apple Silicon with Metal Performance Shaders","language":"Python","stars":92,"topics":["3d-reconstruction","apple-silicon","claude-desktop","computer-vision","depth-estimation","m1","m2","m3","macos","mcp"],"license":"MIT","category":"mcp-servers","readme_excerpt":"vggt-mps Port of Facebook Research's VGGT (Visual Geometry Grounded Transformer) to Apple Silicon via PyTorch's MPS backend. Takes single or multi-view images and produces depth maps, camera poses, and 3D point clouds. --- --- Version 2.0.0 Python 3.10+ Platform macOS 13+ on Apple Silicon (M1/M2/M3) Model facebook/VGGT-1B (1B params, 5 GB on disk) License MIT PyPI Not yet published What it produces Given N input images, VGGT predicts: Output Description --- --- Depth maps Per-pixel depth estimation Camera poses 6-DOF camera parameters for each view 3D point clouds Dense reconstruction (exportable as PLY, OBJ, GLB) Confidence maps Per-pixel reliability scores Architecture The upstream VGGT model is a 1B-parameter transformer trained on multi-view geometry tasks. This repo wraps it with: - MPS device detection and dtype handling (float32 for Metal compatibility) - A sparse attention module ( vggt sparse attention.py ) that patches the model at runtime for O(n) memory scaling instead of O(n^2) - A unified CLI ( vggt command with subcommands) - A Gradio web interface - An MCP server for Claude Desktop integration Sparse attention The sparse attention module replaces standard O(n^2) cross-view attention with a covisibility-masked variant. No retraining required -- it patches the loaded model at runtime. Images Standard memory Sparse memory Reduction --- --- --- --- 100 O(10K) O(1K) 10x 500 O(250K) O(5K) 50x 1000 O(1M) O(10K) 100x Output difference vs. standard attention: reported ","default_branch":null,"files":null,"tree":[],"storefront":"/r/jmanhype","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/jmanhype/vggt-mps/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}