{"repo":"ButzYung/SystemAnimatorOnline","free":true,"listed":false,"github":"https://github.com/ButzYung/SystemAnimatorOnline","clone":"git clone https://github.com/ButzYung/SystemAnimatorOnline.git","description":"XR Animator, AI-based Full Body Motion Capture and Extended Reality (XR) solution, powered by System Animator Online","language":"JavaScript","stars":1822,"topics":["webgl","electron-app","augmented-reality","mediapipe","motion-capture","tensorflowjs","webxr","threejs","vtuber"],"license":null,"category":"machine-learning","readme_excerpt":"# XR Animator Full-body, real-time motion tracking with a single webcam, on your PC and web browser XR Animator, inherited from my previous desktop gadget project known as System Animator, is a video/webcam-based AI motion capture application designed for VTubing and the metaverse era. It uses the machine learning (ML) solution from MediaPipe and TensorFlow.js to detect the 3D poses from a live webcam video, which is then used to drive the 3D avatar (MMD/VRM model) as if you are controlling it with your body. It can be used for VTubing and various XR/3D purposes. It has a variety of motion tracking options. You can choose to track the face, full body, or something in between (any combination of face/body/hands). The web app version works on all major web browsers both on desktop and smartphone. On browsers supporting both web worker and OffscreenCanvas (e.g. Chrome), it can achieve 60fps visual rendering and 30fps body pose detection on a mediocre PC. On smartphones with limited processing power, you may want to use limit its usage on face tracking. 🌐XR Animator - Web app version The Windows/Linux/macOS app version (powered by Electron) is also availabe for download, which provides a few extra features (e.g. VMC-protocol, transparent background) available only in a native-OS environment. 🖥️XR Animator - Windows/Linux/macOS app version Features - Support full-body AI motion tracking using a single webcam or media file (image/video) - Support \"Perfect Sync\"/ARKit-compatible 5","default_branch":null,"files":null,"tree":[],"storefront":"/r/ButzYung","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ButzYung/SystemAnimatorOnline/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}