{"repo":"NU-MECH-ENG-495/vr-hand-tracking","free":true,"listed":false,"github":"https://github.com/NU-MECH-ENG-495/vr-hand-tracking","clone":"git clone https://github.com/NU-MECH-ENG-495/vr-hand-tracking.git","description":"VR Hand Tracking with Meta Quest 3s","language":"ShaderLab","stars":30,"topics":["quest","unity","vr"],"license":null,"category":"game-templates","readme_excerpt":"VR Based Hand Joint Angle Tracking Author: Zhengyang Kris Weng !!Updates!! For integrated wrist/hand tracking, or alternatively dexterous-retargeting, see updates in this repo. Overview This project integrates VR and robotics to track hand joint angles in real time. It consists of two main components: a Unity-based VR application that captures joint angle data using Meta’s OpenXR SDK (previously using Oculus SDK) and broadcasts this data via UDP, and a C++ ROS2 node that receives the data, publishes it to a ROS2 topic, and provides a visualization UI. Additionally, the system can interface with a robotic hand for remote control. Schematic Requirements - Unity 6 - Meta Interactino SDK - OXR Hand Development There are two parts to this project - first part mostly focuses on developing unity app with C# and VR utilities to capture and compute joint angle data. The second part is mostly C++ ros2 project for receiving and data publishing. The VR app was developed in Unity with meta SDK. Originally, I developed a version of this app using the legacy Oculus VR SDK since it's been released for some time and there are plenty of documentations of it. However, I wasn't quite happy with the VR visuals, so I evantually switched to the new OpenXR SDK with Meta's building blocks. This allowed me to utilize some existing prefabs and features unique to meta Quest to develop an app with see-through background and synthetic hand overlay. There was much fewer documentation on OXR Hand usages, so","default_branch":null,"files":null,"tree":[],"storefront":"/r/NU-MECH-ENG-495","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/NU-MECH-ENG-495/vr-hand-tracking/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}