{"repo":"collidingScopes/arpeggiator","free":true,"listed":false,"github":"https://github.com/collidingScopes/arpeggiator","clone":"git clone https://github.com/collidingScopes/arpeggiator.git","description":"Hand-controlled arpeggiator, drum machine, and audio reactive visualizer. Built with mediapipe computer vision, threejs, tonejs","language":"JavaScript","stars":159,"topics":["arpeggio","audio-reactive","augmented-reality","computer-vision","drum-machine","mediapipe","music","spatial-computing","synthesizer","threejs"],"license":null,"category":"machine-learning","readme_excerpt":"Hand Gesture Arpeggiator Hand-controlled arpeggiator, drum machine, and audio reactive visualizer. Raise your hands to raise the roof! An interactive web app built with threejs, mediapipe computer vision, rosebud AI, and tone.js. - Hand #1 controls the arpeggios (raise hand to raise pitch, pinch to change volume) - Hand #2 controls the drums (raise different fingers to change the pattern) Video Live Demo More Code & Tutorials Requirements - Modern web browser with WebGL support - Camera access enabled for hand tracking Technologies - MediaPipe for hand tracking and gesture recognition - Three.js for audio reactive visual rendering - Tone.js for synthesizer sounds - HTML5 Canvas for visual feedback - JavaScript for real-time interaction Setup for Development Then navigate to http://localhost:8000 in your browser. License MIT License Credits - Three.js - https://threejs.org/ - MediaPipe - https://mediapipe.dev/ - Rosebud AI - https://rosebud.ai/ - Tone.js - https://tonejs.github.io/ Related Projects I've released several computer vision projects (with code + tutorials) here: Fun With Computer Vision You can purchase lifetime access and receive the full project files and tutorials. I'm adding more content regularly 🪬 You might also like some of my other open source projects: - 3D Model Playground - control 3D models with voice and hand gestures - Threejs hand tracking tutorial - Basic hand tracking setup with threejs and MediaPipe computer vision - Particular Drift - Turn photo","default_branch":null,"files":null,"tree":[],"storefront":"/r/collidingScopes","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/collidingScopes/arpeggiator/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}