{"repo":"hecomi/uLipSync","free":true,"listed":false,"github":"https://github.com/hecomi/uLipSync","clone":"git clone https://github.com/hecomi/uLipSync.git","description":"MFCC-based LipSync plug-in for Unity using Job System and Burst Compiler","language":"C#","stars":1658,"topics":["unity","lip-sync","burst-compiler","job-system","microphone","timeline","vrm","webgl"],"license":"MIT","category":"game-templates","readme_excerpt":"uLipSync ======== uLipSync is an asset for lip-syncing in Unity. It has the following features: - Utilizes Job System and Burst Compiler to run faster on any OS without using native plugins. - Can be calibrated to create a per-character profile . - Both runtime analysis and pre-bake processing are available. - Pre-bake processing can be integrated with Timeline . - Pre-bake data can be converted to AnimationClip Features -------- LipSync Profile Real-time Analysis Mic Input Pre-Bake Timeline AnimationClip Texture Change VRM Support WebGL Support Install ------- - Unity Package - Download the latest .unitypackage from Release page. - Import Unity.Burst and Unity.Mathematics from Package Manager. - Git URL (UPM) - Add https://github.com/hecomi/uLipSync.git#upm to Package Manager. - Scoped Registry (UPM) - Add a scoped registry to your project. - URL: https://registry.npmjs.com - Scope: com.hecomi - Install uLipSync in Package Manager. - If you can't find uLipSync in the list, please try entering com.hecomi.ulipsync directly. How to Use ---------- Mechanism When a sound is played by AudioSource , a buffer of the sound comes into the OnAudioFilterRead() method of a component attached to the same GameObject. We can modify this buffer to apply sound effects like reverb, but at the same time since we know what kind of waveform is being played, we can also analyze it to calculate Mel-Frequency Cepstrum Coefficients (MFCC), which represent the characteristics of the human vocal tract.","default_branch":null,"files":null,"tree":[],"storefront":"/r/hecomi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/hecomi/uLipSync/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}