{"repo":"SocAIty/py_audio2face","free":true,"listed":false,"github":"https://github.com/SocAIty/py_audio2face","clone":"git clone https://github.com/SocAIty/py_audio2face.git","description":"Use the NVIDIA Audio2Face headless server and interact with it through a requests API. Generate animation sequences for Unreal Engine 5, Maya and MetaHumans","language":"Python","stars":155,"topics":["audio2face","npc","unreal-engine","virtual-avatars","audio2emotion","nvidia"],"license":"GPL-3.0","category":"game-templates","readme_excerpt":"py Audio2Face Generate expressive facial animation from audio Overview This Python script leverages the headless mode of Audio2Face to generate animations for characters: - lip movement animations - face animations - emotions (new since 2023.2.0) - It provides methods to control the Audio2Face headless server and interact with it through a requests API. Use cases: - Power your games and movies with expressive facial animations. - Create natural looking virtual avatars. - Generate animations for characters and export them as USD files for example for Maya or Unreal Engine 5. - Stream audio data to the Audio2Face server to generate animations in real-time. Use Live-Lynk to use them in UE5 Demo and Tutorial Checkout socaity.ai for a ton of related generative AI models and free hosting. Installation Install the py audio2face package using pip: Modify the ROOT DIR , DEFAULT OUTPUT DIR , and DEFAULT AUDIO STREAM GRPC PORT variables in the settings.py file as needed. Prerequisites - Audio2Face installed on the system - Python 3.x Usage First initialize Audio2Face instance: Generate animation for audio files: Configure Emotions The emotion mixin let's you control the strength of the emotions in the generated animation. You can also configure the emotion detection behaviour with the set settings method. Stream audio to Audio2Face: Instead of providing paths to the a2f headless server, you can stream the audio data directly to the server. This is useful if you want to generate animatio","default_branch":null,"files":null,"tree":[],"storefront":"/r/SocAIty","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/SocAIty/py_audio2face/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}