{"repo":"sergiosolorzano/TalkomicApp-Unity","free":true,"listed":false,"github":"https://github.com/sergiosolorzano/TalkomicApp-Unity","clone":"git clone https://github.com/sergiosolorzano/TalkomicApp-Unity.git","description":"Whisper, Stable Diffusion on U-Net, Chatgpt AI models, bundled in a Unity project. Locally run models powered by Onnxruntime. These transcribe podcasts' audio to text and generate contextual images tied to the transcribed text.","language":"C#","stars":27,"topics":["chatgpt","onnxruntime","stable-diffusion","unity3d","whisper-ai"],"license":"MIT","category":"game-templates","readme_excerpt":"Ready Tensor Computer Vision 2024 Competition Most Engaging Presentation Prize I am thrilled the Ready Tensor jury awarded the Talkomic App in the Ready Tensor Computer Vision 2024 Competition as the \"Most Engaging Presentation for skilfully combining technical depth with compelling clarity and storytelling\" 🚀 \"This publication presents a creative approach to enhancing the podcast experience by generating contextual images from audio content through the Talkomic app. The creative presentation style, starting with a simple yet attention-grabbing title and followed by a highly engaging walk through the implementation, captures the reader's attention and makes complex concepts accessible. The judges applauded the authors for crafting a thoroughly enjoyable and informative read, exemplifying the essence of the Most Engaging Presentation prize.\" Project Watching a sound wave or unrelated images for a podcast that is published in a platform that supports video and images can be dull. We propose asking a trio of AI models, bundled in a Unity project, to transcribe the audio to text and generate contexual images closely tied to the transcribed text.   We run two of the AI models locally, Whisper-Tiny and stable diffusion in U-Net architecture; we access a third, Chatgpt, remotely via an API.   In a Unity scene we loop the AI Models over each podcast audio section to generate the contextual images.   --------------------------------------------- Watch The Trailer🎬 &nb","default_branch":null,"files":null,"tree":[],"storefront":"/r/sergiosolorzano","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/sergiosolorzano/TalkomicApp-Unity/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}