{"repo":"thetobysiu/Deepstory","free":true,"listed":false,"github":"https://github.com/thetobysiu/Deepstory","clone":"git clone https://github.com/thetobysiu/Deepstory.git","description":"Deepstory turns a text/generated text into a video where the character is animated to speak your story using his/her voice.","language":"Python","stars":103,"topics":["pytorch","dctts","dc-tts","deep-learning","jquery","flask","gpt-2","gpt2","witcher-3","witcher3"],"license":null,"category":"machine-learning","readme_excerpt":"Deepstory Deepstory is an artwork that incorporates Natural Language Generation(NLG) w/GPT-2, Text-to-Speech(TTS) w/Deep Convolutional TTS, speech to animation w/Speech driven animation and image animation w/First Order Motion Model into a media application. To put it simply, it turns a text/generated text into a video where the character is animated to speak your story using his/her voice. You can convert image into a video like this: It provides a comfortable web interface and backend written with flask to create your own story. It supports transformers model, and pytorch-dctts models Live Demo (Finally Updated) Now you can experience the ancient technology from 5 years ago! Actually kind of amazing how GPT is capable of nowadays. I will update it with more modern models. Colab (flask-ngrok): https://drive.google.com/file/d/1zIEjoldXXkzhZjkPY3WhB3mlIMnVwm4J/view?usp=sharing Video (In case you need instructions): https://blog.thetobysiu.com/video/ Updates 1. Redesign interface, especially the whole GPT2 interface 2. GPT2 now support text loading from original data, so that it can continue to generate a story based on the book 3. Figure out the token limits in GPT2 and only infer to the nearest 1024 - predict length tokens 4. GPT2 support interactive mode that generates several batches of sentences and provides an interface to add those sentence 5. Sentence speaker mapping system, not replacing all speaker by default anymore 6. text normalization is now in the synthesizing st","default_branch":null,"files":null,"tree":[],"storefront":"/r/thetobysiu","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/thetobysiu/Deepstory/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}