High-fidelity, directable animation transfer using facial decomposition on optimized micro-sequences
Numéro de l'application : | 522014-2017 | ||
Année de concours : | 2017 | Année financière : | 2018-2019 |
Nom de la personne : | Popa, Tiberiu | Institution : | Concordia University |
Département : | Computer Science and Software Engineering | Province : | Québec |
Montant : | 50 500,00 $ | Versement : | 1 - 1 |
Type de programme : | Subventions de recherche et développement coopérative | Comité évaluateur : | Cté de décision interne - PPR |
Sujet de recherche : | Traitement des images | Domaine d'application : | Technologie de l'information, des ordinateurs et des réseaux de communications |
Chercheurs associés : |
Paquette, Eric E |
Partenaires : |
Audio Z |
**The entertainment industry delivers media products around the world to people speaking a large number of distinct languages. Media products such as TV or internet spots, movies and video games, typically consist of a video and sound stream. To accommodate different languages, the producers typically re-generate the sound stream in different language in a post-production step, a process known as dubbing. While it still takes a lot of effort to re-generate the sound stream (dubbing), one of the remaining open challenges both from a research and production point of view is how to synchronize the original video stream with the new audio stream. The lack of synchronization creates a very uncanny effect that takes away from the experience since the lip motion of the actors does not correspond to the soundtrack. In this project we propose a practical solution to the dubbing synchronization problem, producing natural results that can be used in a production studio. To achieve that, we created a strategic partnership with AudioZ, a production studio located in Montreal with whom we will collaborate on this project. We propose a video synthesis method that blends animation focusing on the lip area while preserving the facial expression of the original actor. Our method uses novel optimization techniques to avoid the common undesired uncanny valley effect of video synthesis.******
- Date de modification :