End-to-End Signal Factorization for Speech: Identity, Content, and Style
Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence
Doctoral Consortium. Pages 5212-5213. https://doi.org/10.24963/ijcai.2020/746
Preliminary experiments in this dissertation show that it is possible to factorize specific types of information from the speech signal in an abstract embedding space using machine learning. This information includes characteristics of the recording environment, speaking style, and speech quality. Based on these findings, a new technique is proposed to factorize multiple types of information from the speech signal simultaneously using a combination of state-of-the-art machine learning methods for speech processing. Successful speech signal factorization will lead to advances across many speech technologies, including improved speaker identification, detection of speech audio deep fakes, and controllable expression in speech synthesis.
Natural Language Processing: Speech
Machine Learning: Deep Learning
Machine Learning: Multi-instance;Multi-label;Multi-view learning
Multidisciplinary Topics and Applications: Security and Privacy