North Weber & Baugh LLP
Systems and methods for neural voice cloning with a few samples
Voice cloning is a highly desired capability for personalized speech interfaces. Neural network-based speech synthesis has been shown to generate high quality speech for a large number of speakers. Neural voice cloning systems that take a few audio samples as input are presented herein. Two approaches, speaker adaptation and speaker encoding, are disclosed. Speaker adaptation embodiments are based on fine-tuning a multi-speaker generative model with a few cloning samples. Speaker encoding embodiments are based on training a separate model to directly infer a new speaker embedding from cloning audios, which is used in or with a multi-speaker generative model. Both approaches achieve good performance in terms of naturalness of the speech and its similarity to original speaker—even with very few cloning audios.
Baidu USA LLC
G G G G
G10L G10L G10L G10L
inventional inventional inventional inventional
Wei Jitong Kainan Sercan O. Yanqi
Ping Chen Peng Arik Zhou