Microsoft’s DeepSinger Generates Voices That Can Sing In English and Chinese

A team of researchers from Microsoft and Zhejiang University recently developed a multi-lingual multi-singer singing voice synthesis (SVS) system known as DeepSinger. The system is built from scratch using singing training data mined from music websites. With the advancement of deep neural networks, Singing Voice Synthesis (SVS) generates singing voices from lyrics, which has attracted much traction in the field of research and industrial community in recent years. This technique is similar to the text-to-speech method that enables machines to speak. Traditional SVS mostly relies on human recording and annotations and requires a large number of high-quality singing recordings as training data as well as strict data alignments between lyrics and singing audio for accurate singing mode