Now Reading
Google DeepMind develops a lip reading software

Google DeepMind develops a lip reading software

Image: Getty images

Not a single day passes without Mountain View-headquartered search giant Google releasing its latest accomplishment in AI.  Now, reportedly, researchers from Google-owned London-based DeepMind and Oxford University have used AI to deliver a lip-reading software that bests human beings as well.

Google’s algorithm factory DeepMind that is carrying out groundbreaking research in healthcare and energy among other areas teamed up with Oxford researchers to develop a lip-reading software. The research cites how the reason behind developing such a software —  machine that can lip read opens up a host of applications, from dictating’ instructions or messages to a phone in a noisy environment; transcribing and re-dubbing archival silent films; resolving multi-talker simultaneous speech; and, improving the performance of automated speech recognition in general.

Follow us on Google News>>

In an earlier interview, DeepMind CEO Demis Hassabis revealed how the AI company is focusing on smartphone technologies that will have great potential.

Some of the noteworthy contributions of the researchers are (1) a ‘Watch, Listen, Attend and Spell’ (WLAS) network that learns to transcribe videos of mouth motion to characters; (2) a curriculum learning strategy to accelerate training and to reduce overfitting; (3) a ‘Lip Reading Sentences’ (LRS) dataset for visual speech recognition, consisting of over 100,000 natural sentences from British television.

Interestingly, the WLAS model trained on the LRS dataset outshines the performance of all previous work on standard lip reading benchmark datasets, that too by a great margin. The paper claims that their lip reading software has bested professional lip reader on videos from BBC television.  The model uses a dual attention mechanism that works on both visual input  and  audio input.

Looking for a job change? Let us help you.
What Do You Think?

Join Our Discord Server. Be part of an engaging online community. Join Here.

Subscribe to our Newsletter

Get the latest updates and relevant offers by sharing your email.

Copyright Analytics India Magazine Pvt Ltd

Scroll To Top