Hello Google, What’s LaMDA?

Listen to this story

Talking to a chatbot can get tricky and sometimes lead to a dead-end. 

To ensure a smooth conversing experience, Google has announced a language model called ‘LaMDA’ or ‘Language Model for Dialogue Applications,’ at Google I/O 2021. The new model makes conversations more meaningful and alive.

The tech giant is looking to tap into the versatility of human interactions for open-ended yet purposeful dialogues. Remember in the movie, Her, how Theodore Twombly (Joaquin Phoenix) falls in love with Samantha, a perceptive voice assistant. 

Alphabet’s CEO Sunder Pichai said he spent some time with his son conversing with LaMDA (masqueraded as Pluto, the planet). It was magical as the model talked about the New Horizons spacecraft and the coldness of space, he said.

(Source: Google I/O)

Further, Pichai said LaMDA synthesized these concepts from its training data. He said none of the concepts were programmed or pre-defined. “LaMDA answered with sensible responses, keeping the dialogue open-ended,” he added, stating that no conversation takes the same path twice and the model can carry a conversation without retraining. 

How LaMDA works

In its blog post, Google said LaMDA’s conversational skills had been years in the making. The new language model has been built on Transformer — a neural network architecture open-sourced by Google Research in 2017— similar to many recent language models like BERT and GPT-3.

LaMDA’s natural conversation network (Source: Google)

In January 2020, Google first published a research paper about LaMDA, a transformer-based language model trained on dialogue that could learn to talk on any topic. Since theN, Google has been fine-tuning the model to improve the sensibleness and the specificity of its responses significantly. 

At Google I/O, the tech giant said its new language model still has some teething troubles. “Sometimes it can give nonsensical responses, imagining Pluto doing flips, or playing fetch with a favourite ball ‘the moon,” said Pichai.  

Further, he said Google has put a lot of effort to ensure LaMDA upholds high standards in terms of fairness, accuracy and privacy.

“From concept all the way to design, we are making sure it is developed consistent with our AI principles. We believe LaMDA’s natural conversation capabilities have the potential to make information and computing radically more accessible and easier to use,” Pichai added. 

He emphasised the need to integrate better conversational features into products like Google Assistant and Google Workspace. 

A still from the movie ‘Her’ 2013 (Source: sempeternal.tumblr.com)

The road ahead

Google said it is looking to explore ways to cater to the developers and enterprise customers. LaMDA is a huge step forward in the area of natural conversation.  

However, LaMDA is still trained only on text. It is yet to explore various formats, including images, audio and video. The question is, how is Google planning to integrate all this? Pichai said, using a multimodal model that amalgamates text, image, audio and video, Google can provide a single source of conversational AI across applications and tools like Google Maps, Youtube, etc. 

“All of this work has laid the foundation for complex models like LaMDA and multimodal. Our computational infrastructure is how we drive and sustain these advances, and tensor processing units (TPUs) are a big part of that,” said Pichai. 

Download our Mobile App

Amit Raja Naik
Amit Raja Naik is a seasoned technology journalist who covers everything from data science to machine learning and artificial intelligence for Analytics India Magazine, where he examines the trends, challenges, ideas, and transformations across the industry.

Subscribe to our newsletter

Join our editors every weekday evening as they steer you through the most significant news of the day.
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

Our Recent Stories

Our Upcoming Events

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox
How Generative AI is Revolutionising Data Science Tools

How Generative AI is Revolutionising Data Science Tools

Einblick Prompt enables users to create complete data workflows using natural language, accelerating various stages of data science and analytics. Einblick has effectively combined the capabilities of a Jupyter notebook with the user-friendliness of ChatGPT.