Google unveils new AI model LaMDA, to aid natural conversations with machines

Google I/O 2021: Google unveils new AI model LaMDA, to aid natural conversations with machines

Google on dated 18-May-2021 unveiled its latest language breakthrough, the development of a conversational language model called LaMDA (Language Model for Dialogue Applications). Google discussed the new model during the keynote address at its I/O conference. Google says LaMDA, or Language Model for Dialogue Applications, can engage in a free-flowing way about a seemingly endless number of topics, an ability we think could unlock more natural ways of interacting with technology and entirely new categories of helpful applications
Like other recently-developed language models, including BERT and GPT-3, LaMDA is built on Transformer, the neural network architecture that Google Research invented and open-sourced in 2017.
However, unlike other language models, Google's LaMDA was trained on dialogue, teaching it how to engage in free-flowing conversations. This training taught LaMDA to deliver responses that not only make sense given the context but are specific.
Google is also exploring how to add dimensions to responses, such as "interestingness," which could include responses that are insightful, unexpected or witty. It's also working on ensuring that respones are factually correct and meet Google's AI principles.
Google says it has made a new leap in developing conversational artificial intelligence (AI) models, developing a system that can hold its own in natural conversations. The company announced LaMDA during the first day keynote of Google I/O, its yearly developer conference, last night. LaMDA stands for Language Model for Dialogue Applications and aims to replace robotic conversations with AI with more natural dialogues.
“Language is remarkably nuanced and adaptable. It can be literal or figurative, flowery or plain, inventive or informational. That versatility makes language one of humanity’s greatest tools — and one of computer science’s most difficult puzzles," the company said in a blog post. The company showed demos of how LaMDA works, though one could argue that Google’s choice of subjects in the demos somewhat undermined the system’s utility.
In essence, Google is saying it wants conversations with AI to feel more natural, which in turn would reduce the learning curve associated with interacting with such systems. Human conversations are natural, in the sense that we do not reply to a question like ‘hey, how are you’ with the same five responses. You could respond with ‘I’m fine, you?’, or change your response based on whom you’re speaking to, while the other person is capable of comprehending your tone, meaning etc. and response appropriately.
On the other hand, interactions with AI are narrow and limited, instead of free-flowing and open-ended like in real life. “That meandering quality can quickly stump modern conversational agents (commonly known as chatbots), which tend to follow narrow, pre-defined paths. But LaMDA — short for 'Language Model for Dialogue Applications' — can engage in a free-flowing way about a seemingly endless number of topics, an ability we think could unlock more natural ways of interacting with technology and entirely new categories of helpful applications," the company said.
While companies like Google have made significant improvements in this space, AI systems like the Google Assistant still lose the conversational thread far too often. Systems like LaMDA, GPT-3 and BERT are all designed to solve such problems. In fact, Google’s new system is based on the company’s Transformer neural networks, which it built and open sourced in 2017. BERT and GPT-3, too, use the same neural networks.
The utility of LaMDA of machine learning models like this is quite easy to understand as well. For instance, Google can make marked improvements in conversations users have with the Google Assistant (the company’s AI assistant) built into Android phones. More importantly, it could significantly improve how you interact with the Nest Smart Speakers, which are designed to be in-home assistants that work naturally.
Watch Google's AI LaMDA program talk to itself at length Source: Few websites, Wikipedia...