Article complete

DeepMind’s New AI Framework Helps Machines Understand Humans Better

The new framework uses reinforcement learning to build AI agents that can follow instructions, and safely perform actions in open-ended conditions

DeepMind’s New AI Framework Helps Machines Understand Humans Better

Key takeaways

  • DeepMind has introduced a new AI framework that enhances machines' ability to understand human instructions.
  • The framework addresses criticisms of existing AI systems that often lack situational understanding in language interpretation.
  • It enables AI agents to perform tasks in dynamic environments, moving beyond traditional win/loss scoring methods.
  • The agents can navigate, interact, search for information, and manipulate objects, simulating a child's playhouse environment.

Takeaways drafted with AI from the article text.

Existing AI frameworks have been at the receiving end of criticism for ignoring the situational understanding inherent to how humans use language. For example, DALL.E 2, the text-to-image generator, received a lot of flak for failing to understand the syntax of text prompts. So, for a simple input text like ‘a spoon on a cup’, the responses would include all images consisting of a spoon and a cup in the dataset, without really knowing the relationality between the spoon and cup in the text. 

To overcome this problem and build agents that can follow instructions and safely perform actions in open-ended conditions, the researchers at DeepMind created a new model within a video game environment.

The new framework will move away from training the AI agents, keeping a score based on wins/losses calculated by computer code used in applications like StarCraft and Dota. Instead, people will create tasks and score AI agents based on their behaviour. 

Although in its infancy, the new research paradigm develops real-time agents that can navigate, talk, interact with people, search for information, ask questions, control items, and do various other tasks.

The game is conceptualised based on a child’s “playhouse”, where both humans and agents have an avatar that can interact with each other and manipulate objects around. The framework is four-stepped. First, human-human interaction facilitates the ground for training initial agents by imitation learning. Then comes the cycle of human-agent interaction with performance judgement and optimisation of these judgements, which will improve agents based on reinforcement learning (RL). 

The new research is built on DeepMind’s previously published work demonstrating the role of imitation learning in creating AI agents that can capture the diversity of human behaviour well. In the new work, a reinforcement learning model is used to improve AI systems based on scores obtained via human evaluation.   

The framework has also been described as offering utility in building digital and robotic assistants—to create safe AI.

Published Updated

Corrections: AIM corrects errors of fact and notes the change on the story. Spotted one? Tell the editors. Read our editorial standards.

More in this story

DeepMind · 5 stories
  1. DeepMind Introduces TayPO, A Policy Optimisation Framework For RL Algorithm
  2. Behind DeepMind’s Framework That Discovers New Reinforcement Learning Algorithms
  3. DeepMind & Its Parent Company Google Are Betting Big On Reinforcement Learning
  4. DeepMind Trains AI Agents To Play Games Without Human Interaction Data
  5. You are here: DeepMind’s New AI Framework Helps Machines Understand Humans Better
About the author

Contributor

Ayush is interested in knowing how technology shapes and defines our culture, and our understanding of the world. He believes in exploring reality at the intersections of technology and art, science, and politics.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.