Key takeaways
- Facebook's AI researchers are advancing virtual assistants to enhance travel experiences using natural language.
- The new task, 'Talk The Walk', involves AI agents navigating real city streets through dialogue.
- This approach introduces realism to AI navigation, moving beyond traditional game-like environments.
- A guide agent uses a novel attention mechanism to effectively focus on relevant locations on a map.
Virtual assistants are going a long way to making our life easier. They find information for us, play songs for us and also make calls apart from many other daily activities. But the Facebook Artificial Intelligence Research (FAIR) centre is far from being satisfied. Researchers Douwe Keila, Jason Weston, Harm de Vries, Kurt Shuster, Dhruv Batra and Devi Parikh, want to take AI and virtual assistants to the next level. They want to use natural language to make travel more attractive.
Full comprehension of human language has been a difficult aim to achieve for some time now. The research team at FAIR are teaching the artificial intelligence systems to understand language by getting them to ‘guide’ virtual tourists around New York City. They have developed a new research task, called Talk The Walk, which explores this embodied AI approach while introducing a degree of realism not previously found in this area.




