Article complete

Agora Partners with Beken and Robopoet to Launch ConvoAI Device Kit

Real-time voice processing and emotional AI make human-machine interaction more engaging.

Logo of Agora alongside a microphone and a studio microphone against a light background.

Key takeaways

  • Agora launches ConvoAI Device Kit for enhanced real-time voice interactions in smart devices.
  • Collaborates with Beken and Robopoet to enable engaging AI-driven toys and robots.
  • Utilizes emotional AI for natural, adaptive learning and personalized user interactions.
  • Supports diverse applications, including educational toys, smart home devices, and wearables.
  • Addresses challenges in conversational AI, such as latency and background noise.

Takeaways drafted with AI from the article text.

Agora has launched the ConvoAI Device Kit, a new solution designed to enhance real-time, AI-powered voice interactions in smart devices. 

Developed in collaboration with chip-maker Beken, the toolkit aims to power interactive toys, robots, and IoT devices with ultra-low latency voice processing and intelligent dialogue capabilities.

"Conversational AI is key to making robots and AI-driven toys truly interactive, engaging, and intuitive," said Tony Zhao, CEO of Agora. 

"By integrating Agora’s technology into Beken’s chips, IoT toymakers like Robopoet will transform entertainment, education, and emotional support by enabling more natural conversations, adaptive learning, and personalised interactions that evolve with the user over time."

The ConvoAI Device Kit is already being used in Robopoet’s AI companion robot, Fuzzoo, unveiled at Mobile World Congress (MWC). Fuzzoo leverages Agora’s technology to deliver real-time emotional engagement through multimodal interactions.

"Agora’s AI technology enables toys and robots to interact in a way that feels natural and engaging," said Yuna Pan, Co-Founder and CTO of Robopoet. "With real-time voice processing, emotional AI, and advanced speech capabilities, Agora makes seamless human-machine interaction possible and ensures exceptional performance and reliability."

The solution supports a wide range of applications, from educational AI toys and smart home devices to AI-powered wearables. Pengfei Zhang, CEO of Beken, highlighted the collaboration’s impact, stating, "With Agora’s conversational AI technology and our optimised AI hardware, we’re enabling the next generation of devices to think, respond, and interact naturally."

Agora’s AI technology addresses key challenges in on-device conversational AI, such as background noise, latency issues, and rigid AI models. By integrating real-time speech synthesis and intelligent interruption handling, Agora is paving the way for more fluid and human-like interactions in smart devices.

Earlier this week, Agora launched its Conversational AI engines, enabling developers to create interactive voice experiences with any AI model. These conversational engines are designed to provide ultra-low latency responses and superior voice processing capabilities while allowing real-time interruptions for a more natural dialogue experience.

Published

Corrections: AIM corrects errors of fact and notes the change on the story. Spotted one? Tell the editors. Read our editorial standards.

More in this story

Agora · 4 stories
  1. Why Agora Bets on Golang for Real-Time AI
  2. Agora, Exotel Partner to Deliver Real-Time AI Voice Bots for Enterprises
  3. You are here: Agora Partners with Beken and Robopoet to Launch ConvoAI Device Kit
  4. Agora Taps IIT-Kharagpur Alum's Startup Murf AI to Enable Real-Time Voice Agents
About the author

Associate Technology Journalist

All stories
Belamy · Daily

The day’s AI news, before your first meeting.