- Published on September 30, 2021
- In AI Features
Baidu Launches World’s Largest Dialogue Generation Model With 11 Billion Parameters
PLATO-XL is trained on a high-performance GPU cluster with 256 NVIDIA Tesla V100 32G GPU cards.
- By Amit Naik
Earlier this week, the Chinese internet giant Baidu released PLATO-XL, a pre-trained dialogue generation model with up to 11 billion parameters. It adopts the architecture of a unified transformer with high computation and parameter efficiency.
PLATO-XL carries out multi-party aware pre-training to better distinguish the characteristic information in social media conversation. As a result, it achieves superior performance compared to other approaches in both English and Chinese. Furthermore, PLATO-XL has effectively reduced the inconsistency phenomenon in multi-turn conversations, thanks to the multi-party aware pre-training.
Soon, the company plans to release the source code on GitHub. "We will release our source code together with the English model at GitHub, hoping to facilitate frontier research in dialogue generation," said Baidu researchers.
https://twitter.com/BaiduResearch/status/1442558874523824129
Language Models Vs Dialogue Generation Models&n
📣 Want to advertise in AIM? Book here
Amit Naik
Amit Raja Naik is Senior Editorial Producer – Live Shows at AIM Network, driving India’s most influential AI and technology conversations. He leads content, narrative design, and visual storytelling, engaging with leaders, innovators, and policymakers to advance how technology impacts businesses, governance, and society.
Related Posts
AI is Redrawing VC Rules as Investors Hedge Bets Against Rival Startups
As AI reshapes markets, VC firms like Sequoia Capital are backing rival startups, raising fresh questions.
Inside IAIRO, India’s ISRO for AI
IAIRO is trying to create an ecosystem in India with funded labs, strong mentors, ambitious peers, and a culture of
For 25 Years, Wikipedia Trained AI. Now it Wants Payback
Wikipedia’s partnerships with Microsoft, Meta, Perplexity, Mistral, and Amazon have ushered it into the AI era.
Global AI Summits, Big Promises, No Rules: Will India’s Be Any Different?
The previous global AI summits have delivered failed promises of self-regulation by Big Tech and voluntary agreements lacking teeth.
How Agentic AI is Redesigning Job Roles for Engineers
EY research shows that 62% of employees in India are already using AI regularly at work.
AI is Forcing the End of Unit Testing. Here’s What It Means for Engineering Talent
The cost of such failures is enormous, forcing teams to rethink how early and how holistically they test.
India’s Big Tech Governance, Unchecked Tech Optimism Alarm Policy Advisors
Policy advisors and civil society groups accuse Big Tech of serving corporate interests with a hawkish AI push.
Why Scrapping 10-min Delivery Doesn’t Give Gig Workers Much Relief
Quick commerce firms are scrapping 10-minute deliveries, but riders still chase incentives and face penalties.
Download the easiest way to
stay informed
stay informed
