Article complete

ElevenLabs Introduces Real-Time Streaming for Text-to-Speech, Offers Multilingual Experience Similar to Google's Bard

It enables users to listen to Large Language Model (LLM) responses as they're being crafted.

ElevenLabs logo displayed prominently on a white background.

Key takeaways

  • ElevenLabs has launched real-time input streaming for text-to-speech with impressive sub-1-second latency.
  • The eleven_multilingual_v1 model supports a variety of languages, enhancing the auditory experience for users.
  • Developers can easily integrate different voices and even clone their own voice with minimal coding.
  • ElevenLabs' features are similar to Google's Bard, which supports a wide range of languages for spoken output.
  • While ElevenLabs focuses on real-time streaming, ChatGPT currently lacks a built-in text-to-speech model.

Takeaways drafted with AI from the article text.

In a significant stride, ElevenLabs has unveiled a new feature - input streaming for generating speech in real-time with remarkable sub-1-second latency. This cutting-edge capability, available via the ElevenLabs platform, enables users to listen to Large Language Model (LLM) responses as they're being crafted.

https://twitter.com/elevenlabsio/status/1688638033980014592?t=PnDJLOSC5UqSr1rXPZYG6A&s=15

Elevating the experience further, ElevenLabs introduces the eleven_multilingual_v1 model, presenting an array of voices that breathe life into content. This model supports a diverse range of languages, including English, German, Polish, Spanish, Italian, French, Portuguese, and Hindi. 

With just a few lines of code, creators and developers can harness the richness of these voices, painting a captivating auditory landscape. In addition to this, you have the option to choose different voices and even clone your own voice.

Interestingly, the tool's features bear a resemblance to Google's Bard, a multilingual text-to-speech marvel. Bard's expansion to 40 new languages, including Arabic, Chinese, German, and Spanish, has broadened its global reach. 

Both ElevenLabs and Bard cater to a multilingual audience, offering spoken outputs across various languages.While Bard flaunts Google's efforts in nurturing it with extensive content to ensure accuracy, ElevenLabs opens doors to real-time text streaming, providing a dynamic and immediate auditory experience. 

Whether exploring pronunciation or simply relishing the auditory rendition, ElevenLabs and Bard create a symphony of linguistic possibilities for users worldwide.

Interestingly, ChatGPT from OpenAI lacks a built-in text-to-speech model, leaving a notable gap in its capabilities. It seems this is the one element yet to be included in OpenAI's toolkit. Perhaps a cue could be taken from ElevenLabs, which has introduced innovative features in the same arena. Unlike Whisper API, which facilitates speech-to-text, OpenAI hasn't rolled out a comparable API.

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

About the author

Tech Journalist

Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.