Article complete

Hume AI Launches EVI, an Emotionally Intelligent Voice AI, as iOS App Powered by Claude 3.5 Sonnet

EVI can understand 53 different human emotions, including amusement, anger, confusion, and even deceit.

A stylized mouth is shown against a bright yellow background, with speech bubbles emerging in various colors.

Key takeaways

  • Launch EVI, an AI voice app, capable of understanding 53 human emotions.
  • Integrate Kora, a new AI voice, powered by Claude 3.5 Sonnet for improved interactions.
  • Utilize EVI API for developers, supporting multiple AI models including OpenAI and Anthropic.
  • Leverage extensive research on 'vocal bursts' to enhance emotional recognition capabilities.
  • Plan to expand EVI's features to include facial expression recognition for deeper emotional understanding.

Takeaways drafted with AI from the article text.

https://twitter.com/hume_ai/status/1803854136389308495?t=lSn-YIbBVpDzXCIn0meOAg&s=03

The model promises enhanced user interaction by understanding and responding to human emotions.

Developed by top emotion scientists and AI researchers at Hume AI, EVI is the first AI designed to understand and emulate human emotions. 

EVI can understand 53 different human emotions, including amusement, anger, confusion, and even deceit. The AI's empathic large language model (eLLM) is adept at interpreting tones of voice, word emphasis, and non-verbal cues to optimise interactions.

The new voice, Kora, is also available to developers through the EVI API, which currently supports Anthropic, OpenAI, and open-source language models, with plans to add Google model support soon. Developers can start building their applications and join EVI’s Discord for updates.

The emotional intelligence of EVI stems from Hume AI’s extensive research into 'vocal bursts'—non-verbal sounds that convey emotions. Hume AI has collected thousands of audio clips from over 16,000 individuals across the United States, China, India, South Africa, and Venezuela to decode the emotional meanings of these sounds.

Looking ahead, Hume AI plans to expand EVI’s capabilities to recognise facial expressions globally, enhancing the model’s understanding of user emotions through facial cues. 

“What we’ve done at Hume is build models that understand expressions a lot better and we’ve integrated those into large language models,” said Hume AI chief Alan Cowen. “These models understand beyond language—what’s going on in the voice, what’s going on in facial expression… and it can learn from that.”

Last month, OpenAI announced its latest model, GPT-4o, which also has voice capabilities that let users ask it to sing, talk faster, use different voices, and speak various languages. This feature will be available to users in the coming months.

Published Updated

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

Intelligent Agent · 5 stories
  1. Sony to Release First Intelligent Vision Sensors with AI Processing Functionality
  2. Google announces general availability of Dataplex, an intelligent data fabric
  3. Intelligent workforce platform Observe.ai raises USD 125 Mn in Series C
  4. You are here: Hume AI Launches EVI, an Emotionally Intelligent Voice AI, as iOS App Powered by Claude 3.5 Sonnet
  5. Hume AI’s Latest Voice-to-Voice Model EVI 2 for Human-Like Conversations Makes OpenAI’s GPT-4o Sweat
About the author

Tech Journalist

Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.