TWO Announces SUTRA Dual2L, a Multilingual AI Model Using Llama 3.1

TWO has announced SUTRA Dual2L, a new multilingual large language model (LLM) leveraging Llama 3.1. This model is designed to support over 50 languages, enhancing AI adoption across diverse markets.

SUTRA Dual2L uses TWO AI's dual-transformer (Dual2) architecture, which separates concept learning from language learning. This approach allows SUTRA to integrate state-of-the-art open-source models without retraining from scratch, improving efficiency and offering cost-effective, enterprise-ready solutions.

The Dual2L model enhances Llama 3.1's capabilities by expanding support to more languages, including Korean, Gujarati, Tamil, Malayalam, and Japanese, with a 5-10% improvement in multilingual performance for the 70B model. It also employs a multilingual tokenizer with a 256K vocabulary trained on a balanced dataset, reducing token consumption costs for non-English languages by 3-5 times.

SUTRA Dual2L aims to provide cost-effective multilingual AI solutions globally. The models will soon be available via API and in AI Enterprise Solutions for enterprise customers. Interested businesses can contact TWO for information on availability.

TWO AI  recently launched the SUTRA for Startups program, an initiative aimed at accelerating startups with access to its multilingual LLM-based services. The program will select 10 startups from India, Korea, Japan, or the Middle East to receive API access to SUTRA and 1 billion tokens for free.

The selected startups will leverage SUTRA's scalable and cost-efficient text-based models to develop solutions targeting global markets. This marks the first round of the SUTRA for Startups program, designed to foster innovation by providing affordable multilingual LLM capabilities to emerging companies.

Eligible startups must have existing LLM-based services and be headquartered in the specified regions. Applications are open until July 31, 2024, at 11:59 PM PST. Winners will be announced soon after the submission deadline.

Jio backed TWO AI recently announced the launch of SUTRA through its new AI app, ChatSUTRA, available at two.chat.ai. It  is now accessible via web and will soon be available on iOS and Android. 

The startup raised a $20M seed fund in February 2022 from Jio Platforms and South Korean internet conglomerate Naver. “Jio has been one of our key partners for a long time and has invested in us from the very beginning,” said Pranav Mistry, the founder of TWO, in an exclusive interaction with AIM. 

Another product from TWO is Geniya which can browse data from the internet using Google, rivalling Perplexity AI. Mistry said that Geniya is still in public beta and users can try it out, following the official launch soon.