- Published on December 13, 2023
- In Deep Tech
Indian Startup Sarvam AI Launches Hindi LLM, OpenHathi
The model demonstrates robust performance across various Hindi tasks, comparable to, if not surpassing, GPT-3.5.
- By Siddharth Jindal
Indian AI startup Sarvam AI has released OpenHathi-Hi-v0.1, the first Hindi LLM in the OpenHathi series. Developed on a budget-friendly platform, the model, an extension of Llama2-7B, boasts GPT-3.5-like performance for Indic languages.
OpenHathi, featuring a 48K-token extension of Llama2-7B’s tokenizer, underwent a two-phase training process. The first phase focused on embedding alignment, where Hindi embeddings were randomly initialized and aligned, followed by bilingual language modelling to teach the model cross-lingual attention across tokens.
https://youtu.be/WKfVzJSDAd8
The model demonstrates robust performance across various Hindi tasks, comparable to, if not surpassing, GPT-3.5, while maintaining English proficiency. Sarvam AI's evaluation includes non-academic, real-
📣 Want to advertise in AIM? Book here
Siddharth Jindal
Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.
Related Posts
Will 2026 be the year of AI IPOs?
With CoreWeave’s listing in the US and Fractal Analytics poised to become the first AI pure-play Indian company to go
Fighting Deepfakes May Not Be a Technology Problem
Defenders must be active at all times, while attackers need only one opportunity.
India’s Data Centre Expansion Is Decentralising
Without compute buildup beyond metros, the next wave of digital adoption will be constrained
How Mumbai Keeps Winning India’s Data-Centre Race
Land prices are among the highest in the country, but total build economics remain competitive by global standards.
From Shortages to Scale, io.net’s Approach to Rewriting AI Compute Access
A decentralised GPU marketplace may scale AI compute faster than traditional clouds, as GPU demand towers over supply
Why Deloitte Built a Tax AI That Knows When to Say ‘I Don’t Know’
The company has launched an agentic AI platform for tax research that’s targeting something radical in a conservative profession.
Can India’s AI Copyright Plan Survive Legal and Technical Scrutiny?
India’s ambitious proposal for a single mandatory AI training licence faces feasibility, legal and innovation concerns.
2026 Could be India’s Year in AI, But Only the Resilient Will Survive
“This isn’t a freeze. It’s a filter… By 2026, the real signal will be resilience, not rhetoric.”
Download the easiest way to
stay informed
stay informed
