Researcher from Upwork Releases Nandi, Gemma-based Telugu Model

Another Telugu model is here, it’s called Nandi. Built on top of Zephyr-7b-Gemma, the model boasts 7 billion parameters and is trained on Telugu Q&A data sets curated  by Telugu LLM Labs.

Click here to check out the model.

Bharadwaj Swarna, a freelance senior data scientist, got inspired by the pioneering work of Ramsri Goutham Golla and Ravi Theja Desetty of Telugu LLM Labs and created this model. 

You can prompt the model in both English and Telugu.

Swarna’s future endeavours include the expansion of datasets for Data Preference Optimisation (DPO) in Telugu, a significant area that remains largely unexplored.

Additionally, efforts will be directed towards refining the Tokenizer based on insights gleaned from the video series released by the Telugu LLM Labs team.

There has been a rise in Indic language models coming from the developer community of India. For example, Telugu Llama is a passion project for both Golla and Theja. In February, they introduced Telugu-LLM-Labs, a collaborative independent effort where they released datasets translated and romanised in Telugu. 

The company has also announced the release of Navarasa 2.0, a Gemma 7B/2B instruction-tuned model capable of processing content in 15 Indian languages along with English. This latest iteration marks a significant advancement following the recent introduction of fine-tuned Gemma models for nine Indian languages.