Article complete

Much Awaited Breakthrough in LLMs Has Finally Arrived

The reign of DIY chatbots is set to begin, thanks to Hugging Face.

Bowling pins scattered across a lane, featuring a logo, with a smiling emoji in the foreground.

Key takeaways

  • Hugging Face is leading advancements in open-source AI, enabling DIY chatbots for developers and businesses.
  • The integration of Transformer Reinforcement Learning with Parameter-Efficient Fine-Tuning allows large language models to be fine-tuned on consumer-grade GPUs.
  • Colossal-AI offers a method for creating personal chatbots with significantly lower resource requirements, enhancing accessibility for users.

Takeaways drafted with AI from the article text.

Every AI company would say that they want to build something like ChatGPT. After the release of the OpenAI's API, the chatbot can now be integrated into business for building products. This has been helpful for a lot of developers and companies. But even then, building such a technology from scratch is a far off game as it requires a lot of resources. But things have changed now!

Similarly, Colossal-AI had also taken up the herculean task and found a way to build one’s own ‘personal ChatGPT’ on less computing resources, as small as a GPU of only 1.62 GB of memory. Their implementation was based on PyTorch that covered all three stages—pre training, reward model training, and reinforcement learning. The speed was even faster by 10.3 times with 8 billion parameters on a single GPU, which is much larger while being cheaper than a $14,999 A100 80GB GPU. 

These achievements are significant because they solve one of the most significant barriers to entry in the generative AI space: Computational resources. There is no doubt by now that building an LLM or chatbot with billions of parameters is a high-computation task. As a result, only the biggest tech companies in the world have been able to do so until now and even they fail in replicating what OpenAI did. 

But with these models, small- and medium-sized businesses can build their own language models without spending a fortune on computational resources. Now the ball is in everyone else’s court. Anyone can try it out on their own device. Who knows? Someone might actually beat OpenAI at their own game!

ChatGPT Who?

The era of being dependent on OpenAI, or any other big-tech, is coming to an end and the reign of DIY chatbots is set to begin. 

Until now, companies looking to implement AI chatbots have relied on third-party providers which are now offering pre-trained models like ChatGPT through APIs. However, with Hugging Face's latest development, this could all change. Companies, or even developers, will now have the ability to build their own chatbots with similar capabilities, including their own weights and biases, if required. 

This means, for starters, the company can tailor the chatbot to its specific needs rather than relying on a generic pre-trained model. A custom chatbot can understand the nuances of the company's industry and can be trained to respond to specific queries and concerns that are relevant to the company. This level of customisation is impossible with third-party chatbots.

Another benefit of building a chatbot in-house is that the company can retain full control over the data that the chatbot collects. Third-party chatbot providers are notorious for collecting data from conversations and using it for their own purposes. This data can be highly sensitive and companies may not want to risk it falling into the wrong hands. 

What This Means for Big-Tech

Colossal-AI’s offering was more developer-focused. On the other hand, Hugging Face’s step shows more promise. Hugging Face recognises two limitations in their approach. One is that the training speed is still slower and the other is the challenge of how users are to expand it to multiple GPUs for data parallelism. But this is just the first step, hopefully. 

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

Big Tech · 4 stories
  1. You are here: Much Awaited Breakthrough in LLMs Has Finally Arrived
  2. The Battle for AI Supremacy Begins
  3. LLMs are an Ethical Nightmare 
  4. Marc Benioff Says He's Not Returning to ChatGPT After Using Gemini 3 for 2 Hours
About the author

Journalist

Mohit writes about AI in simple, explainable, and often funny words. He's especially passionate about chatting with those building AI for Bharat, with the occasional detour into AGI.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.