Now Developers Can Train GPT-3 On Their Data

A customised GPT-3 is capable of doing all the tasks that GPT-3 can, but better

OpenAI has launched tools to customise GPT-3. Developers can fine-tune GPT-3 on their data and create a customised version tailored to their application. Such customising will make GPT-3 reliable for wider use cases, and running the model becomes cheaper and faster.

OpenAI trained GPT-3 last year and has made it available in their API. With a few examples, GPT-3 can perform a variety of natural language tasks, a concept called few-shot learning or prompt design.

Just running a single command in the OpenAI command-line tool with a file will start training the custom model and make it available immediately in API. Developers can use an existing dataset of virtually any size and shape or incrementally add data based on user feedback. According to the company, customisation can help in increasing correct outputs from 83% to 95%.

Subscribe to our Newsletter

Join our editors every weekday evening as they steer you through the most significant news of the day, introduce you to fresh perspectives, and provide unexpected moments of joy
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

According to research by OpenAI, in less than 100 examples, the benefits of fine-tuning GPT-3 are visible, and the performance continues to improve as more data is added. A customised GPT-3 model with Grade School Math problems dataset improved accuracy by 2 to 4x over what’s possible with prompt design. Developers can improve the reliability of output and offer more consistent results by customising GPT-3.

As custom versions of GPT-3 are tailored to specific required applications, the prompt can be much short, with improved latency and reduced costs. Be it summarization, text generation, classification, or any other natural language task that GPT-3 is capable of performing; a customised GPT-3 will improve performance.

Some of the apps powered by customised versions of GPT-3 include Keeper Tax, Viable, Sana Labs, and Elicit. Keeper Tax adds 500 new training examples every week to fine-tune their model, which has led to an increase in accuracy from 85% to 93%. Viable shows better results, where with a customised version of GPT-3, accuracy in summarising customer feedback has improved from 66% to 90%.
OpenAI’s all API customers have access to customised GPT-3.

Meeta Ramnani
Meeta’s interest lies in finding out real practical applications of technology. At AIM, she writes stories that question the new inventions and the need to develop them. She believes that technology has and will continue to change the world very fast and that it is no more ‘cool’ to be ‘old-school’. If people don’t update themselves with the technology, they will surely be left behind.

Download our Mobile App

MachineHack | AI Hackathons, Coding & Learning

Host Hackathons & Recruit Great Data Talent!

AIMResearch Pioneering advanced AI market research

With a decade of experience under our belt, we are transforming how businesses use AI & data-driven insights to succeed.

The Gold Standard for Recognizing Excellence in Data Science and Tech Workplaces

With Best Firm Certification, you can effortlessly delve into the minds of your employees, unveil invaluable perspectives, and gain distinguished acclaim for fostering an exceptional company culture.

AIM Leaders Council

World’s Biggest Community Exclusively For Senior Executives In Data Science And Analytics.

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox