Now Developers Can Train GPT-3 On Their Data

A customised GPT-3 is capable of doing all the tasks that GPT-3 can, but better

OpenAI has launched tools to customise GPT-3. Developers can fine-tune GPT-3 on their data and create a customised version tailored to their application. Such customising will make GPT-3 reliable for wider use cases, and running the model becomes cheaper and faster.

OpenAI trained GPT-3 last year and has made it available in their API. With a few examples, GPT-3 can perform a variety of natural language tasks, a concept called few-shot learning or prompt design.

Just running a single command in the OpenAI command-line tool with a file will start training the custom model and make it available immediately in API. Developers can use an existing dataset of virtually any size and shape or incrementally add data based on user feedback. According to the company, customisation can help in increasing correct outputs from 83% to 95%.


Sign up for your weekly dose of what's up in emerging technology.

According to research by OpenAI, in less than 100 examples, the benefits of fine-tuning GPT-3 are visible, and the performance continues to improve as more data is added. A customised GPT-3 model with Grade School Math problems dataset improved accuracy by 2 to 4x over what’s possible with prompt design. Developers can improve the reliability of output and offer more consistent results by customising GPT-3.

As custom versions of GPT-3 are tailored to specific required applications, the prompt can be much short, with improved latency and reduced costs. Be it summarization, text generation, classification, or any other natural language task that GPT-3 is capable of performing; a customised GPT-3 will improve performance.

Some of the apps powered by customised versions of GPT-3 include Keeper Tax, Viable, Sana Labs, and Elicit. Keeper Tax adds 500 new training examples every week to fine-tune their model, which has led to an increase in accuracy from 85% to 93%. Viable shows better results, where with a customised version of GPT-3, accuracy in summarising customer feedback has improved from 66% to 90%.
OpenAI’s all API customers have access to customised GPT-3.

More Great AIM Stories

Meeta Ramnani
Meeta’s interest lies in finding out real practical applications of technology. At AIM, she writes stories that question the new inventions and the need to develop them. She believes that technology has and will continue to change the world very fast and that it is no more ‘cool’ to be ‘old-school’. If people don’t update themselves with the technology, they will surely be left behind.

Our Upcoming Events

Conference, in-person (Bangalore)
Machine Learning Developers Summit (MLDS) 2023
19-20th Jan, 2023

Conference, in-person (Bangalore)
Rising 2023 | Women in Tech Conference
16-17th Mar, 2023

Conference, in-person (Bangalore)
Data Engineering Summit (DES) 2023
27-28th Apr, 2023

Conference, in-person (Bangalore)
MachineCon 2023
23rd Jun, 2023

Conference, in-person (Bangalore)
Cypher 2023
20-22nd Sep, 2023

3 Ways to Join our Community

Whatsapp group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our newsletter

Get the latest updates from AIM