OpenAI Launches Classifier to Tackle Misuse of AI-Generated Content

The AI classifier can distinguish between text written by a human and text written by AIs from a variety of providers.

In a move that makes AI detector tools redundant, OpenAI yesterday announced that it has trained a classifier, alongside launching AI Text Classifier to distinguish between text written by a human and text written by AIs from a variety of providers.

Citing automated misinformation campaigns, OpenAI said while it is impossible to reliably detect all AI-written text, it believes that classifiers can inform mitigations for false claims that AI-generated text was written by a human. 

Compared to its previously released classifier, this new classifier by OpenAI is significantly more reliable on text from more recent AI systems. The company has made this publicly available to get feedback, checking if tools like this are useful. 

AIM Daily XO

Join our editors every weekday evening as they steer you through the most significant news of the day, introduce you to fresh perspectives, and provide unexpected moments of joy
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

Check out the AI Text Classifier here.

AI Text Classifier

Download our Mobile App

AI Text Classifier is a fine-tuned GPT model that predicts how likely it is that a piece of text was generated by AI from a variety of sources, including ChatGPT and alike. OpenAI said that this classifier is available as a tool to spark discussions on AI literacy. 

Limitations of AI Text Classifier

  • A minimum of 1,000 characters are needed for the classifier to run, which is roughly 150–250 words.
  • The classifier isn’t always accurate; it’s capable of mislabeling AI as well as human-written texts.
  • Editing AI-generated content is simple and can be used to manipulate the classifier.
  • Since it was mostly trained on English content created by adults, the classifier is likely to make mistakes when dealing with text written by non-English texts and kids.
  • Text that is very universal and predictable cannot be reliably identified like the first five alphabets will be the same. 
  • Neural network-based classifiers perform poorly when used outside of training data. OpenAI said that the classifier can occasionally be very certain that a false prediction will be made for inputs that are substantially different to the text in our training set.

We tried the AI Classifier with an essay generated by ChatGPT and here is the result.

The classifier does not assert that the text is generated by AI but agrees that it ‘possibly‘ is.

ChatGPT Ban 

This comes in the backdrop of multiple schools and educational institutions raising concerns about students using ChatGPT for answers. ChatGPT has drawn flacks of educational institutions across the world as it can easily write essays, codes, scripts, and poetry and prose of all kinds. Considering the backlash, OpenAI has developed a preliminary resource on the use of ChatGPT for educators, which outlines some of the uses and associated limitations and considerations. OpenAI is working with US schools to find solutions for the problem.

Sign up for The Deep Learning Podcast

by Vijayalakshmi Anandan

The Deep Learning Curve is a technology-based podcast hosted by Vijayalakshmi Anandan - Video Presenter and Podcaster at Analytics India Magazine. This podcast is the narrator's journey of curiosity and discovery in the world of technology.

Analytics India Magazine
Analytics India Magazine chronicles technological progress in the space of analytics, artificial intelligence, data science & big data by highlighting the innovations, players, and challenges shaping the future of India through promotion and discussion of ideas and thoughts by smart, ardent, action-oriented individuals who want to change the world.

Our Upcoming Events

27-28th Apr, 2023 I Bangalore
Data Engineering Summit (DES) 2023

23 Jun, 2023 | Bangalore
MachineCon India 2023

21 Jul, 2023 | New York
MachineCon USA 2023

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox