Advertisement

After GPTZero, Turnitin is Developing Tool to Identify AI-Generated Text

Listen to this story

A few weeks back, Analytics India Magazine did a story, ‘Will AI-plagiarism Tools Burst the ChatGPT Bubble?’ predicting that AI plagiarism detectors will have a bigger market than ChatGPT itself. Now, anti-plagiarism software Turnitin, largely used by thousands of universities and schools across the globe, is in the process of building a tool to detect text generated by AI.

The tool has been in the making since the release of GPT-3. 

“Turnitin hopes to launch its software in the first half of this year. It will be pretty basic detection at first, and then we’ll throw out subsequent quick releases that will create a more actionable workflow for teachers. After that, the plan is to make the prototype free for its existing customers as the company collects data and user feedback,” said Annie Chechitelli, chief product officer, Turnitin in an interaction with The Register.

THE BELAMY

Sign up for your weekly dose of what's up in emerging technology.

Established in 1998, Turnitin produces software that calculates the similarity of a specific essay when compared with content from a large database of webpages and books to spot signs of plagiarism.

The firm was acquired by media giant Advanced Publications for $1.75 billion in 2019. Today its software has been used by 15,000 institutions across 140 countries. 


Download our Mobile App



How it works? 

While AI-produced content may seem pretty convincing, there are some standout patterns that can reveal the hand of an algorithm. Among these signs is writing that will look bland and unoriginal and does not have a distinct voice. Recently, tech news site CNET was in the news for publishing AI generated content that was riddled with errors.

And machines can be easily trained to detect these patterns effectively. “Though AI writing may feel human-like to us, machines write using a fundamentally different mechanism. It picks the most probable word in the most probable location, and that’s a very different way of constructing language compared to humans,” said Eric Wang, VP of AI at Turnitin. 

He further said that Turnitin’s plagiarism detector predicts what words AI is more likely to generate in a given text snippet. It’s very bland, statistically. Humans don’t tend to consistently use a high probability word in high probability places, but GPT-3 does — so Turnitin’s plagiarism detector cues in on that.

What is interesting to note is that Turnitin’s detector is built using the same architecture as that of GPT-3 and can be perceived as a miniature version of the model. It uses a detection component instead of a generating component

Jan Leike, ML Researcher at OpenAI had earlier said that “The path I’m very excited for is using models like ChatGPT to assist humans at evaluating other AI systems.” OpenAI has already been working in that direction, like in the paper, ‘Self-critiquing models for assisting human evaluators ‘.

We can already see this happening in the case of Turnitin’s AI plagiarism detector tool which was  built based on the same architecture as GPT-3.

GPTZero

Besides Turnitin, Edward Tian, a Princeton student, alongside Sreejan Kumar, developed GPTZero, a tool that prompts when a particular text is written by ChatGPT and other generative AI engines. 

The app processes submitted text for indicators of AI origins like randomness and complexity in how it is written, technically referred to as “perplexity and burstiness”. In his Twitter thread, Tian tested GPTZero on various posts published by companies on various social media platforms like Linkedin and Twitter, to check its effectiveness. 

However, the app does not have enough data to measure accuracy yet, but it is a good start, as it is still a work in progress. The duo looks to publish a paper soon.

More Great AIM Stories

Aparna Iyer
Aparna Iyer has covered various sectors spanning education, wildlife, culture and law for close to a decade. She now writes on technology and is keen to unearth its capability for public good.

AIM Upcoming Events

Regular Passes expire on 3rd Mar

Conference, in-person (Bangalore)
Rising 2023 | Women in Tech Conference
16-17th Mar, 2023

Early Bird Passes expire on 17th Feb

Conference, in-person (Bangalore)
Data Engineering Summit (DES) 2023
27-28th Apr, 2023

Conference, Virtual
Deep Learning DevCon 2023
27 May, 2023

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox
AIM TOP STORIES

A beginner’s guide to image processing using NumPy

Since images can also be considered as made up of arrays, we can use NumPy for performing different image processing tasks as well from scratch. In this article, we will learn about the image processing tasks that can be performed only using NumPy.

RIP Google Stadia: What went wrong?

Google has “deprioritised” the Stadia game streaming platform and wants to offer its Stadia technology to select partners in a new service called “Google Stream”.