- Published on January 25, 2023
- In Global Tech
Time for OpenAI to Open Source Toxicity Detection?
Open-sourcing toxicity filtering models would bring huge social benefits and help all open-source LLMs become less toxic
- By Pritam Bordoloi
If you have followed the AI space closely over the past few years, you would have encountered many instances where AI took violent, sexist and racist barbs at people. This happens because most of the data used to train these AI models is sourced from the web, and often has toxic content.
Take for instance GPT-4Chan, where YouTuber Yannic Kilchner created an AI chatbot and trained it on three years’ worth of posts from 4chan, the repulsive cousin of Reddit. Kilchner fed the bot threads from the politically incorrect /pol/board, a 4chan message board notorious for racist, xenophobic, and hateful content. Obviously, the chatbot spewed unparliamentary content as a result.
Hence, it gets crucial to remove toxicity from AI models.
OpenAI, the company behind ChatGPT, has mana
📣 Want to advertise in AIM? Book here
Pritam Bordoloi
I have a keen interest in creative writing and artificial intelligence. As a journalist, I deep dive into the world of technology and analyse how it’s restructuring business models and reshaping society.
Related Posts
Building an AI Economy That Includes Everyone
“What we’re seeing is that accessibility-driven design often solves a broader problem. It’s not charity. It’s engineering.”
Top 10 Companies That Crowned Hyderabad as India’s Greenfield GCC Leader in 2025
Telangana has attracted over 75 greenfield GCCs in 2025, compared with 40-plus in Karnataka.
The AI Coding Gold Rush Ends Where Harness Begins
“Only 30% of software engineering happens on the laptop. The real 70% starts after you commit the code,” says Jyoti
How Gradient-Boosting is Quietly Powering India’s Research Push
From groundwater and slopes to carbon sinks, tools like CatBoost are enabling Indian scientists to extract insights and drive sustainability.
India’s Data Centre Boom Is Running Into a Talent Wall
With capacity expected to more than double this decade, the industry is investing in training as graduates struggle to meet
This Firm Wants to be the ‘Next Big Disruptor’ in Networking
Arrcus positions itself as a horizontal software layer that can run across different types of networking hardware.
Will 2026 be the year of AI IPOs?
With CoreWeave’s listing and Fractal Analytics going for an IPO, an array of AI companies are now looking to raise
Fighting Deepfakes May Not Be a Technology Problem
Defenders must be active at all times, while attackers need only one opportunity.
Download the easiest way to
stay informed
stay informed
