- Published on June 20, 2023
- In AI Features
The Rise of Lame LLM Papers
Publishing false information for the sake of grabbing headlines is one of the new trends in LLM papers.
- By Mohit Pandey
A few months ago, AIM made GPT-4 take India’s toughest exam - UPSC. ChatGPT, powered by GPT-4, was able to crack the exam with 162.76 marks. We noted that by altering the inquiry, we could eventually prompt the model to generate accurate responses. However, in the experiment, we only considered the first responses from the bot.
Recently, a paper from MIT researchers named Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models was trending. The paper claimed that GPT-4 scored 100% on MIT’s EECS curriculum with a dataset of 4,550 questions and solutions. Sounded like a great feat before some researchers decided to dig deeper.
Raunak Chowdhari, Neil Deshmukh, and David Koplow from MIT EECS seniors decided to investigate the paper and were left disappointe
📣 Want to advertise in AIM? Book here
Mohit Pandey
Mohit writes about AI in simple, explainable, and often funny words. He's especially passionate about chatting with those building AI for Bharat, with the occasional detour into AGI.
Related Posts
Top 10 Companies That Crowned Hyderabad as India’s Greenfield GCC Leader in 2025
Telangana has attracted over 75 greenfield GCCs in 2025, compared with 40-plus in Karnataka.
The AI Coding Gold Rush Ends Where Harness Begins
“Only 30% of software engineering happens on the laptop. The real 70% starts after you commit the code,” says Jyoti
How Gradient-Boosting is Quietly Powering India’s Research Push
From groundwater and slopes to carbon sinks, tools like CatBoost are enabling Indian scientists to extract insights and drive sustainability.
India’s Data Centre Boom Is Running Into a Talent Wall
With capacity expected to more than double this decade, the industry is investing in training as graduates struggle to meet
This Firm Wants to be the ‘Next Big Disruptor’ in Networking
Arrcus positions itself as a horizontal software layer that can run across different types of networking hardware.
Will 2026 be the year of AI IPOs?
With CoreWeave’s listing and Fractal Analytics going for an IPO, an array of AI companies are now looking to raise
Fighting Deepfakes May Not Be a Technology Problem
Defenders must be active at all times, while attackers need only one opportunity.
India’s Data Centre Expansion Is Decentralising
Without compute buildup beyond metros, the next wave of digital adoption will be constrained
Download the easiest way to
stay informed
stay informed
