Article complete

AI4Bharat Builds 4,000-Test Benchmark, Finds AI Judges Fail Half the Time

AI4Bharat has created FOCUS, a benchmark designed to measure how well evaluator VLMs detect mistakes across both image-to-text (I2T) and text-to-image (T2I) tasks.

An orange background with a stylized elephant logo at the center, surrounded by silhouettes of people and buildings.

Key takeaways

  • AI4Bharat developed FOCUS, a benchmark to assess the accuracy of vision-language models in evaluating AI outputs.
  • Evaluator VLMs, often used as 'AI judges', showed a significant failure rate in identifying mistakes, missing issues over half the time.
  • The benchmark includes over 4,000 test cases and examines both image-to-text and text-to-image tasks.
  • Current models performed worse in text-to-image evaluations compared to image-to-text tasks, raising concerns about their reliability.
  • The research highlights the need for improved evaluation methods in AI to ensure trustworthiness.

Takeaways drafted with AI from the article text.

Researchers from AI4Bharat at IIT Madras and BITS Pilani Hyderabad have developed a new benchmark called FOCUS to test how reliably vision-language models (VLMs) evaluate the outputs of other AI models.

The research paper, titled “Seeing Isn’t Believing: Uncovering Blind Spots in Evaluator Vision-Language Models,” has been accepted at the Conference on Language Modeling (COLM) 2026.

Vision-language models are increasingly being used as “AI judges” to evaluate tasks such as image captioning, visual question answering, and text-to-image generation. However, the researchers questioned whether these evaluator models are accurate enough to be trusted on their own.

To investigate this, the team created FOCUS, a benchmark designed to measure how well evaluator VLMs detect mistakes across both image-to-text (I2T) and text-to-image (T2I) tasks.

The benchmark contains more than 4,000 carefully designed test cases covering 40 different types of perturbations, or intentional changes that reduce output quality. These examples were created through a human-in-the-loop process and validated by expert annotators.

Using FOCUS, the researchers evaluated several frontier vision-language models across three commonly used evaluation methods while testing different prompting strategies.

The study found that current evaluator VLMs often fail to identify degraded outputs. In some cases, the models missed quality issues in more than 50% of the test samples. Their performance was particularly weaker when evaluating text-to-image generation compared to image-to-text tasks.

According to the researchers, these findings suggest that AI models should not yet be relied upon as standalone evaluators for benchmarking or training other AI systems.

Instead, they recommend using human oversight alongside AI evaluation and treating automated evaluation scores with caution until more reliable systems are developed.

Along with the paper, the researchers have also open-sourced the FOCUS dataset and codebase to help the broader AI community study and improve evaluator vision-language models.

The work was led by Mohammed Safi Ur Rahman Khan, Sanjay Suryanarayanan, Tushar Anand, and Mitesh Khapra, with affiliations to AI4Bharat at IIT Madras and BITS Pilani Hyderabad.

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

AI in India · 5 stories
  1. Freshworks Turns Profitable on the Back of AI Discipline, Shrinking Costs
  2. Can AI Make India’s Roads Safer?
  3. Xebia Partners with NVIDIA, Anthropic to Scale Enterprise AI
  4. Deloitte India Launches AI-Led SAP Delivery Centre in Bengaluru, Plans to Hire Up to 500 AI Specialists
  5. You are here: AI4Bharat Builds 4,000-Test Benchmark, Finds AI Judges Fail Half the Time
About the author

Journalist

Prachi is a Bengaluru-based journalist who writes on AI trends and the startup ecosystem.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.