Article complete

OpenAI's o3 Wins Gold at International Olympiad in Informatics 2024

The research highlights that more training and test-time compute improves model performance, nearing top human levels.

OpenAI's o3 Wins Gold at International Olympiad in Informatics 2024

Key takeaways

  • OpenAI's o3 model achieved a gold medal at the 2024 International Olympiad in Informatics.
  • o3 scored 2724 on CodeForces, ranking in the 99.8th percentile among global programmers.
  • Research shows reinforcement learning outperforms traditional hand-crafted programming solutions.
  • Ethan Mollick emphasizes general-purpose models excel through enhanced reasoning capabilities.
  • OpenAI continues to evaluate its models in competitive programming and software engineering contexts.

Takeaways drafted with AI from the article text.

New research from OpenAI highlights the results of their reasoning models (o-series models) and how LLMs have evolved from amateur competitive programmers to competing with the world's best. 

OpenAI’s latest AI model, o3, earned an impressive 2724 rating on CodeForces, placing it in the 99.8th percentile. It also secured a gold medal-level score at the 2024 International Olympiad in Informatics (IOI).

According to the research, o3 outperforms the o1-ioi model, which is specifically fine-tuned for IOI. This proves that reinforcement learning is more effective than hand-crafted approaches.

At IOI 2024, o3 competed under standard conditions and crossed the gold medal threshold. On CodeForces, it ranked among the top 200 programmers globally, competing with elite human coders.

“General-purpose reasoning capabilities developed through reinforcement learning are now outperforming carefully hand-crafted, domain-specific solutions,” said Ethan Mollick, associate professor at The Wharton School. “Rather than building specialised systems for specific tasks, large, general-purpose models can achieve superior results through better reasoning abilities.”

The research is part of OpenAI’s ongoing efforts to assess its models’ performance in competitive programming and broader software engineering. 

The findings revealed that approximately 36% of all occupations incorporate AI for at least a quarter of their tasks. Moreover, 57% of AI applications enhance human capabilities, while 43% focus on automation. However, only 4% of occupations rely on AI for at least 75% of their tasks.

The study identified software development and technical writing as the primary areas where AI is utilised. In contrast, AI plays a minimal role in tasks that involve physical interaction with the environment.

Published

Corrections: AIM corrects errors of fact and notes the change on the story. Spotted one? Tell the editors. Read our editorial standards.

More in this story

OpenAI · 5 stories
  1. You are here: OpenAI's o3 Wins Gold at International Olympiad in Informatics 2024
  2. OpenAI Unveils GPT-4.1 Models in API Specifically for Coding
  3. Emergent Launches VibeCon India, Offers Winning Team Interview with YC
  4. Humyn Labs Highlights Multilingual AI Speech Recognition Gaps With New Benchmark Report
  5. Europe's Biggest Tech Startup Cuts AI Coding Costs by 90% Using Chinese Model
About the author

Contributor

I hold a degree in political science, and am interested in how AI and online culture intersect. I am at & x.com/aditisuresh12

All stories
Belamy · Daily

The day’s AI news, before your first meeting.