Article complete

Inflection AI Unveils Inflection-2.5, Achieves GPT-4 and Gemini Level Performance

Inflection-2.5 is available to all Pi's users today, at pi.ai, on iOS, on Android, and via the new desktop app.

The text "Inflection" displayed in a stylized font with wavy lines on a light background.

Key takeaways

  • Launch Inflection-2.5, a model rivaling GPT-4 and Gemini, focusing on coding and mathematics.
  • Achieve 94% of GPT-4's performance while using only 40% of the computing resources.
  • Improve over 10% on BIG-Bench-Hard and excel in coding benchmarks compared to Inflection-1.
  • Make Inflection-2.5 available to all Pi users across iOS, Android, and desktop platforms.
  • Highlight significant advancements in intellectual capabilities and performance metrics for large language models.

Takeaways drafted with AI from the article text.

Inflection-2.5 is available to all Pi's users today, at pi.ai, on iOS, on Android, and via the new desktop app.

Inflection AI's previous model, Inflection-1, utilized about 4% of the training FLOPs of GPT-4 and exhibited an average performance of around 72% compared to GPT-4 across various IQ-oriented tasks.

Inflection-2.5, now driving Pi, brings a substantial boost to Pi's intellectual capabilities (IQ), with a focus on coding and mathematics. The model's performance on key industry benchmarks demonstrates its prowess, showcasing over 94% of GPT-4's average performance across various tasks, especially excelling in STEM areas.

Inflection-2.5 shines in coding and mathematics, demonstrating over a 10% improvement on Inflection-1 on BIG-Bench-Hard, a subset of challenging problems for large language models. Two coding benchmarks, MBPP+ and HumanEval+, reveal massive improvements over Inflection-1, solidifying its position as a force to be reckoned with.

Inflection-2.5 stands out in industry benchmarks, showcasing substantial improvements over Inflection-1 on the MMLU benchmark and the GPQA Diamond benchmark, renowned for its expert-level difficulty. 

The model's prowess extends to STEM examinations, with standout performance on the Hungarian Math exam and Physics GRE, where it reaches the 85th percentile of human test-takers in maj@8.

Inflection-2.5 not only upholds Pi's signature personality and safety standards but elevates its status as a versatile and invaluable personal AI across diverse topics. From discussing current events to seeking local recommendations, studying for exams, coding, and even casual conversations, Pi powered by Inflection-2.5 promises an enriched user experience.

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

Inflection AI · 5 stories
  1. Just months old, Inflection AI raises USD 225 million in equity financing: Reports
  2. OpenAI Rival Inflection AI Unveils Most Friendly Chatbot Ever
  3. Stanford as a Service
  4. Google DeepMind Alumni Shine As Startup Founders
  5. You are here: Inflection AI Unveils Inflection-2.5, Achieves GPT-4 and Gemini Level Performance
About the author

Tech Journalist

Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.