Inflection AI Unveils Inflection-2.5, Achieves GPT-4 and Gemini Level Performance

Inflection AI has recently launched Inflection-2.5, a model that competes with all the world's leading LLMs, including GPT-4 and Gemini. Inflection-2.5 approaches the performance level of GPT-4 but utilizes only 40% of the computing resources for training.

Inflection-2.5 is available to all Pi's users today, at pi.ai, on iOS, on Android, and via the new desktop app.

Inflection AI's previous model, Inflection-1, utilized about 4% of the training FLOPs of GPT-4 and exhibited an average performance of around 72% compared to GPT-4 across various IQ-oriented tasks.

Inflection-2.5, now driving Pi, brings a substantial boost to Pi's intellectual capabilities (IQ), with a focus on coding and mathematics. The model's performance on key industry benchmarks demonstrates its prowess, showcasing over 94% of GPT-4's average performance across various tasks, especially excelling in STEM areas.

Inflection-2.5 shines in coding and mathematics, demonstrating over a 10% improvement on Inflection-1 on BIG-Bench-Hard, a subset of challenging problems for large language models. Two coding benchmarks, MBPP+ and HumanEval+, reveal massive improvements over Inflection-1, solidifying its position as a force to be reckoned with.

Inflection-2.5 stands out in industry benchmarks, showcasing substantial improvements over Inflection-1 on the MMLU benchmark and the GPQA Diamond benchmark, renowned for its expert-level difficulty. 

The model's prowess extends to STEM examinations, with standout performance on the Hungarian Math exam and Physics GRE, where it reaches the 85th percentile of human test-takers in maj@8.

Inflection-2.5 not only upholds Pi's signature personality and safety standards but elevates its status as a versatile and invaluable personal AI across diverse topics. From discussing current events to seeking local recommendations, studying for exams, coding, and even casual conversations, Pi powered by Inflection-2.5 promises an enriched user experience.