Inflection AI has recently launched Inflection-2.5, a model that competes with all the world’s leading LLMs, including GPT-4 and Gemini. Inflection-2.5 approaches the performance level of GPT-4 but utilizes only 40% of the computing resources for training.
Inflection-2.5 is available to all Pi’s users today, at pi.ai, on iOS, on Android, and via the new desktop app.
Inflection AI’s previous model, Inflection-1, utilized about 4% of the training FLOPs of GPT-4 and exhibited an average performance of around 72% compared to GPT-4 across various IQ-oriented tasks.
Inflection-2.5, now driving Pi, brings a substantial boost to Pi’s intellectual capabilities (IQ), with a focus on coding and mathematics. The model’s performance on key industry benchmarks demonstrates its prowess, showcasing over 94% of GPT-4’s average performance across various tasks, especially excelling in STEM areas.
Inflection-2.5 shines in coding and mathematics, demonstrating over a 10% improvement on Inflection-1 on BIG-Bench-Hard, a subset of challenging problems for large language models. Two coding benchmarks, MBPP+ and HumanEval+, reveal massive improvements over Inflection-1, solidifying its position as a force to be reckoned with.
Inflection-2.5 stands out in industry benchmarks, showcasing substantial improvements over Inflection-1 on the MMLU benchmark and the GPQA Diamond benchmark, renowned for its expert-level difficulty.
The model’s prowess extends to STEM examinations, with standout performance on the Hungarian Math exam and Physics GRE, where it reaches the 85th percentile of human test-takers in maj@8.
Inflection-2.5 not only upholds Pi’s signature personality and safety standards but elevates its status as a versatile and invaluable personal AI across diverse topics. From discussing current events to seeking local recommendations, studying for exams, coding, and even casual conversations, Pi powered by Inflection-2.5 promises an enriched user experience.
