OpenAI Wants to be a ‘24/7 World-Class Doctor’ in Your Pocket

OpenAI is making a serious push into the healthcare sector, with the release of a new benchmark called HealthBench, designed to evaluate the capabilities of AI systems in health.  The benchmark aims to help large language models (LLMs) support patients and clinicians with health discussions that are trustworthy, meaningful, and open to continuous improvement. HealthBench looks at seven key areas, including emergency care, managing uncertainty, and global health. “What if you had a world-class doctor in your pocket, 24/7, at no cost? That’s the promise of AI in healthcare, but mistakes can be catastrophic. That’s why OpenAI launched HealthBench, a new benchmark to test how well AI models handle real, complex medical conversations,”  Matthew Berman, CEO of Forward Future, wrote on X.  Developed in partnership with 262 physicians from 60 countries, HealthBench includes 5,000 realistic health-related conversations, each paired with a custom physician-created