Recently, OpenAI partnered with WHOOP to introduce a personalised health and fitness coach driven by GPT-4. WHOOP Coach provides answers to a wide range of fitness and health-related queries.
For instance, it can address questions like, “What was my lowest resting heart rate ever?” or “What weekly workout schedule would help me reach my goal?” — all while offering personalised guidance based on each individual’s unique body and goals.
Apart from WHOOP, OpenAI has also partnered with Summer Health, a 24×7 text-based pediatric care service, using GPT-4 to assist its doctors. Summer Health has built and launched their new feature, which uses GPT-4 to automatically generate visit notes from a doctor’s detailed written observations.
These notes are then quickly reviewed by the pediatrician before being shared with parents. In collaboration with OpenAI, Summer Health rigorously fine-tuned the model, added a clinical review process to ensure accuracy and relevance in medical contexts, and continues to improve the model based on expert feedback.
Moreover, GPT Vision has found applications in radiology as well. Microsoft recently published a paper titled ‘Exploring the Boundaries of GPT-4 in Radiology‘, which assesses the performance of GPT-4 in text-based applications for radiology reports.
One of the primary applications of GPT-4 in radiology lies in its ability to process and comprehend medical images, ranging from X-rays to MRIs. The paper said, “The radiology report summaries created by GPT-4 are comparable, and in some cases, even preferred over those written by experienced radiologists.”
Additionally, Be My Eyes is utilising GPT-4’s multimodal capabilities, specifically the visual input feature, to enhance their app, which acts as a virtual assistant. Be My Eyes aids visually impaired users with tasks such as identifying objects, reading text, and navigating their environment.”
On the mental wellness side, numerous users have experimented with ChatGPT as a therapist. Many individuals have found ChatGPT to be helpful in providing practical advice and human-like interaction, offering a unique alternative to those unable or unwilling to seek professional therapy.
What Others are Doing
Prior to OpenAI, both Google and Apple have been making significant advancements using LLMs in the healthcare industry.
Google recently introduced MedLM, a family of foundation models specifically fine-tuned for various healthcare use cases. Currently, there are two models under MedLM, both built on Med-PaLM 2, providing flexibility for healthcare organisations and addressing their diverse needs.
In contrast, Apple plans to incorporate additional health detection features in their upcoming series of watches, focusing on conditions such as hypertension and apnea, among others.
Moreover, Isomorphic Labs, the London-based drug discovery spin-out of Google AI R&D division DeepMind, has entered into strategic partnerships with two pharmaceutical giants, Eli Lilly and Novartis, to apply AI to discover new medications to treat diseases.
Last year, Oracle introduced Clinical Digital Assistant, which integrates with Oracle’s EHR systems, allowing doctors to use voice commands for tasks like note-taking, scheduling appointments, and ordering medication.
Similar to Isomorphic Labs, partnering with healthcare institutions and researchers would grant OpenAI access to diverse medical data, crucial for refining their AI models and accelerating product development. Furthermore, venturing into healthcare diversifies OpenAI’s revenue streams, reducing vulnerability to fluctuations in other sectors.
