Article complete

ChatGPT Has The Potential To Compete With Mental Health Experts, Says Study

Study results indicated that participants could barely tell the difference between responses written by ChatGPT and responses written by a therapist.

A blurred green background features the ChatGPT logo on a crystal ball, suggesting predictions about mental health.

Key takeaways

  • Study reveals ChatGPT can rival human therapists in psychotherapy responses.
  • Participants struggled to distinguish between ChatGPT and therapist replies.
  • AI-generated responses scored higher on key psychotherapy principles.
  • Identification accuracy for therapists was only slightly better than for ChatGPT.
  • ChatGPT demonstrates a notable level of empathy in its responses.

Takeaways drafted with AI from the article text.

Since the expansion of use cases for ChatGPT, there have been discussions regarding whether this signifies the end for human therapists and if GPT-4 surpasses psychologists in terms of intelligence.

A recent study suggests that ChatGPT can potentially rival human therapists in certain aspects of psychotherapy. The research, which appears in PLOS Mental Health, explores the capabilities of ChatGPT in comparison to responses from a panel of mental health experts.

The study involved a large sample of 830 participants who were asked to differentiate between responses to couple therapy vignettes written by ChatGPT 4.0 and those written by clinical psychologists, counselling psychologists, marriage and family therapists, and a psychiatrist. 

The results indicated that participants could barely tell the difference between responses written by ChatGPT and responses written by a therapist. Moreover, the AI-generated responses were generally rated higher in key psychotherapy principles. 

When gauging the results regarding stats, the study mentions, “Identification within authors was poor, with participants correctly guessing that the therapist was the author 56.1% of the time and participants correctly guessing that ChatGPT was the author 51.2% of the time.” It further states, “Between authors, participants were only able to correctly identify therapists 5% more often than ChatGPT (56.1% versus 51.2%, respectively).”

The research emphasises the linguistic distinctions between ChatGPT's replies and those of therapists, noting that ChatGPT exhibits a high level of empathy.

The study suggests that "ChatGPT has the potential to improve psychotherapeutic processes." The study notes that one practical application of GenAI is in web-based interventions for couples, where an automated chatbot could provide evidence-based support, expanding the reach and dissemination of such programs.

In addition to the interesting success rate, the study acknowledges limitations, including the absence of a therapeutic context and the need for supervision during the training process to ensure participant safety. 

The authors call for continued research to improve the usefulness of psychotherapeutic applications using chatbots like ChatGPT, potentially placing them in the hands of individuals who need them the most.

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

ChatGPT · 5 stories
  1. You are here: ChatGPT Has The Potential To Compete With Mental Health Experts, Says Study
  2. OpenAI Dismisses Senior Policy Executive After ‘Adult Mode’ Criticism: Report
  3. OpenAI’s Smart Speaker to Cost Over $300: Report
  4. OpenAI Introduces ChatGPT for Financial Services Built on GPT-6 Astra
  5. Oracle Partners With OpenAI to Bring ChatGPT and Codex to Enterprise Workflows
About the author

Editor

I am a tech aficionado and a computer science graduate with a keen interest in AI, Coding, Open Source, Global SaaS, and Cloud. Have a tip? Reach out to

All stories
Belamy · Daily

The day’s AI news, before your first meeting.