As large language models (LLMs) increasingly engage in emotionally sensitive interactions, their unintended therapeutic roles demand systematic investigation. We examine ChatGPT’s perceived capacity to provide emotional and mental health support by analyzing user-generated content from social networks through relevance classification and sentiment analysis. Guided by three research questions, we quantify public sentiment toward ChatGPT in therapeutic contexts. To identify posts suggesting therapeutic use of ChatGPT, we introduce two methods: SemReC, a supervised relevance classification, and PASS, an unsupervised similarity-based approach. Both methods demonstrate high accuracy and consistent performance across the dataset. We further assess the performance of existing pre-trained sentiment analysis models to benchmark their effectiveness. To capture affective sentiment propagation in multi-turn interactions, we propose two tree-structured methods—HierSent and AggSent—which model emotional dynamics within threaded conversations. Empirical results validate the effectiveness of our methods and reveal a predominance of positive sentiment toward using ChatGPT for therapeutic purposes. These findings highlight the public popularity of the emergent therapeutic use of LLMs and underscore the need to examine their broader implications for mental health.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Therapist by Chance: Investigating ChatGPT’s Emotional and Mental Health Support via Sentiment Analysis on Social Networks

  • Smita Ghosh,
  • Xiaochen Luo,
  • Jared Maeyama,
  • Shiv Jhalani,
  • C. J. Oshiro,
  • Tharun Venkatesh,
  • Rushil Patel

摘要

As large language models (LLMs) increasingly engage in emotionally sensitive interactions, their unintended therapeutic roles demand systematic investigation. We examine ChatGPT’s perceived capacity to provide emotional and mental health support by analyzing user-generated content from social networks through relevance classification and sentiment analysis. Guided by three research questions, we quantify public sentiment toward ChatGPT in therapeutic contexts. To identify posts suggesting therapeutic use of ChatGPT, we introduce two methods: SemReC, a supervised relevance classification, and PASS, an unsupervised similarity-based approach. Both methods demonstrate high accuracy and consistent performance across the dataset. We further assess the performance of existing pre-trained sentiment analysis models to benchmark their effectiveness. To capture affective sentiment propagation in multi-turn interactions, we propose two tree-structured methods—HierSent and AggSent—which model emotional dynamics within threaded conversations. Empirical results validate the effectiveness of our methods and reveal a predominance of positive sentiment toward using ChatGPT for therapeutic purposes. These findings highlight the public popularity of the emergent therapeutic use of LLMs and underscore the need to examine their broader implications for mental health.