<p>Generative AI chatbots are increasingly used by youth for mental health support, but their safety for managing youth suicide risk remains poorly understood. In this paper, we review research on how general-purpose chatbots and AI companions detect and respond to suicide risk disclosures, finding that existing studies rely almost entirely on single-turn, researcher-generated prompts that are not designed with youth in mind. Chatbot performance degrades substantially with indirect, ambiguous, or gradually disclosed risk, which are patterns characteristic of adolescent communication, and the real-world impact of chatbot interactions on youth suicide risk remains unknown. We propose a youth-focused clinical research agenda to address these gaps, organized around four priorities: understanding and integrating youth perspectives through qualitative and participatory research; improving youth-specific risk detection and evaluation methods; examining real-world impacts of chatbot use among youth through prospective outcome research; and improving connection of at-risk youth to crisis resources and trusted adults. Progress will require multidisciplinary collaboration and must evolve alongside rapidly changing chatbot capabilities.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

AI chatbots and youth suicide risk: current evidence, critical gaps, and a clinical research agenda

  • Kelly L. Zuromski,
  • Margaret Meagher,
  • Tracy Costigan,
  • Elizabeth A. Olson

摘要

Generative AI chatbots are increasingly used by youth for mental health support, but their safety for managing youth suicide risk remains poorly understood. In this paper, we review research on how general-purpose chatbots and AI companions detect and respond to suicide risk disclosures, finding that existing studies rely almost entirely on single-turn, researcher-generated prompts that are not designed with youth in mind. Chatbot performance degrades substantially with indirect, ambiguous, or gradually disclosed risk, which are patterns characteristic of adolescent communication, and the real-world impact of chatbot interactions on youth suicide risk remains unknown. We propose a youth-focused clinical research agenda to address these gaps, organized around four priorities: understanding and integrating youth perspectives through qualitative and participatory research; improving youth-specific risk detection and evaluation methods; examining real-world impacts of chatbot use among youth through prospective outcome research; and improving connection of at-risk youth to crisis resources and trusted adults. Progress will require multidisciplinary collaboration and must evolve alongside rapidly changing chatbot capabilities.