Despite significant advancements in medical artificial intelligence (AI) systems, these technologies are prone to mistake in their predictions. These mistakes can significantly affect medical experts’ willingness to continue using these systems. To mitigate potential discontinuation, existing research indicates that providing additional information alongside predictions, can lessen negative outcomes like discontinuation. Given the potential impact on users’ information processing, we hypothesize that AI explanations, detailing the system's decision-making process, can also influence the likelihood of discontinuing use after an AI mistake. Through an online experiment with medical experts (n = 227), we demonstrate that such explanations can influence medical experts’ information processing and, consequently, mitigate the adverse effects on the actual discontinuation of AI systems following a mistake.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Mitigating Discontinuance in Medical AI Systems: The Role of AI Explanations

  • Aycan Aslan,
  • Maike Greve,
  • Lutz Kolbe

摘要

Despite significant advancements in medical artificial intelligence (AI) systems, these technologies are prone to mistake in their predictions. These mistakes can significantly affect medical experts’ willingness to continue using these systems. To mitigate potential discontinuation, existing research indicates that providing additional information alongside predictions, can lessen negative outcomes like discontinuation. Given the potential impact on users’ information processing, we hypothesize that AI explanations, detailing the system's decision-making process, can also influence the likelihood of discontinuing use after an AI mistake. Through an online experiment with medical experts (n = 227), we demonstrate that such explanations can influence medical experts’ information processing and, consequently, mitigate the adverse effects on the actual discontinuation of AI systems following a mistake.