<p>Trust in human-machine interaction is a critical factor for the performance of AI systems, but achieving it is still challenging because many AI models are considered black-box. Following the purpose of the study, we quantitatively analyze the role of XAI and ESNs on the trust calibration with two different benchmark datasets, CIFAR-10 for visual tasks and SQuAD for text-based tasks. Using a 2 × 2 between-subjects experimental design, we examine the influence of AI explainability (explainable AI vs. non-explainable AI) and interaction outcomes (successful vs. failed) on explicit and implicit measures of trust. To increase the transparency of the model, convolution neural networks are joined with Explainable Artificial Intelligence (XAI) techniques including Grad-CAM for visual explainability and attention mechanisms for text-based tasks. This study shows explainable AI as a significant moderator of trust levels, especially in failed interactions and when users are given rationales for AI decisions. Explanations based on CNNs (Convolutional Neural Networks) improve the understanding, hence building trust, by providing visual evidence that is often easier to comprehend. Though implicit and explicit trust measures show strong correlations between the two measures, implicit metrics reveal differences in trust dynamics that cannot be gea-verified using self-reports. In addition, demographic factors, such as gender, have no significant impact on trust, further highlighting the versatility of these methods. The study compares its performance against five state-of-the-art methods in terms of accuracy, trust calibration, and user satisfaction and show that it outperforms them, while maintaining second best computational efficiency. These findings underscore the importance of explainability and dynamic trust calibration in ensuring the development of trusts in AI systems, providing a pathway for the widespread adoption of AI systems in various fields.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Explainable AI and echo state networks calibrate trust in human machine interaction

  • Sijia Hao,
  • Fei Teng,
  • Ruipeng Hou,
  • Lanwen Zhang,
  • Han Wu,
  • Jinling Qi

摘要

Trust in human-machine interaction is a critical factor for the performance of AI systems, but achieving it is still challenging because many AI models are considered black-box. Following the purpose of the study, we quantitatively analyze the role of XAI and ESNs on the trust calibration with two different benchmark datasets, CIFAR-10 for visual tasks and SQuAD for text-based tasks. Using a 2 × 2 between-subjects experimental design, we examine the influence of AI explainability (explainable AI vs. non-explainable AI) and interaction outcomes (successful vs. failed) on explicit and implicit measures of trust. To increase the transparency of the model, convolution neural networks are joined with Explainable Artificial Intelligence (XAI) techniques including Grad-CAM for visual explainability and attention mechanisms for text-based tasks. This study shows explainable AI as a significant moderator of trust levels, especially in failed interactions and when users are given rationales for AI decisions. Explanations based on CNNs (Convolutional Neural Networks) improve the understanding, hence building trust, by providing visual evidence that is often easier to comprehend. Though implicit and explicit trust measures show strong correlations between the two measures, implicit metrics reveal differences in trust dynamics that cannot be gea-verified using self-reports. In addition, demographic factors, such as gender, have no significant impact on trust, further highlighting the versatility of these methods. The study compares its performance against five state-of-the-art methods in terms of accuracy, trust calibration, and user satisfaction and show that it outperforms them, while maintaining second best computational efficiency. These findings underscore the importance of explainability and dynamic trust calibration in ensuring the development of trusts in AI systems, providing a pathway for the widespread adoption of AI systems in various fields.