Generative AI models such as ChatGPT and Stable Diffusion have become easily available to end users through various apps. Research has identified several safety risks and limitations of generative AI, but the experiences and issues faced by real users of this technology in the wild have not been systematically investigated. In this paper, we identify user issues related to trustworthiness dimensions of generative AI, by analyzing user reviews of AI apps using a hybrid approach that combines unsupervised topic modeling and manual qualitative analysis. The results revealed user issues related to the validity, reliability, safety, security and privacy of the AI. Validity-related issues, such as incorrect output, were often found, but these issues appeared to result from high expectations about the capabilities of the technology, rather than an accurate reflection of its limitations. Concerns about safety issues, such as bias and the handling of inappropriate content, also appeared frequently, although users had conflicting expectations on how these should be handled. On the other hand, the user reviews contained fewer instances of concern related to the security and privacy of the AI itself. Overall, the results suggest that real users of generative AI have inadequate information about the characteristics and limitations of these models.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

User Issues and Concerns in Generative AI: A Mixed-Methods Analysis of App Reviews

  • Vanessa Bracamonte,
  • Sascha Loebner,
  • Frederic Tronnier,
  • Ann-Kristin Lieberknecht,
  • Sebastian Pape

摘要

Generative AI models such as ChatGPT and Stable Diffusion have become easily available to end users through various apps. Research has identified several safety risks and limitations of generative AI, but the experiences and issues faced by real users of this technology in the wild have not been systematically investigated. In this paper, we identify user issues related to trustworthiness dimensions of generative AI, by analyzing user reviews of AI apps using a hybrid approach that combines unsupervised topic modeling and manual qualitative analysis. The results revealed user issues related to the validity, reliability, safety, security and privacy of the AI. Validity-related issues, such as incorrect output, were often found, but these issues appeared to result from high expectations about the capabilities of the technology, rather than an accurate reflection of its limitations. Concerns about safety issues, such as bias and the handling of inappropriate content, also appeared frequently, although users had conflicting expectations on how these should be handled. On the other hand, the user reviews contained fewer instances of concern related to the security and privacy of the AI itself. Overall, the results suggest that real users of generative AI have inadequate information about the characteristics and limitations of these models.