A Checklist for the Usability Evaluation of Artificial Intelligence (AI) mHealth Applications Graphical User Interface

The download rate of AI mobile health (mHealth) apps has increased rapidly, and there are many usability evaluation studies based on mobile apps, but few studies have been conducted on the usability of AI mHealth applications. This study aims to develop a task-based usability checklist based on heuristic evaluation based on the opinions of AI mobile health app user interface (UI) practitioners. This study was divided into two phases. The first phase of the study developed a hierarchical structure of graphical user interface design elements and usability principles related to AI mHealth applications, which used to develop the visual checklist for the usability evaluation. In order to demonstrate the practical effectiveness of the proposed checklist, the second phase of the study makes the usability evaluation with the checklist in AI m-Health application. Thirty user interface practitioners were recruited for this test, and they will use a visual checklist to evaluate the usability of AI GUIs in mHealth applications. The results showed that this usability checklist identified most of the usability issues and considerations that should be taken into account when developing AI mHealth, especially the usability of conversational AI and chatbot. This facilitates the study of potential ways to standardize AI GUIs to enhance the user experience in AI mHealth applications. The usability checklist proposed in this study is expected to be used quickly and effectively by usability practitioners for user interface evaluation during AI m-Health application development.