Analyzing Video-Based Human-Computer Interaction Data in Healthcare Using a Cognitive-Socio-Technical Framework

The usability of healthcare information systems is recognized as being critical for the adoption of new technologies. In response, a large number of usability studies have been conducted for analyzing user interactions with systems and information technologies. This has included testing the usability of applications ranging from electronic health records (EHRs) to artificial intelligence (AI) applications in healthcare. In the first part of the chapter, the need for developing more effective methods for analyzing data from usability studies will be discussed. The authors then describe the development of a principled, evidence-based approach that can be used in the analysis of data emerging from usability testing. This has included the development of methods for the analysis of video recordings of user interactions, computer screens as well as user verbalizations. The resultant coding system and overall approach described has been applied to identifying usability issues with health information systems, the cognitive impact of systems, as well as their impact on workflow and patient safety. The focus of the work is to identify the impact of technology at multiple levels, from the cognitive and workflow levels to the socio-technical level. This chapter will also include a discussion of recent work in automating the coding and analysis of usability problems as well as the potential for using automated text analytic approaches. This chapter will provide examples of their application on a range of research initiatives as well their application in health informatics.