Using a Novel Conversational Method for Measuring Comprehension of D/HoH Viewers Consuming Captioning Content for Entertainment Purposes

Assessing the comprehension of Deaf and Hard of Hearing (D/HoH) viewers in the context of television content has traditionally relied on methods such as focus groups, open-ended questionnaires, and multiple-choice questions. This paper proposes a novel methodology rooted in the social pragmatic model of conversation to measure the comprehension of D/HoH viewers who watch fast-paced live sports. Sixteen Deaf and 11 Hard of Hearing individuals, all sports fans, engaged in one-on-one informal conversations with researchers after viewing a sports game with two different styles of captioning. Comprehension scores were determined based on correct responses to predetermined topics related to gameplay and commentary. Results indicate comprehension scores were above 60% with the majority of participants exceeding 80%. This conversation methodology was effective in capturing participants’ understanding beyond traditional comprehension measures, encouraging spontaneous engagement and insights. Researchers recognized the natural and free-flowing nature of the conversations. This study introduces a promising method for evaluating content comprehension in D/HoH viewers, emphasizing the need for researchers to immerse themselves in content and conversations. Future research should explore variations in this methodology and topic selection while addressing training needs for researchers.