<p>Researchers have increasingly pivoted from paper and phone to online survey delivery. However, bots and inattentive participants can lower data quality dramatically compared with in-person delivery. In this paper, we demonstrate to the reader the effectiveness of measures used to screen for bots and inattentive participants. Using our own survey that incorporates current best practices, we illustrate that these measures aided us in detecting both bots and inattentive participants; however, our attention checks eliminated more inattentive respondents than our bot detection questions. Thus, we show that including checks for bots and reader attention is crucial to implementing online surveys and generating high-quality data.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Battling bots and bad data: enhancing data quality in online surveys

  • Adrienne W. Sudbury,
  • Melanie Marks

摘要

Researchers have increasingly pivoted from paper and phone to online survey delivery. However, bots and inattentive participants can lower data quality dramatically compared with in-person delivery. In this paper, we demonstrate to the reader the effectiveness of measures used to screen for bots and inattentive participants. Using our own survey that incorporates current best practices, we illustrate that these measures aided us in detecting both bots and inattentive participants; however, our attention checks eliminated more inattentive respondents than our bot detection questions. Thus, we show that including checks for bots and reader attention is crucial to implementing online surveys and generating high-quality data.