Participatory Observation Methods Within Data-Intensive Science: Formal Evaluation and Sociotechnical Insight

This paper presents a framework enabling qualitative researchers to gain rich participatory access to study scientific practices within collaborative, funded research projects. Participatory observation methods provide unique access to scientific sites for social studies of science but require authentic and mutually beneficial motivations for qualitative researchers’ participation. We illustrate a successful approach to configuring such collaborations by presenting the case of our participatory observation of an intensive NSF-funded Data-Intensive Science (DIS) training, as members of the evaluation team. We detail how our dual-purpose data collection methods informed both funder-facing evaluation materials and our own subsequent research publications, completed in parallel to the training’s core objectives. We organize our site-specific findings on scientific practice around the themes of Technology, Practices, and Culture. Participatory evaluation of grant-funded science is a rich and under-utilized form of site access for sociotechnical researchers that can facilitate mutually beneficial scientific convergence.