<p>Biomedical machine learning (ML) models raise critical concerns about embedded assumptions influencing clinical decision-making, necessitating robust documentation frameworks for datasets that are shared via external repositories. Fairness-aware algorithm effectiveness hinges on users’ prior awareness of specific issues in the data – information such as data collection methodology, provenance and quality. Current ML-focused documentation approaches impose impractical burdens on data generators and conflate data/model accountability. This is problematic for resource datasets not explicitly created for ML applications. This study addresses these gaps through a two-step process: First, we derived consensus documentation fields by mapping elements across four key templates. Second, we surveyed biomedical stakeholders across four roles (clinicians, bench scientists, data manager and computationalists) to assess field importance and relevance. This revealed important role-dependent prioritization differences, motivating the development of the Biomedical Data Manifest – a modular template employing persona-specific field presentation reducing generator burden while ensuring end-users receive role-relevant information. The Biomedical Data Manifest improves transparency for datasets deposited in public or controlled-access repositories and bias mitigation across ML applications.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Biomedical Data Manifest: A lightweight data documentation mapping to increase transparency for AI/ML

  • Daniel Bottomly,
  • Christopher G. Suciu,
  • Benjamin Cordier,
  • Nathaniel Evans,
  • Alfonso Poire,
  • Christina Zheng,
  • Jeffrey Myers,
  • Vlad Sandulache,
  • Trever Bivona,
  • Jack Roth,
  • Boyi Gan,
  • Albert Koong,
  • Pankaj Singh,
  • Michael Hollingsworth,
  • Jixin Dong,
  • Brian Druker,
  • David W. Goodrich,
  • Song Liu,
  • Tao Liu,
  • Christopher Willey,
  • Joshi Alumkal,
  • Keith Syson Chan,
  • Phuoc Tran,
  • Chunru Lin,
  • Erina Vlashi,
  • Alice Soragni,
  • Paul C. Boutros,
  • Erik Knudsen,
  • Agnieszka Witkiewicz,
  • Xingxing Zang,
  • Michael Deininger,
  • Jeffrey W. Tyner,
  • Alan Hutson,
  • Shannon K. McWeeney

摘要

Biomedical machine learning (ML) models raise critical concerns about embedded assumptions influencing clinical decision-making, necessitating robust documentation frameworks for datasets that are shared via external repositories. Fairness-aware algorithm effectiveness hinges on users’ prior awareness of specific issues in the data – information such as data collection methodology, provenance and quality. Current ML-focused documentation approaches impose impractical burdens on data generators and conflate data/model accountability. This is problematic for resource datasets not explicitly created for ML applications. This study addresses these gaps through a two-step process: First, we derived consensus documentation fields by mapping elements across four key templates. Second, we surveyed biomedical stakeholders across four roles (clinicians, bench scientists, data manager and computationalists) to assess field importance and relevance. This revealed important role-dependent prioritization differences, motivating the development of the Biomedical Data Manifest – a modular template employing persona-specific field presentation reducing generator burden while ensuring end-users receive role-relevant information. The Biomedical Data Manifest improves transparency for datasets deposited in public or controlled-access repositories and bias mitigation across ML applications.