<p>“Data hugging” blocks independent verification of medical AI. Apple claims age estimation with a mean absolute error of 2.9 years using photoplethysmographic (PPG) signals. Given PPG’s noise, such accuracy is questionable, raising concerns about other tech companies’ claims. Using UK Biobank data, we find this accuracy unreplicable, achieving results only marginally better than predicting mean age. We advocate for curated public benchmark datasets and evaluation platforms to protect the public from unverifiable claims.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Data-hugging shields proprietary AI models from research that could disprove them

  • Anish Karpurapu,
  • Zhicheng Guo,
  • Xiao Hu,
  • Cynthia Rudin

摘要

“Data hugging” blocks independent verification of medical AI. Apple claims age estimation with a mean absolute error of 2.9 years using photoplethysmographic (PPG) signals. Given PPG’s noise, such accuracy is questionable, raising concerns about other tech companies’ claims. Using UK Biobank data, we find this accuracy unreplicable, achieving results only marginally better than predicting mean age. We advocate for curated public benchmark datasets and evaluation platforms to protect the public from unverifiable claims.