错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Foundation models for fast, label-free detection of glioma infiltration

  • Akhil Kondepudi,
  • Melike Pekmezci,
  • Xinhai Hou,
  • Katie Scotford,
  • Cheng Jiang,
  • Akshay Rao,
  • Edward S. Harake,
  • Asadur Chowdury,
  • Wajd Al-Holou,
  • Lin Wang,
  • Aditya Pandey,
  • Pedro R. Lowenstein,
  • Maria G. Castro,
  • Lisa Irina Koerner,
  • Thomas Roetzer-Pejrimovsky,
  • Georg Widhalm,
  • Sandra Camelo-Piragua,
  • Misha Movahed-Ezazi,
  • Daniel A. Orringer,
  • Honglak Lee,
  • Christian Freudiger,
  • Mitchel Berger,
  • Shawn Hervey-Jumper,
  • Todd Hollon

摘要

A critical challenge in glioma treatment is detecting tumour infiltration during surgery to achieve safe maximal resection13. Unfortunately, safely resectable residual tumour is found in the majority of patients with glioma after surgery, causing early recurrence and decreased survival46. Here we present FastGlioma, a visual foundation model for fast (<10 s) and accurate detection of glioma infiltration in fresh, unprocessed surgical tissue. FastGlioma was pretrained using large-scale self-supervision (around 4 million images) on rapid, label-free optical microscopy, and fine-tuned to output a normalized score that indicates the degree of tumour infiltration within whole-slide optical images. In a prospective, multicentre, international testing cohort of patients with diffuse glioma (n = 220), FastGlioma was able to detect and quantify the degree of tumour infiltration with an average area under the receiver operating characteristic curve of 92.1 ± 0.9%. FastGlioma outperformed image-guided and fluorescence-guided adjuncts for detecting tumour infiltration during surgery by a wide margin in a head-to-head, prospective study (n = 129). The performance of FastGlioma remained high across diverse patient demographics, medical centres and diffuse glioma molecular subtypes as defined by the World Health Organization. FastGlioma shows zero-shot generalization to other adult and paediatric brain tumour diagnoses, demonstrating the potential for our foundation model to be used as a general-purpose adjunct for guiding brain tumour surgeries. These findings represent the transformative potential of medical foundation models to unlock the role of artificial intelligence in the care of patients with cancer.