PathoVision is an AI-powered framework that enhances cancer diagnosis by integrating histopathology images with clinical text using multimodal learning. Unlike traditional systems focused solely on image analysis, it employs the PLIP model to generate combined visual-text embeddings for more accurate and contextual understanding. A custom decoder processes these embeddings to classify cancer subtypes, while Grad-CAM provides interpretable heatmaps, ensuring transparency in decision-making. Designed for use in clinical diagnostics, research, and education, PathoVision addresses the limitations of manual pathology—such as subjectivity and time constraints—by offering a reliable, interpretable, and accessible solution. This framework represents a significant advancement in computational pathology, blending modern AI with traditional diagnostics to support expert pathologists and improve patient outcomes.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

PathoVision: Multimodal Deep Learning for Advancing Pathology Imaging with Explainable Artificial Intelligence

  • Meeradevi,
  • P. Maria Rufina,
  • B. Prathik,
  • C. S. Parthasarathy,
  • V. Janya,
  • Neeha Ritvika Mandava

摘要

PathoVision is an AI-powered framework that enhances cancer diagnosis by integrating histopathology images with clinical text using multimodal learning. Unlike traditional systems focused solely on image analysis, it employs the PLIP model to generate combined visual-text embeddings for more accurate and contextual understanding. A custom decoder processes these embeddings to classify cancer subtypes, while Grad-CAM provides interpretable heatmaps, ensuring transparency in decision-making. Designed for use in clinical diagnostics, research, and education, PathoVision addresses the limitations of manual pathology—such as subjectivity and time constraints—by offering a reliable, interpretable, and accessible solution. This framework represents a significant advancement in computational pathology, blending modern AI with traditional diagnostics to support expert pathologists and improve patient outcomes.