Low back pain affects millions worldwide, driving the need for robust diagnostic models that can jointly analyze complex medical images and accompanying text reports. We present \(\texttt{LumbarCLIP}\) , a novel multimodal framework that leverages contrastive language-image pretraining to align lumbar spine MRI scans with corresponding radiological descriptions. Built upon a curated dataset containing axial MRI views paired with expert-written reports, \(\texttt{LumbarCLIP}\) integrates vision encoders (ResNet-50, Vision Transformer, Swin Transformer) with a BERT-based text encoder to extract dense representations. These are projected into a shared embedding space via learnable projection heads - configurable as linear or non-linear—and normalized to facilitate stable contrastive training using a soft CLIP loss. Our model achieves state-of-the-art performance on downstream classification, reaching up to \(95.00\%\) accuracy and \(94.75\%\) F1-score on the test set, despite inherent class imbalance. Extensive ablation studies demonstrate that linear projection heads yield more effective cross-modal alignment than non-linear variants. \(\texttt{LumbarCLIP}\) offers a promising foundation for automated musculoskeletal diagnosis and clinical decision support.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Revolutionizing Precise Low Back Pain Diagnosis via Contrastive Learning

  • Thanh Binh Le,
  • Hoang Nhat Khang Vo,
  • Tan Ha Mai,
  • Trong Nhan Phan

摘要

Low back pain affects millions worldwide, driving the need for robust diagnostic models that can jointly analyze complex medical images and accompanying text reports. We present \(\texttt{LumbarCLIP}\) , a novel multimodal framework that leverages contrastive language-image pretraining to align lumbar spine MRI scans with corresponding radiological descriptions. Built upon a curated dataset containing axial MRI views paired with expert-written reports, \(\texttt{LumbarCLIP}\) integrates vision encoders (ResNet-50, Vision Transformer, Swin Transformer) with a BERT-based text encoder to extract dense representations. These are projected into a shared embedding space via learnable projection heads - configurable as linear or non-linear—and normalized to facilitate stable contrastive training using a soft CLIP loss. Our model achieves state-of-the-art performance on downstream classification, reaching up to \(95.00\%\) accuracy and \(94.75\%\) F1-score on the test set, despite inherent class imbalance. Extensive ablation studies demonstrate that linear projection heads yield more effective cross-modal alignment than non-linear variants. \(\texttt{LumbarCLIP}\) offers a promising foundation for automated musculoskeletal diagnosis and clinical decision support.