Deep learning-based retinal vessel segmentation models often struggle to capture both local and global dependencies without explicitly modeling vessel connectivity. To address this challenge, we propose MRGT-Net, a novel Multi-Representation Guided Transformer network that unifies Convolutional Neural Networks (CNNs), Graph Neural Networks (GNNs), and Transformers into a single framework. MRGT-Net leverages the strengths of multiscale CNNs for local feature extraction, GNNs for relational reasoning, and Transformers for capturing long-range dependencies and global context. The architecture adopts a U-Net-inspired encoder-decoder design. The encoder uses CNN blocks to extract hierarchical spatial features. To model contextual relationships between distant yet semantically similar regions, we introduce a Graph Convolution Block (GCB) that constructs a \(k\) -Nearest Neighbor (kNN) graph from high-level features. Furthermore, a Transformer Block (TB) enhances global context modeling in the feature space. We apply gamma correction and CLAHE (Contrast Limited Adaptive Histogram Equalization) during preprocessing to boost contrast and improve segmentation performance. Fused feature representations are decoded into precise segmentation maps. Extensive experiments on benchmark retinal vessel datasets demonstrate that MRGT-Net outperforms state-of-the-art methods, achieving F1 scores of 82.56% on CHASE-DB1 and 83.79% on DRIVE, surpassing prior methods by 0.93% and 0.58%, respectively, and achieving competitive F1 performance on STARE, with the highest accuracy across all three datasets.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multiscale Recursive Graph Transformer for Retinal Vessel Segmentation

  • Syed Javed,
  • Erik Meijering,
  • Arcot Sowmya,
  • Imran Razzak

摘要

Deep learning-based retinal vessel segmentation models often struggle to capture both local and global dependencies without explicitly modeling vessel connectivity. To address this challenge, we propose MRGT-Net, a novel Multi-Representation Guided Transformer network that unifies Convolutional Neural Networks (CNNs), Graph Neural Networks (GNNs), and Transformers into a single framework. MRGT-Net leverages the strengths of multiscale CNNs for local feature extraction, GNNs for relational reasoning, and Transformers for capturing long-range dependencies and global context. The architecture adopts a U-Net-inspired encoder-decoder design. The encoder uses CNN blocks to extract hierarchical spatial features. To model contextual relationships between distant yet semantically similar regions, we introduce a Graph Convolution Block (GCB) that constructs a \(k\) -Nearest Neighbor (kNN) graph from high-level features. Furthermore, a Transformer Block (TB) enhances global context modeling in the feature space. We apply gamma correction and CLAHE (Contrast Limited Adaptive Histogram Equalization) during preprocessing to boost contrast and improve segmentation performance. Fused feature representations are decoded into precise segmentation maps. Extensive experiments on benchmark retinal vessel datasets demonstrate that MRGT-Net outperforms state-of-the-art methods, achieving F1 scores of 82.56% on CHASE-DB1 and 83.79% on DRIVE, surpassing prior methods by 0.93% and 0.58%, respectively, and achieving competitive F1 performance on STARE, with the highest accuracy across all three datasets.