Wavelet Deep Learning Network for Objective Retinal Functional Estimation from Multimodal Retinal Imaging
摘要
In this study, we proposed a wavelet-based deep learning network to estimate retinal function from retinal structure in patients with Retinitis Pigmentosa. We used macular integrity assessment microperimetry to measure retinal sensitivities (functional information) and spectral domain optical coherence tomography to assess retinal layer thicknesses (structural information). Outer, inner, and total retinal thicknesses were extracted. We found a strong correlation between outer retinal thickness and retinal sensitivity. Leveraging this correlation, we employed machine learning models for functional estimation from retinal layer thicknesses and vice versa. For functional estimation, we incorporated discrete wavelet transform and max-pooling features in a ResNet18-based architecture, significantly improving the accuracy to an \(R^2\) score of 0.79. Our results demonstrate that machine learning models can effectively predict retinal function from retinal structure, and vice versa. Furthermore, the integration of discrete wavelet transform features in the convolutional neural network improved the performance of functional estimation from retinal structure.