TomoRay cranial: synthesis of cranial CT imaging from biplanar radiographs using a generative adversarial network
摘要
Besides clinical examination, cranial CT plays a critical role in diagnostics in neurosurgery. In trauma cases or perioperatively, having low-barrier access to CT-like imaging would be highly beneficial. Therefore, this feasibility study examines at an early stage if and how well synthetic cranial CT imaging can be generated from biplanar radiographs of adult neurosurgical patients using deep learning.
Materials and methodsTwo 2D to 3D generative adversarial networks (GANs) were trained for the generation of synthetic cranial CTs using radiographs taken in two planes as input. Model 1 uses digitally reconstructed radiographs (DRRs) as input, while model 2 was trained using real X-rays. In total, model 1 was trained and validated using 235 images from three separate centers. Model 2 was trained and tested using 1323 images from a single center.
ResultsThe performance of the model using DDRs as input reached a peak-signal-to-noise ratio (PSNR) of 15.61 and a structural similarity index measure (SSIM) of 0.782 during external validation. The second model, using real X-rays as input, attained a PSNR of 14.69 and an SSIM of 0.717 upon internal validation.
ConclusionsAt the present stage, the synthetic cranial tomography scans generated as part of this study show promise but do not seamlessly correspond to ground-truth CTs. However, this proof-of-concept study is the first to derive such artificial cranial images using deep learning and can serve as a starting point for further investigation.
Key Points