<p>Creating an annotated medical image dataset is challenging and traditionally reliant on labor-intensive manual annotations. Additionally, these datasets often present substantial imbalances regarding sensing devices, class of medical disorders, and patient ethnicity and phenotype. Recently, there has been a research interest in mitigating these issues by employing data augmentation with generative models. However, the quality of images and semantics in medical image datasets are critical for computer vision tasks such as image segmentation. This paper presents DatasetGAN2-ADA, which aims to mitigate these difficulties by presenting an innovative deep-style interpreter robust against anomalous synthesis and designed to automate annotated image generation entirely. By leveraging the capabilities of StyleGAN2-ADA with an improved architecture of DatasetGAN and an enhanced execution framework integrated with an anomaly detector based on custom features, we propose a combined strategy for eliminating flawed synthetic images and masks. Furthermore, we propose exploiting image projections and preexisting semantics, eliminating the need for manual annotations to train our deep-style interpreter. The experimental results obtained with a magnetic resonance image (MRI) dataset demonstrate that DatasetGAN2-ADA is strongly effective in improving the efficiency and quality of synthetic generation, rejecting the synthesis of a substantial amount of low-quality images and masks. Then, an extension of this method is evaluated for detecting anomalous latent vectors <i>a priori</i> of the image synthesis, achieving up to 95.24% precision and illustrating its compelling potential for practical applications in medical imaging.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhanced deep-style interpreter for automatic synthesis of annotated medical images

  • Marcos Sergio Pacheco dos Santos Lima Junior,
  • Juan Miguel Ortiz-de-Lazcano-Lobato,
  • José David Fernández-Rodríguez,
  • Ezequiel López-Rubio

摘要

Creating an annotated medical image dataset is challenging and traditionally reliant on labor-intensive manual annotations. Additionally, these datasets often present substantial imbalances regarding sensing devices, class of medical disorders, and patient ethnicity and phenotype. Recently, there has been a research interest in mitigating these issues by employing data augmentation with generative models. However, the quality of images and semantics in medical image datasets are critical for computer vision tasks such as image segmentation. This paper presents DatasetGAN2-ADA, which aims to mitigate these difficulties by presenting an innovative deep-style interpreter robust against anomalous synthesis and designed to automate annotated image generation entirely. By leveraging the capabilities of StyleGAN2-ADA with an improved architecture of DatasetGAN and an enhanced execution framework integrated with an anomaly detector based on custom features, we propose a combined strategy for eliminating flawed synthetic images and masks. Furthermore, we propose exploiting image projections and preexisting semantics, eliminating the need for manual annotations to train our deep-style interpreter. The experimental results obtained with a magnetic resonance image (MRI) dataset demonstrate that DatasetGAN2-ADA is strongly effective in improving the efficiency and quality of synthetic generation, rejecting the synthesis of a substantial amount of low-quality images and masks. Then, an extension of this method is evaluated for detecting anomalous latent vectors a priori of the image synthesis, achieving up to 95.24% precision and illustrating its compelling potential for practical applications in medical imaging.