Generative models have been widely adopted in the biomedical domain, especially in image generation applications. Latent diffusion models achieve state-of-the-art results in generating brain MRIs. However, due to latent compression, generated images from these models are overly smooth, lacking fine anatomical structures and scan acquisition noise that are typically seen in real images. We propose image-to-image diffusion models that are designed to enhance the realism and details of generated brain images by introducing sharp edges, fine textures, subtle anatomical features, and imaging noise. This work formulates the realism enhancing and detail adding process as an image-to-image diffusion model, which refines the quality of LDM-generated images. We employ commonly used metrics like FID and LPIPS for image realism assessment. Furthermore, we introduce new metrics to quantify the improved realism of images generated by RealDeal in terms of image noise distribution, sharpness, and texture.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

RealDeal: Enhancing Realism and Details in Brain Image Generation via Image-to-Image Diffusion Models

  • Shen Zhu,
  • Yinzhu Jin,
  • Tyler Spears,
  • Ifrah Zawar,
  • P. Thomas Fletcher

摘要

Generative models have been widely adopted in the biomedical domain, especially in image generation applications. Latent diffusion models achieve state-of-the-art results in generating brain MRIs. However, due to latent compression, generated images from these models are overly smooth, lacking fine anatomical structures and scan acquisition noise that are typically seen in real images. We propose image-to-image diffusion models that are designed to enhance the realism and details of generated brain images by introducing sharp edges, fine textures, subtle anatomical features, and imaging noise. This work formulates the realism enhancing and detail adding process as an image-to-image diffusion model, which refines the quality of LDM-generated images. We employ commonly used metrics like FID and LPIPS for image realism assessment. Furthermore, we introduce new metrics to quantify the improved realism of images generated by RealDeal in terms of image noise distribution, sharpness, and texture.