<p>Recent breakthroughs in artificial intelligence generative content technology are driving transformational change. Diffractive optical networks offer a promising solution for high-speed, low-power generative models. However, the generative capabilities of optical computing remain underexplored. Here, we present the implementation of a generative model on an optoelectronic computing architecture based on generative adversarial networks, termed the optoelectronic generative adversarial network. The network strategically distributes the generator and discriminator across optical and electronic components, which are seamlessly integrated to leverage the unique strengths of each computing paradigm and take advantage of transfer learning. The network can efficiently and rapidly process complex generative tasks. The performance of the network is demonstrated through three generative tasks: image generation, conditional generation, and image restoration. By integrating the advantages of optical and electronic computing, the network advances the development of more powerful and accessible generative models, unlocking new creative possibilities across diverse applications.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Optoelectronic generative adversarial networks

  • Jumin Qiu,
  • Ganqing Lu,
  • Tingting Liu,
  • Dejian Zhang,
  • Shuyuan Xiao,
  • Tianbao Yu

摘要

Recent breakthroughs in artificial intelligence generative content technology are driving transformational change. Diffractive optical networks offer a promising solution for high-speed, low-power generative models. However, the generative capabilities of optical computing remain underexplored. Here, we present the implementation of a generative model on an optoelectronic computing architecture based on generative adversarial networks, termed the optoelectronic generative adversarial network. The network strategically distributes the generator and discriminator across optical and electronic components, which are seamlessly integrated to leverage the unique strengths of each computing paradigm and take advantage of transfer learning. The network can efficiently and rapidly process complex generative tasks. The performance of the network is demonstrated through three generative tasks: image generation, conditional generation, and image restoration. By integrating the advantages of optical and electronic computing, the network advances the development of more powerful and accessible generative models, unlocking new creative possibilities across diverse applications.