错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Efficient and accurate neural-field reconstruction using resistive memory

  • Yifei Yu,
  • Xinyuan Zhang,
  • Shaocong Wang,
  • Woyu Zhang,
  • Xiuzhe Wu,
  • Yangu He,
  • Jichang Yang,
  • Yue Zhang,
  • Ning Lin,
  • Bo Wang,
  • Xi Chen,
  • Songqi Wang,
  • Xiaoshan Wu,
  • Shihao Han,
  • Yi Li,
  • Meng Xu,
  • Hegan Chen,
  • Wenkui Zhang,
  • Jingyi Chen,
  • Xumeng Zhang,
  • Xiaojuan Qi,
  • Dashan Shang,
  • Qi Liu,
  • Zhongrui Wang,
  • Kwang-Ting Cheng,
  • Ming Liu

摘要

Applications such as medical imaging, augmented and virtual reality, and embodied artificial intelligence (AI) depend on the ability to reconstruct complex signals from sparse observations. These applications are characterized by incomplete measurements and limited computational resources. Traditional approaches to digital hardware face the following challenges: explicit signal representations require heavy sampling and storage, data movement across the von Neumann bottleneck dominates energy and latency, and CMOS (complementary metal–oxide–semiconductor)-based circuits offer limited parallel efficiency. Here we present a software–hardware co-optimization framework for sparse-input signal reconstruction. At the software level, we use neural fields1 to implicitly represent signals using neural networks, which are further compressed by low-rank decomposition and structured pruning. At the hardware level, we design a resistive-memory-based computing-in-memory platform, featuring a Gaussian encoder and a multi-layer perceptron processing engine. The Gaussian encoder leverages the intrinsic stochasticity of resistive memory for efficient encoding, whereas the processing engine enables precise weight mapping through a hardware-aware quantization circuit. On a 40-nm 256 Kb resistive-memory macro, the system delivers 23.5×, 21.0× and 32.3× gains in projected energy efficiency, together with 10.8×, 38.8× and 6.2× gains in projected parallelism, for three-dimensional computed tomography sparse reconstruction, novel view synthesis and dynamic-scene novel view synthesis, without compromising on reconstruction quality. This work advances AI-driven signal reconstruction technology and paves the way for future efficient and robust medical AI and three-dimensional vision applications.