<p>Non-negative matrix factorization (NMF) is a powerful technique for extracting latent structures from high-dimensional data, with applications spanning recommender systems, bioinformatics, and image processing. However, conventional digital hardware struggles to efficiently handle large-scale NMF due to computational complexity and memory bottlenecks. In this work, we propose an in-memory analog NMF solver based on a reconfigurable compact generalized inverse circuit, optimized using the conductance compensation principle. This circuit significantly reduces power consumption by minimizing the number of operational amplifiers while supporting various non-negative regression constraints. By integrating the alternating non-negative least squares algorithm, we achieve efficient and accurate factorization with a limited number of iterations. Experimental validation demonstrates the effectiveness of our analog NMF solver in real-world tasks, including image compression and collaborative filtering-based recommender systems, achieving high accuracy with orders-of-magnitude improvements in speed and energy efficiency over FPGA- and GPU-based digital solvers. These results highlight the potential of analog matrix computing for enabling real-time, large-scale NMF applications.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

In-memory analog computing for non-negative matrix factorization

  • Shiqing Wang,
  • Yubiao Luo,
  • Pushen Zuo,
  • Yongxiang Li,
  • Lunshuai Pan,
  • Daniele Ielmini,
  • Zhong Sun

摘要

Non-negative matrix factorization (NMF) is a powerful technique for extracting latent structures from high-dimensional data, with applications spanning recommender systems, bioinformatics, and image processing. However, conventional digital hardware struggles to efficiently handle large-scale NMF due to computational complexity and memory bottlenecks. In this work, we propose an in-memory analog NMF solver based on a reconfigurable compact generalized inverse circuit, optimized using the conductance compensation principle. This circuit significantly reduces power consumption by minimizing the number of operational amplifiers while supporting various non-negative regression constraints. By integrating the alternating non-negative least squares algorithm, we achieve efficient and accurate factorization with a limited number of iterations. Experimental validation demonstrates the effectiveness of our analog NMF solver in real-world tasks, including image compression and collaborative filtering-based recommender systems, achieving high accuracy with orders-of-magnitude improvements in speed and energy efficiency over FPGA- and GPU-based digital solvers. These results highlight the potential of analog matrix computing for enabling real-time, large-scale NMF applications.