Scholarlink

<p>Energy-efficient sampling with probabilistic neurons or <i>p-bits</i> has been demonstrated in the context of Boltzmann machines, and it is natural to ask if these approaches can be extended to the field of generative AI, where energy costs have become prohibitively large. However, this very active field is dominated by feedforward deep neural networks (DNNs), which primarily use multi-bit deterministic neurons with no role for sampling. In this paper, we first show that it is feasible to obtain superior accuracy through the use of multiple samples generated by probabilistic networks. This possibility raises the question of which option is energetically preferable for improving accuracy: generating more samples or adding more bits to a single deterministic sample. We provide a simple expression that can be used to estimate these energy tradeoffs and illustrate it with results for different algorithms and architectures.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Improving deep neural network performance through sampling

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年4月27日

查看全文
  • Lakshmi A. Ghantasala,
  • Ming-Che Li,
  • Risi Jaiswal,
  • Behtash Behin-Aein,
  • Joseph Makin,
  • Shreyas Sen,
  • Supriyo Datta

摘要

Energy-efficient sampling with probabilistic neurons or p-bits has been demonstrated in the context of Boltzmann machines, and it is natural to ask if these approaches can be extended to the field of generative AI, where energy costs have become prohibitively large. However, this very active field is dominated by feedforward deep neural networks (DNNs), which primarily use multi-bit deterministic neurons with no role for sampling. In this paper, we first show that it is feasible to obtain superior accuracy through the use of multiple samples generated by probabilistic networks. This possibility raises the question of which option is energetically preferable for improving accuracy: generating more samples or adding more bits to a single deterministic sample. We provide a simple expression that can be used to estimate these energy tradeoffs and illustrate it with results for different algorithms and architectures.