In this paper, we propose a novel quantization technique for Bayesian deep learning aimed at enhancing efficiency without compromising performance. Our approach leverages post-training quantization to significantly reduce the memory footprint of stochastic gradient samplers, particularly Stochastic Gradient Markov Chain Monte Carlo (SG-MCMC) methods. This technique achieves a level of compression comparable to optimal thinning, which traditionally necessitates not only the original samples in single precision floating-point representation but also the gradients, resulting in substantial computational overhead. In contrast, our quantization method requires only the original samples and can accurately recover posterior modes through a simple affine transformation. This process incurs minimal additional memory or computational costs, making it a highly efficient alternative for Bayesian deep learning applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Quantized SG-MCMC for Bayesian Deep Posterior Compression

  • Sergio Hernández,
  • Xaviera López-Cortes

摘要

In this paper, we propose a novel quantization technique for Bayesian deep learning aimed at enhancing efficiency without compromising performance. Our approach leverages post-training quantization to significantly reduce the memory footprint of stochastic gradient samplers, particularly Stochastic Gradient Markov Chain Monte Carlo (SG-MCMC) methods. This technique achieves a level of compression comparable to optimal thinning, which traditionally necessitates not only the original samples in single precision floating-point representation but also the gradients, resulting in substantial computational overhead. In contrast, our quantization method requires only the original samples and can accurately recover posterior modes through a simple affine transformation. This process incurs minimal additional memory or computational costs, making it a highly efficient alternative for Bayesian deep learning applications.