Scholarlink

The computational resources required for deep reinforcement learning (RL) model training are challenging for many applications with computational resource constraints. Low-precision methods are a promising avenue to alleviate computational bottlenecks and reduce the time, memory, and power required for model training. A notional drawback to low-precision training methods is that the benefits depend on model complexity and Graphical Processing Unit (GPU) hardware capabilities. In this work, we will address this notion and gap in the literature and investigate how the benefits of low-precision training methods scale with GPU capabilities and model complexity by benchmarking GPU resource usage using state-of-the-art system profiling methods for Soft Actor-Critic (SAC) deep RL agents trained on control environments for a range of model configurations and NVidia GPUs spanning from edge devices to data science grade desktop cards.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Understanding GPU Architecture Influences on Low-Precision Deep Reinforcement Learning Performance

  • 会议论文

  • 发表日期：

    2025年

查看全文
  • Christopher Hixenbaugh,
  • Eugene Chabot,
  • Alfa Heryudono

摘要

The computational resources required for deep reinforcement learning (RL) model training are challenging for many applications with computational resource constraints. Low-precision methods are a promising avenue to alleviate computational bottlenecks and reduce the time, memory, and power required for model training. A notional drawback to low-precision training methods is that the benefits depend on model complexity and Graphical Processing Unit (GPU) hardware capabilities. In this work, we will address this notion and gap in the literature and investigate how the benefits of low-precision training methods scale with GPU capabilities and model complexity by benchmarking GPU resource usage using state-of-the-art system profiling methods for Soft Actor-Critic (SAC) deep RL agents trained on control environments for a range of model configurations and NVidia GPUs spanning from edge devices to data science grade desktop cards.