<p>Accurate measurement of bladder volume is essential for diagnosing urinary retention and voiding dysfunction. However, finding optimal view can be challenging for less experienced operators, potentially leading to suboptimal imaging and potential misdiagnoses. This study proposes an intelligent guidance system leveraging reinforcement learning (RL) to improve the acquisition of ultrasound images in ultrasound bladder scanning procedure. We introduce a novel pipeline that incorporates a practical variant of Deep Q-Networks (DQN), known as Adam LMCDQN, which is theoretically validated within linear Markov Decision Processes. Our system aims to offer real-time, adaptive feedback to operators, improving image quality and consistency. We also present a novel domain-specific reward design for reinforcement learning (RL), incorporating domain knowledge to enhance performance. Our results demonstrate a promising <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(81 \%\)</EquationSource> </InlineEquation> success rate in reaching target points along the transverse direction and <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(67 \%\)</EquationSource> </InlineEquation> along the longitudinal direction, significantly outperforming supervised deep learning models, which achieved <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(58 \%\)</EquationSource> </InlineEquation> and <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(32 \%\)</EquationSource> </InlineEquation>, respectively. This work is among the first to apply RL in ultrasound guidance for bladder assessment, demonstrating the technical feasibility of optimal-view localization in a simulated environment and exploring exploration strategies and reward formulations relevant to the guidance task.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Active guidance in ultrasound bladder scanning using reinforcement learning

  • Hao-Lun Hsu,
  • Mohsen Zahiri,
  • Gary Y. Li,
  • Rashid Al Mukaddim,
  • HyeonWoo Lee,
  • Martha Grewe Wilson,
  • Joyce Grube,
  • Stephen Schmidt,
  • Goutam Ghoshal,
  • Balasundar Raju

摘要

Accurate measurement of bladder volume is essential for diagnosing urinary retention and voiding dysfunction. However, finding optimal view can be challenging for less experienced operators, potentially leading to suboptimal imaging and potential misdiagnoses. This study proposes an intelligent guidance system leveraging reinforcement learning (RL) to improve the acquisition of ultrasound images in ultrasound bladder scanning procedure. We introduce a novel pipeline that incorporates a practical variant of Deep Q-Networks (DQN), known as Adam LMCDQN, which is theoretically validated within linear Markov Decision Processes. Our system aims to offer real-time, adaptive feedback to operators, improving image quality and consistency. We also present a novel domain-specific reward design for reinforcement learning (RL), incorporating domain knowledge to enhance performance. Our results demonstrate a promising \(81 \%\) success rate in reaching target points along the transverse direction and \(67 \%\) along the longitudinal direction, significantly outperforming supervised deep learning models, which achieved \(58 \%\) and \(32 \%\) , respectively. This work is among the first to apply RL in ultrasound guidance for bladder assessment, demonstrating the technical feasibility of optimal-view localization in a simulated environment and exploring exploration strategies and reward formulations relevant to the guidance task.