Deep Deterministic Policy Gradient (DDPG) is a deep reinforcement learning algorithm designed to solve decision-making problems in complex systems. DDPG has been extensively used for decision-making in various complex systems. However, DDPG has not been widely applied to the aircraft maintenance decision optimization, which is a crucial aspect of the aircraft Prognosis and Health Management (PHM). Evaluating the performance of DDPG first is essential, as it directly impacts the effectiveness of PHM systems and the determination of maintenance actions. This work investigates the performance of DDPG and compares it with Ant Colony Optimization (ACO) and Deep Q Network (DQN) algorithms within an aircraft maintenance simulation environment. Two types of typical aircraft systems, simple and complex, are defined and simulated in the environment as maintenance objects. We find that DDPG has a unique advantage in terms of training efficiency and solving efficiency when dealing with complex aircraft systems, which have both complex state spaces and action spaces. Besides, the accuracy of the DDPG algorithm’s solution and the rationality of its decisions are verified.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Comparative Evaluation of Deep Deterministic Policy Gradient on Aircraft Maintenance Decision Optimization

  • Yuxuan Sun,
  • Yilin Wang,
  • Joe Yin,
  • Yongsheng Yang,
  • Yuanxiang Li

摘要

Deep Deterministic Policy Gradient (DDPG) is a deep reinforcement learning algorithm designed to solve decision-making problems in complex systems. DDPG has been extensively used for decision-making in various complex systems. However, DDPG has not been widely applied to the aircraft maintenance decision optimization, which is a crucial aspect of the aircraft Prognosis and Health Management (PHM). Evaluating the performance of DDPG first is essential, as it directly impacts the effectiveness of PHM systems and the determination of maintenance actions. This work investigates the performance of DDPG and compares it with Ant Colony Optimization (ACO) and Deep Q Network (DQN) algorithms within an aircraft maintenance simulation environment. Two types of typical aircraft systems, simple and complex, are defined and simulated in the environment as maintenance objects. We find that DDPG has a unique advantage in terms of training efficiency and solving efficiency when dealing with complex aircraft systems, which have both complex state spaces and action spaces. Besides, the accuracy of the DDPG algorithm’s solution and the rationality of its decisions are verified.