Reinforcement Learning-Based Active Suspension Control Strategy with Safety Constraints
摘要
This study addresses the core challenge in traditional active suspension control systems: the difficulty in synergistically optimizing ride comfort and handling stability.
PurposeTo tackle this issue, a safety-constrained reinforcement learning control strategy is proposed to achieve multi-objective performance enhancement.
MethodsBy integrating physical safety constraints—including suspension dynamic deflection limits and tire dynamic load ranges—into the reinforcement learning framework, a novel Twin-Delayed Deep Deterministic Policy Gradient algorithm with safety boundary constraints (S-TD3) is designed. The algorithm combines a task-driven multi-objective reward function with a continuous soft-constraint reward mechanism, enabling the derivation of an optimal active suspension control policy through offline training. A comparative experimental framework is established on the MATLAB/Simulink platform, incorporating a Genetic Algorithm-optimized Linear Quadratic Regulator (GA-LQR) and the standard TD3 algorithm for benchmarking.
ResultsExperimental results demonstrate that the S-TD3 algorithm significantly outperforms the GA-LQR algorithm in all evaluated metrics. The proposed method not only enhances vehicle ride comfort but also ensures robust handling stability while reducing suspension dynamic deflection.
ConclusionThe S-TD3 algorithm effectively addresses the challenge of synergistically optimizing ride comfort and handling stability in active suspension systems, offering a significant improvement over existing methods.