In recent years, the research on Hybrid Electric Vehicles (HEVs) has received widespread attention. The Power Transmission System of hybrid vehicles often exhibits poor vibration performance due to engine torque fluctuations. To address this issue, this paper proposes a multi-channel Active Vibration Control (AVC) strategy based on FxLMS algorithm to compensate for the vibration response caused by engine torque fluctuations by controlling the motor torque of hybrid vehicles. Firstly, a dynamic model of the drivetrain system is established, and the dynamic model is simplified based on sensitivity analysis. Secondly, a multi-channel notch adaptive control strategy based on reinforcement learning is proposed, which updates the parameters of the notch adaptive algorithm through FxLMS algorithm to achieve vibration attenuation of the system. Thirdly, through simulation analysis under different operating conditions, this study confirms the effectiveness and stability of the FxLMS-based AVC algorithm.