<p>The vibration and noise of the gearbox in a car transmission are directly related to the safety and comfort of the car. Therefore, this study constructs a rigid flexible coupled multibody dynamics model of the gearbox transmission system, and combines vibration signal feedback proportional integral derivative control to simulate and control gearbox fault signals. The outcomes indicated that the established gearbox model conformed to the principles of dynamics. The peak support force of the uncoupled planetary carrier gearbox was 97.68, which was 36.7% higher than the peak value after coupling. The maximum error between the simulated signals of the four measurement points in the simulation model and the actual calculated values was 7.3%, and the minimum was 4.7%. The fractional order proportional integral derivative control method had a maximum value of about 0.3 under different control conditions, and there was no collision state, which was more stable than the integer order proportional integral derivative control and non-proportional integral derivative control. The proposed method improves simulation accuracy and vibration suppression performance under time-varying mesh stiffness, and has higher stability and robustness than traditional methods. Therefore, this research method can effectively simulate and control the vibration signals of the gearbox.</p>