Optimized Conversational Gesture Generation with Enhanced Motion Feature Extraction and Cascaded Generator
摘要
Conversational gesture generation holds pivotal importance in enhancing the natural flow of digital human interaction. However, the inherent weak correlation between gestures and language poses a significant challenge for automated gesture generation systems. Existing methods have shortcomings in the quality of generated gestures and inference speed. In this paper, we propose an optimized method for conversational gesture generation. By training a more powerful motion feature extraction network, the connotation of different motions can be accurately grasped. Moreover, we utilize a two-level cascaded generator, which initially produces broad movements such as arm gestures, followed by generating finer gestures like finger movements. To enhance network convergence and stability, we integrate multiple loss terms and implement refined training strategies. These measures collectively contribute to the improved quality of the final generated gestures. Additionally, we employ GRU as the backbone network, striking a balance between generation quality and computational efficiency. Both subjective and objective experiments demonstrate that our method achieves a remarkable inference speed while generating high-quality gestures.