Diffusion models have emerged as a catalyst for remarkable advancements in video editing tasks. Despite these achievements, the majority of research in video editing has predominantly focused on style and content manipulation, leaving action editing as a relatively uncharted territory. Video editing of human poses entails multiple challenges. Firstly, the generation of action sequences is vulnerable to artifacts, primarily caused by the influence of reference videos. Secondly, maintaining a consistent background and character appearance throughout the edited footage poses a significant challenge. In addition, most action control methodologies are highly dependent on the availability of large volumes of high-quality training data. To address these issues, we introduce PoseMaster, an innovative one-shot framework that significantly improves the video editing process. Specifically, we utilize a temporal fusion method to mitigate the sticky effects, thus improving the smoothness of the synthesized videos. Complementing this approach is the Pose-Controller Module, which plays a crucial role in ensuring action continuity. Our experiments validate the effectiveness of PoseMaster, demonstrating its ability to generate more realistic videos with a higher level of action consistency compared to existing methods. This achievement demonstrates a substantial advancement in human-centric video editing, paving the way for more refined and sophisticated video editing capabilities.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

PoseMaster: Editing Your Pose in a Video with a One-Shot Framework

  • Yiwen Liu,
  • Jianguo Jiang,
  • Min Yu,
  • Boquan Li,
  • Myung Hwan Na,
  • Gang Li

摘要

Diffusion models have emerged as a catalyst for remarkable advancements in video editing tasks. Despite these achievements, the majority of research in video editing has predominantly focused on style and content manipulation, leaving action editing as a relatively uncharted territory. Video editing of human poses entails multiple challenges. Firstly, the generation of action sequences is vulnerable to artifacts, primarily caused by the influence of reference videos. Secondly, maintaining a consistent background and character appearance throughout the edited footage poses a significant challenge. In addition, most action control methodologies are highly dependent on the availability of large volumes of high-quality training data. To address these issues, we introduce PoseMaster, an innovative one-shot framework that significantly improves the video editing process. Specifically, we utilize a temporal fusion method to mitigate the sticky effects, thus improving the smoothness of the synthesized videos. Complementing this approach is the Pose-Controller Module, which plays a crucial role in ensuring action continuity. Our experiments validate the effectiveness of PoseMaster, demonstrating its ability to generate more realistic videos with a higher level of action consistency compared to existing methods. This achievement demonstrates a substantial advancement in human-centric video editing, paving the way for more refined and sophisticated video editing capabilities.