In recent years, a growing number of works on human motion generation based on LLMs (Large Language Models) have emerged, achieving substantial improvements compared to traditional methods. However, due to the reliance on LLMs, most existing approaches involve massive parameter scales, which lead to high training costs, large storage overhead, and slow inference speed. To address these challenges, we propose a lightweight human motion generation framework based on LLMs, incorporating SFT (Supervised Fine-tuning) and reinforcement learning with RLOO (REINFORCE Leave-One-Out). To the best of our knowledge, this is the first work that introduces the SFT+RLOO paradigm into the LLM-based motion generation field. Our lightweight framework reduces the parameter scale to 1.5B. Experimental results demonstrate that our method effectively reduces computational cost during training and inference, significantly lowers storage requirements, and achieves performance that is comparable to or even surpasses SOTA (state-of-the-art) methods across major metrics.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MotionSlim: A Lightweight T2M Generation Framework Based on LLM

  • Congrui Yu,
  • Bo Fan,
  • Na Lyu

摘要

In recent years, a growing number of works on human motion generation based on LLMs (Large Language Models) have emerged, achieving substantial improvements compared to traditional methods. However, due to the reliance on LLMs, most existing approaches involve massive parameter scales, which lead to high training costs, large storage overhead, and slow inference speed. To address these challenges, we propose a lightweight human motion generation framework based on LLMs, incorporating SFT (Supervised Fine-tuning) and reinforcement learning with RLOO (REINFORCE Leave-One-Out). To the best of our knowledge, this is the first work that introduces the SFT+RLOO paradigm into the LLM-based motion generation field. Our lightweight framework reduces the parameter scale to 1.5B. Experimental results demonstrate that our method effectively reduces computational cost during training and inference, significantly lowers storage requirements, and achieves performance that is comparable to or even surpasses SOTA (state-of-the-art) methods across major metrics.