错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

COMET : “cone of experience” enhanced large multimodal model for mathematical problem generation

  • Sannyuya Liu,
  • Jintian Feng,
  • Zongkai Yang,
  • Yawei Luo,
  • Qian Wan,
  • Xiaoxuan Shen,
  • Jianwen Sun

摘要

We propose COMET, a “cone of experience” enhanced LMM for mathematical problem generation. To explore the possibility of analogy LMM training to human learning, we define the teacher growth process into three level experiences based on the “cone of experience” educational theory and guide the construction of training data at different stages. A three-stage fine-tuning framework is designed to enhance the capabilities of stem generation and problem-solving within a single LMM to meet the requirements of educational applications. Moreover, a CMM12K is built to alleviate the scarcity of Chinese multimodal corpora in this field. Extensive experiments have demonstrated the advancement and effectiveness of the proposed model and framework.