We propose a system to retrieve background music (BGM) for game scenes. BGM plays an important role in creating a particular atmosphere in game scenes, so studies have investigated the relationship between game scenes and BGM. However, none of the existing studies attempted to predict the audio features of BGM directly from a sequence of images expressing game scenes. In our system, the user inputs a sequence of images of a game scene, then our machine learning model, trained with gameplay videos, predicts the audio features from the input. Finally, the system retrieves the closest musical piece to the predicted audio features. Experimental results show both positive and negative tendencies: the predicted audio features for fight scenes are closer to the features of actually used BGM in fight scenes than those in other scenes (positive); the same musical piece was retrieved for different scenes (negative).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Predicting Audio Features of Background Music From Game Scenes

  • Ryusei Hayashi,
  • Tetsuro Kitahara

摘要

We propose a system to retrieve background music (BGM) for game scenes. BGM plays an important role in creating a particular atmosphere in game scenes, so studies have investigated the relationship between game scenes and BGM. However, none of the existing studies attempted to predict the audio features of BGM directly from a sequence of images expressing game scenes. In our system, the user inputs a sequence of images of a game scene, then our machine learning model, trained with gameplay videos, predicts the audio features from the input. Finally, the system retrieves the closest musical piece to the predicted audio features. Experimental results show both positive and negative tendencies: the predicted audio features for fight scenes are closer to the features of actually used BGM in fight scenes than those in other scenes (positive); the same musical piece was retrieved for different scenes (negative).