Predicting Audio Features of Background Music From Game Scenes
摘要
We propose a system to retrieve background music (BGM) for game scenes. BGM plays an important role in creating a particular atmosphere in game scenes, so studies have investigated the relationship between game scenes and BGM. However, none of the existing studies attempted to predict the audio features of BGM directly from a sequence of images expressing game scenes. In our system, the user inputs a sequence of images of a game scene, then our machine learning model, trained with gameplay videos, predicts the audio features from the input. Finally, the system retrieves the closest musical piece to the predicted audio features. Experimental results show both positive and negative tendencies: the predicted audio features for fight scenes are closer to the features of actually used BGM in fight scenes than those in other scenes (positive); the same musical piece was retrieved for different scenes (negative).