Coordinating Music Signals and Electrocardiogram Signals in a Shared Valence-Arousal Emotional Space
摘要
Music signals and electrocardiogram (ECG) signals have different semantics. Quantifying their relationships has a wide range of real-world applications such as personalized music recommendation, music composition, and music digital therapeutics. However, this task remains underexplored due to the absence of an explicit and measurable link between music and ECG signals. In this paper, we propose CardioMusic to bridge this gap based on a shared valence-arousal (VA) emotional space. CardioMusic is a two-branch deep learning model which first embeds music signals and ECG signals into latent features, then projects the separate latent features into a shared emotional space by learning their emotional similarities using VA values. Experimental results demonstrate that CardioMusic effectively captures the VA values of both music and ECG signals and aligns them within the shared VA emotional space.