Real-time emotion identification is an innovation in the field of human–computer interaction, which is an essential and challenging task. The existing studies’ methods for identifying emotions include face, audio, and physiological signals. The study aims to develop a model for emotion classification to identify and interpret human emotions through skin temperature, respiration, and plethysmography. The study also includes analyzing and interpreting emotional states through ensemble models. The classification is based on the frequency domain signal components extracted using the Fast Fourier Transform (FFT), such as amplitude and frequency, to identify emotional states. Ensemble-based machine learning algorithms such as XGBoost and LGBM achieved the highest accuracy in classifying various emotional states. The study involves unimodal and ensemble methods to analyze the signals. The comparative classification rate of unimodal results with ensemble shows that it is the highest at 85.99%, achieved for sad emotions by XGBoost. Fusing modules like respiration, skin temperature, and plethysmography maintains the accuracy level for all four emotions. The unimodal temperature has the highest accuracy of 86.1% for calm, whereas the fusion model has maintained accuracy for all the emotional states. The feature amplitude is the most promising feature for the classification method, which attains an average of 83.2% for XGBoost. The applications enhance user experiences and contribute valuable help in psychology, mental health care, and Human–Computer Interaction.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Feature Fusion Classification for Emotional Intelligence Using Peripheral Signals

  • P. Y. Preema,
  • J. Chandra,
  • C. Steffi Angel

摘要

Real-time emotion identification is an innovation in the field of human–computer interaction, which is an essential and challenging task. The existing studies’ methods for identifying emotions include face, audio, and physiological signals. The study aims to develop a model for emotion classification to identify and interpret human emotions through skin temperature, respiration, and plethysmography. The study also includes analyzing and interpreting emotional states through ensemble models. The classification is based on the frequency domain signal components extracted using the Fast Fourier Transform (FFT), such as amplitude and frequency, to identify emotional states. Ensemble-based machine learning algorithms such as XGBoost and LGBM achieved the highest accuracy in classifying various emotional states. The study involves unimodal and ensemble methods to analyze the signals. The comparative classification rate of unimodal results with ensemble shows that it is the highest at 85.99%, achieved for sad emotions by XGBoost. Fusing modules like respiration, skin temperature, and plethysmography maintains the accuracy level for all four emotions. The unimodal temperature has the highest accuracy of 86.1% for calm, whereas the fusion model has maintained accuracy for all the emotional states. The feature amplitude is the most promising feature for the classification method, which attains an average of 83.2% for XGBoost. The applications enhance user experiences and contribute valuable help in psychology, mental health care, and Human–Computer Interaction.