Machine Learning-Driven Emotion Recognition Through Facial Landmark Analysis
摘要
This research aims to classify affective states of emotion based on facial landmarks using machine learning. It utilizes the ASCERTAIN dataset to capture facial landmark trajectory signals, which track the movement patterns of specific facial regions, such as the lips, nose, and eye corners, over time. By analyzing these trajectories, the study seeks to develop a robust emotion estimation system. Three machine learning algorithms were evaluated: Logistic Regression (LR), K-Nearest Neighbors (KNN), and Linear Discriminant Analysis (LDA). Among these, Logistic Regression showed superior performance, achieving 98.95% accuracy and an F1-score of 0.99 for both arousal and valence classifications. The effectiveness of the proposed system was assessed using multiple evaluation metrics, including Cohen’s Kappa, Precision, Recall, F1-score, Accuracy, and ROC-AUC (Receiver Operating Characteristic - Area Under the Curve). Findings indicate that the LR model outperformed state-of-the-art methods, suggesting that this approach could be a valuable tool for automated emotion recognition and decision-making based on variations in emotional states.