Commercial facial expression recognition tools, such as FaceReader 9©, are often used as off-the-shelf solutions in applied research and industry. However, their real-world generalization capacity, especially in dynamic and unconstrained environments, is rarely scrutinized. This study evaluates the zero-shot performance of FaceReader 9 on two standardized dynamic datasets, RAVDESS and CREMA-D, and compares its results with several publicly available state-of-the-art FER models. The results reveal that FaceReader 9 is significantly outperformed across all metrics, with accuracy levels close to random chance on the more challenging dataset. In contrast, even static models trained on general-purpose datasets perform markedly better, and a dynamic model specifically trained on the evaluation datasets achieves a substantial performance gain. These findings emphasize the limitations of commercial FER systems in dynamic contexts and highlight the value of task-specific training and temporal modeling for robust emotion recognition.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Zero-Shot Evaluation of Commercial Software and State-of-the-Art FER Models on Standardized Datasets

  • José Salas-Cáceres,
  • Javier Lorenzo-Navarro,
  • Modesto Castrillón-Santana,
  • Patricia Picazo-Peral,
  • Sergio Moreno-Gil

摘要

Commercial facial expression recognition tools, such as FaceReader 9©, are often used as off-the-shelf solutions in applied research and industry. However, their real-world generalization capacity, especially in dynamic and unconstrained environments, is rarely scrutinized. This study evaluates the zero-shot performance of FaceReader 9 on two standardized dynamic datasets, RAVDESS and CREMA-D, and compares its results with several publicly available state-of-the-art FER models. The results reveal that FaceReader 9 is significantly outperformed across all metrics, with accuracy levels close to random chance on the more challenging dataset. In contrast, even static models trained on general-purpose datasets perform markedly better, and a dynamic model specifically trained on the evaluation datasets achieves a substantial performance gain. These findings emphasize the limitations of commercial FER systems in dynamic contexts and highlight the value of task-specific training and temporal modeling for robust emotion recognition.