A Computer Vision Perspective on Emotional Intelligence

In this chapter, we will be focusing on computer vision techniques and approaches dedicated to understanding the emotional state and the intentions of a human interlocutor. These will be discussed in such a way that would include, in parallel, both the computer vision and the human psychology perspective. In the beginning, the normal anatomical and psychological traits of the human face and eyes are going to be used to establish the baselines that can act as a reference in the case of lack of communication and expected behavior. We especially emphasize the aspects of detection and recognition of emotional-related impairments and disorders. Furthermore, the computer vision techniques related to face expression understanding and gaze tracking will be reviewed and summarized. We will be discussing the main approaches to face and face parts analysis, putting an emphasis on the eye, and their potential use in various psychological and neurological experiments. Finally, the contribution will conclude with a wide range of challenges that must be overcome until artificial emotional intelligence comes truthfully in fruition.