Deception detection is essential for establishing a secure and reliable society. It plays a critical role in high-stakes circumstances like court trials or police interrogations, when the result is greatly impacted by the behaviour of the individual being investigated. Facial expressions can serve as valuable cues for detecting deception, which is a challenging task due to the ability of deceptive individuals to mask their true feelings or intentions. Besides, facial landmarks, essential locations on the face utilized to identify facial muscle movement and shape changes, play an important role in determining deceptive behaviour. Facial landmark detection is crucial in several applications, including facial analysis for 3D reconstruction and expression. It provides a substantial amount of information about an individual. This paper addresses 3D facial landmark extraction, feature selection, and a Bi-directional Long Short-Term Memory (Bi-LSTM) model. Firstly, the Mediapipe framework extracted 478 facial landmarks with coordinates (x, y, z) to enhance the reliability and precision of deception. Next, the 3D facial landmarks most relevant to deception cues were selected using a feature selection-based Pearson correlation coefficient method. Then, 3D facial landmarks are used to train a Bi-LSTM model that predicts deception from truth-tellers using a high-stakes real-life trial dataset. Finally, the model successfully achieved an accuracy of 97%, surpassing other state-of-the-art methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

High-Stakes Deception Detection Leveraging 3D Facial Landmarks

  • Amira Abbas Hussein,
  • Israa H. Ali

摘要

Deception detection is essential for establishing a secure and reliable society. It plays a critical role in high-stakes circumstances like court trials or police interrogations, when the result is greatly impacted by the behaviour of the individual being investigated. Facial expressions can serve as valuable cues for detecting deception, which is a challenging task due to the ability of deceptive individuals to mask their true feelings or intentions. Besides, facial landmarks, essential locations on the face utilized to identify facial muscle movement and shape changes, play an important role in determining deceptive behaviour. Facial landmark detection is crucial in several applications, including facial analysis for 3D reconstruction and expression. It provides a substantial amount of information about an individual. This paper addresses 3D facial landmark extraction, feature selection, and a Bi-directional Long Short-Term Memory (Bi-LSTM) model. Firstly, the Mediapipe framework extracted 478 facial landmarks with coordinates (x, y, z) to enhance the reliability and precision of deception. Next, the 3D facial landmarks most relevant to deception cues were selected using a feature selection-based Pearson correlation coefficient method. Then, 3D facial landmarks are used to train a Bi-LSTM model that predicts deception from truth-tellers using a high-stakes real-life trial dataset. Finally, the model successfully achieved an accuracy of 97%, surpassing other state-of-the-art methods.