Body Language Between Humans and Machines

In the last two decades, there has been an increasing interest in extending the communication between humans and machines from textual/verbal to nonverbal. Initially, interest has focused on facial behavior. However, there is now also considerable research on “body language,” such as gestures, posture, or proxemics. Research areas such as affective computing or social robotics have been developed to support and augment human-machine interaction by assessing human behavior and providing interpretations in affective, motivational, or socially pragmatic terms. Inversely, such work is providing physically embodied or virtual artificial entities with the capacity for nonverbal behavior. We report on the state of the art of nonverbal behavior between humans and machines concerning interpretation and production. We highlight some of the pitfalls and promises, for example, in using artificial systems to advance our understanding of human communication. Finally, we emphasize the need for interdisciplinary work to improve communication between humans and machines.