Communicating off the top of your head

Forget lip-reading, the way the top of the head moves as we speak also plays a part in communication, a finding that has implications for creating more realistic animated characters.

In an initial experiment, Chris Davis and Jeesun Kim presented students with silent videos that showed the top half of a man’s head as he read out various sentences.

When presented with two pairs of such videos, one in which the man read the same sentence out in each video, and another in which he read different sentences, the students were able to use the movement of the top of his head to judge better than chance which pair was the same and which was different. Note that in the matching pair, the videos were not identical – the man was recorded reading the same sentence on two separate occasions.

Performance was also better than chance when the students had to match the sound of the man reading a sentence with the correct silent video that showed only the top half of his head as he read the same sentence.

In both cases, performance was better when the man was reading an expressive sentence like “that is really annoying; I have to let you know” rather than a mundane sentence like “the jacket hung on the back of the wide chair”.

In a further experiment, the sound of a person speaking was deliberately distorted. This time, the student participants were able to correctly recognise more words if the sound was accompanied by a video showing only the outline of the top of half of the head of the person who was speaking. Again, the sight of the top of the head provided greater advantage if the speaker was uttering an expressive sentence.

“That people are sensitive to speech related upper head movements makes it clear that the production of natural looking virtual characters will need to consider more than the correct animation of the mouth and jaw”, the researchers said.
__________________________________

Davis, C. & Kim, J. (2006). Audio-visual speech perception off the top of the head. Cognition, 100, B21-B31.

You have read this article Social with the title Communicating off the top of your head. You can bookmark this page URL https://psychiatryfun.blogspot.com/2006/07/communicating-off-top-of-your-head.html. Thanks!