Sie befinden Sich nicht im Netzwerk der Universität Paderborn. Der Zugriff auf elektronische Ressourcen ist gegebenenfalls nur via VPN oder Shibboleth (DFN-AAI) möglich. mehr Informationen...
Visual Prosody and Speech Intelligibility: Head Movement Improves Auditory Speech Perception
Ist Teil von
Current directions in psychological science : a journal of the American Psychological Society, 2004-02, Vol.15 (2), p.133-137
Ort / Verlag
Los Angeles, CA: Blackwell Publishing
Erscheinungsjahr
2004
Link zum Volltext
Quelle
EBSCOhost Business Source Ultimate
Beschreibungen/Notizen
People naturally move their heads when they speak, and our study shows that this rhythmic head motion conveys linguistic information. Three-dimensional head and face motion and the acoustics of a talker producing Japanese sentences were recorded and analyzed. The head movement correlated strongly with the pitch (fundamental frequency) and amplitude of the talker's voice. In a perception study, Japanese subjects viewed realistic talking-head animations based on these movement recordings in a speech-in-noise task. The animations allowed the head motion to be manipulated without changing other characteristics of the visual or acoustic speech. Subjects correctly identified more syllables when natural head motion was present in the animation than when it was eliminated or distorted. These results suggest that nonverbal gestures such as head movements play a more direct role in the perception of speech than previously known.