Seeing is believing: body motion dominates in multisensory conversations

Ennis, Cathy, McDonnell, Rachel and O'Sullivan, Carol (2010) Seeing is believing: body motion dominates in multisensory conversations. ACM Transactions on Graphics (TOG), 29 (4). ISSN 1557-7368

Full text not available from this repository.

Abstract

In many scenes with human characters, interacting groups are an important factor for maintaining a sense of realism. However, little is known about what makes these characters appear realistic. In this paper, we investigate human sensitivity to audio mismatches (i.e., when individuals' voices are not matched to their gestures) and visual desynchronization (i.e., when the body motions of the individuals in a group are mis-aligned in time) in virtual human conversers. Using motion capture data from a range of both polite conversations and arguments, we conduct a series of perceptual experiments and determine some factors that contribute to the plausibility of virtual conversing groups. We found that participants are more sensitive to visual desynchronization of body motions, than to mismatches between the characters' gestures and their voices. Furthermore, synthetic conversations can appear sufficiently realistic once there is an appropriate balance between talker and listener roles. This is regardless of body motion desynchronization or mismatched audio.

Item Type:	Article
Subjects:	Q Science > QA Mathematics > Electronic computers. Computer science T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science
Divisions:	School of Computing > Staff Research and Publications
Depositing User:	Caoimhe Ní Mhaicín
Date Deposited:	07 Oct 2014 13:59
Last Modified:	07 Oct 2014 13:59
URI:	https://norma.ncirl.ie/id/eprint/1608

Actions (login required)

View Item