Cross-modal Coordination of Expressive Strength between Voice and Gesture for Personified Media
| Citations: | 2 - 1 self |
BibTeX
@MISC{Yonezawa_cross-modalcoordination,
author = {Tomoko Yonezawa and Noriko Suzuki},
title = {Cross-modal Coordination of Expressive Strength between Voice and Gesture for Personified Media},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
The aim of this paper is to clarify the relationship between the expressive strengths of gestures and voice for embodied and personified interfaces. We conduct perceptual tests using a puppet interface, while controlling singing-voice expressions, to empirically determine the naturalness and strength of various combinations of gesture and voice. The results show that (1) the strength of cross-modal perception is affected more by gestural expression than by the expressions of a singing voice, and (2) the appropriateness of cross-modal perception is affected by expressive combinations between singing voice and gestures in personified expressions. As a promising solution, we propose balancing a singing voice and gestural expressions by expanding and correcting the width and shape of the curve of expressive strength in the singing voice. Categories and Subject Descriptors
Keyphrases
expressive strength singing voice cross-modal coordination personified medium cross-modal perception gestural expression perceptual test promising solution personified expression various combination personified interface subject descriptor puppet interface singing-voice expression expressive combination
