Results 1 -
5 of
5
Synchrony and copying in conversational interactions
- In The 3rd Nordic Symposium on Multimodal Interaction
, 2011
"... This paper describes nonverbal communica-tion in conversations, and focuses especially on the interlocutors ’ synchrony and copying of each other’s behaviour. Synchrony and copying indicate the speakers ’ cooperation with each other, and manifest in the speakers’ use of the same words or similar syn ..."
Abstract
-
Cited by 1 (0 self)
- Add to MetaCart
(Show Context)
This paper describes nonverbal communica-tion in conversations, and focuses especially on the interlocutors ’ synchrony and copying of each other’s behaviour. Synchrony and copying indicate the speakers ’ cooperation with each other, and manifest in the speakers’ use of the same words or similar syntactic patterns in their utterances, adjusting their in-tonation as well as aligning their nonverbal behaviour. We point out some repeated pat-terns of nonverbal communication in three-party conversations, and offer some interpre-tations for them. 1
Multimodal Corpus of Multi-Party Conversations in Second Language
"... We developed a dialogue-based tutoring system for teaching English to Japanese students and plan to transfer the current software tutoring agent into an embodied robot in the hope that the robot will enrich conversation by allowing more natural interactions in small group learning situations. To ena ..."
Abstract
-
Cited by 1 (1 self)
- Add to MetaCart
We developed a dialogue-based tutoring system for teaching English to Japanese students and plan to transfer the current software tutoring agent into an embodied robot in the hope that the robot will enrich conversation by allowing more natural interactions in small group learning situations. To enable smooth communication between an intelligent agent and the user, the agent must have realistic models on when to take turns, when to interrupt, and how to catch the partner’s attention. For developing the realistic models applicable for computer assisted language learning systems, we also need to consider the differences between the mother tongue and second language that affect communication style. We collected a multimodal corpus of multi-party conversations in English as the second language to investigate the differences in communication styles. We describe our multimodal corpus and explore features of communication style e.g. filled pauses, and non-verbal information, such as eye-gaze, which show different characteristics between the mother tongue and second language.
Situated language understanding at 25 miles per hour
- In. Proc. of the SIGDIAL - Annual Meeting on Discourse and Dialogue
, 2014
"... In this paper, we address issues in situ-ated language understanding in a rapidly changing environment – a moving car. Specifically, we propose methods for un-derstanding user queries about specific tar-get buildings in their surroundings. Unlike previous studies on physically situated in-teractions ..."
Abstract
-
Cited by 1 (0 self)
- Add to MetaCart
(Show Context)
In this paper, we address issues in situ-ated language understanding in a rapidly changing environment – a moving car. Specifically, we propose methods for un-derstanding user queries about specific tar-get buildings in their surroundings. Unlike previous studies on physically situated in-teractions such as interaction with mobile robots, the task is very sensitive to tim-ing because the spatial relation between the car and the target is changing while the user is speaking. We collected situated utterances from drivers using our research system, Townsurfer, which is embedded in a real vehicle. Based on this data, we analyze the timing of user queries, spa-tial relationships between the car and tar-gets, head pose of the user, and linguis-tic cues. Optimized on the data, our al-gorithms improved the target identification rate by 24.1 % absolute. 1
Non-verbal signals for turn-taking and feedback
"... Abstract This paper concerns non-verbal communication, and describes especially the use of eye-gaze to signal turn-taking and feedback in conversational settings. Eye-gaze supports smooth interaction by providing signals that the interlocutors interpret with respect to such conversational functions ..."
Abstract
- Add to MetaCart
(Show Context)
Abstract This paper concerns non-verbal communication, and describes especially the use of eye-gaze to signal turn-taking and feedback in conversational settings. Eye-gaze supports smooth interaction by providing signals that the interlocutors interpret with respect to such conversational functions as taking turns and giving feedback. New possibilities to study the effect of eye-gaze on the interlocutors' communicative behaviour have appeared with the eye-tracking technology which in the past years has matured to the level where its use to study naturally occurring dialogues have become easier and more reliable to conduct. It enables the tracking of eye-fixations and gaze-paths, and thus allows analysis of the person's turn-taking and feedback behaviour through the analysis of their focus of attention. In this paper, experiments on the interlocutors' non-verbal communication in conversational settings using the eye-tracker are reported, and results of classifying turn-taking using eye-gaze and gesture information are presented. Also the hybrid method that combines signal level analysis with human interpretation is discussed.
Evaluating Corpora Documentation with regards to the Ethics and Big Data Charter
"... The authors have written the Ethics and Big Data Charter in collaboration with various agencies, private bodies and associations. This Charter aims at describing any large or complex resources, and in particular language resources, from a legal and ethical viewpoint and ensuring the transparency of ..."
Abstract
- Add to MetaCart
(Show Context)
The authors have written the Ethics and Big Data Charter in collaboration with various agencies, private bodies and associations. This Charter aims at describing any large or complex resources, and in particular language resources, from a legal and ethical viewpoint and ensuring the transparency of the process of creating and distributing such resources. We propose in this article an analysis of the docu-mentation coverage of the most frequently mentioned language resources with regards to the Charter, in order to show the benefit it offers.
