Results 1 - 10
of
27
Social Signal Processing: Survey of an Emerging Domain
, 2008
"... The ability to understand and manage social signals of a person we are communicating with is the core of social intelligence. Social intelligence is a facet of human intelligence that has been argued to be indispensable and perhaps the most important for success in life. This paper argues that next- ..."
Abstract
-
Cited by 153 (32 self)
- Add to MetaCart
The ability to understand and manage social signals of a person we are communicating with is the core of social intelligence. Social intelligence is a facet of human intelligence that has been argued to be indispensable and perhaps the most important for success in life. This paper argues that next-generation computing needs to include the essence of social intelligence – the ability to recognize human social signals and social behaviours like turn taking, politeness, and disagreement – in order to become more effective and more efficient. Although each one of us understands the importance of social signals in everyday life situations, and in spite of recent advances in machine analysis of relevant behavioural cues like blinks, smiles, crossed arms, laughter, and similar, design and development of automated systems for Social Signal Processing (SSP) are rather difficult. This paper surveys the past efforts in solving these problems by a computer, it summarizes the relevant findings in social psychology, and it proposes a set of recommendations for enabling the development of the next generation of socially-aware computing.
Automatic Role Recognition in Multiparty Recordings: Using Social Affiliation Networks for Feature Extraction
"... Abstract—Automatic analysis of social interactions attracts increasing attention in the multimedia community. This paper considers one of the most important aspects of the problem, namely the roles played by individuals interacting in different settings. In particular, this work proposes an automati ..."
Abstract
-
Cited by 18 (6 self)
- Add to MetaCart
(Show Context)
Abstract—Automatic analysis of social interactions attracts increasing attention in the multimedia community. This paper considers one of the most important aspects of the problem, namely the roles played by individuals interacting in different settings. In particular, this work proposes an automatic approach for the recognition of roles in both production environment contexts (e.g., news and talk-shows) and spontaneous situations (e.g., meetings). The experiments are performed over roughly 90 hours of material (one of the largest databases used for role recognition in the literature) and show that the recognition effectiveness depends on how much the roles influence the behavior of people. Furthermore, this work proposes the first approach for modeling mutual dependences between roles and assesses its effect on role recognition performance.
Socially intelligent surveillance and monitoring: Analysing social dimensions of physical space
- In: IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW
, 2010
"... Socially intelligent surveillance and monitoring: ..."
Abstract
-
Cited by 14 (11 self)
- Add to MetaCart
(Show Context)
Socially intelligent surveillance and monitoring:
Rolenet: Movie analysis from the perspective of social networks
- IEEE Transactions on Multimedia
, 2009
"... Abstract—With the idea of social network analysis, we propose a novel way to analyze movie videos from the perspective of social relationships rather than audiovisual features. To appropriately describe role’s relationships in movies, we devise a method to quantify relations and construct role’s soc ..."
Abstract
-
Cited by 11 (0 self)
- Add to MetaCart
(Show Context)
Abstract—With the idea of social network analysis, we propose a novel way to analyze movie videos from the perspective of social relationships rather than audiovisual features. To appropriately describe role’s relationships in movies, we devise a method to quantify relations and construct role’s social networks, called RoleNet. Based on RoleNet, we are able to perform semantic analysis that goes beyond conventional feature-based approaches. In this work, social relations between roles are used to be the context information of video scenes, and leading roles and the corresponding communities can be automatically determined. The results of community identification provide new alternatives in media management and browsing. Moreover, by describing video scenes with role’s context, social-relation-based story segmentation method is developed to pave a new way for this widely-studied topic. Experimental results show the effectiveness of leading role determination and community identification. We also demonstrate that the social-based story segmentation approach works much better than the conventional tempo-based method. Finally, we give extensive discussions and state that the proposed ideas provide insights into context-based video analysis. Index Terms—Community analysis, movie understanding, social network analysis, story segmentation. I.
Programming the social computer
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
, 1987
"... human–computer interaction ..."
(Show Context)
ARE YOU A WEREWOLF? DETECTING DECEPTIVE ROLES AND OUTCOMES IN A CONVERSATIONAL ROLE-PLAYING GAME
"... This paper addresses the task of automatically detecting outcomes of social interaction patterns, using non-verbal audio cues in competitive role-playing games (RPGs). For our experiments, we introduce a new data set which features 3 hours of audio-visual recordings of the popular “Are you a Werewol ..."
Abstract
-
Cited by 5 (2 self)
- Add to MetaCart
(Show Context)
This paper addresses the task of automatically detecting outcomes of social interaction patterns, using non-verbal audio cues in competitive role-playing games (RPGs). For our experiments, we introduce a new data set which features 3 hours of audio-visual recordings of the popular “Are you a Werewolf? ” RPG. Two problems are approached in this paper: Detecting lying or suspicious behavior using non-verbal audio cues in a social context and predicting participants’ decisions in a game-day by analyzing speaker turns. Our best classifier exhibits a performance improvement of 87 % over the baseline for detecting deceptive roles. Also, we show that speaker turn based features can be used to determine the outcomes in the initial stages of the game, when the group is large. Index Terms — Deception, Role Analysis, Nonverbal Behavior 1.
Recent Developments in Social Signal Processing
"... Abstract—Social signal processing has the ambitious goal of bridging the social intelligence gap between computers and humans. Nowadays, computers are not only the new interaction partners of humans, but also a privileged interaction medium for social exchange between humans. Consequently, enhancing ..."
Abstract
-
Cited by 4 (3 self)
- Add to MetaCart
(Show Context)
Abstract—Social signal processing has the ambitious goal of bridging the social intelligence gap between computers and humans. Nowadays, computers are not only the new interaction partners of humans, but also a privileged interaction medium for social exchange between humans. Consequently, enhancing machine abilities to interpret and reproduce social signals is a crucial requirement for improving computer-mediated communication and interaction. Furthermore, automated analysis of such signals creates a host of new applications and improvements to existing applications. The study of social signals benefits a wide range of domains, including human-computer interaction, interaction design, entertainment technology, ambient intelligence, healthcare, and psychology. This paper briefly introduces the field and surveys its latest developments. Index Terms—Behavioral science, human computer interaction, emotion recognition I.
2010. Concensus of selffeatures for nonverbal behavior analysis
- In Human Behavior Understanding in conjucion with International Conference in Pattern Recognition
"... Abstract. One of the key challenge in social behavior analysis is to au-tomatically discover the subset of features relevant to a specific social signal (e.g., backchannel feedback). The way that these social signals are performed exhibit some variations among different people. In this paper, we pre ..."
Abstract
-
Cited by 3 (1 self)
- Add to MetaCart
(Show Context)
Abstract. One of the key challenge in social behavior analysis is to au-tomatically discover the subset of features relevant to a specific social signal (e.g., backchannel feedback). The way that these social signals are performed exhibit some variations among different people. In this paper, we present a feature selection approach which first looks at im-portant behaviors for each individual, called self-features, before building a consensus. To enable this approach, we propose a new feature ranking scheme which exploits the sparsity of probabilistic models when trained on human behavior problems. We validated our self-feature concensus approach on the task of listener backchannel prediction and showed im-provement over the traditional group-feature approach. Our technique gives researchers a new tool to analyze individual differences in social nonverbal communication.
Follow me: a web-based, locationsharing architecture for large, indoor environments
- In Proc. of WWW
, 2010
"... We leverage the ubiquity of bluetooth-enabled devices and propose a decentralized, web-based architecture that allows users to share their location by following each other in the style of Twitter1. We demonstrate a prototype that oper-ates in a large building which generates a dataset of de-tected b ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
(Show Context)
We leverage the ubiquity of bluetooth-enabled devices and propose a decentralized, web-based architecture that allows users to share their location by following each other in the style of Twitter1. We demonstrate a prototype that oper-ates in a large building which generates a dataset of de-tected bluetooth devices at a rate of ∼30 new devices per day, including the respective location where they were last detected. Users then query the dataset using their unique bluetooth ID and share their current location with their fol-lowers by means of unique URIs that they control. Our separation between producers (the building) and consumers (the users) of bluetooth device location data allows us to create socially-aware applications that respect userÕs pri-vacy while limiting the software necessary to run on mobile devices to just a web browser.
ANALYSIS OF AFFECTIVE CUES IN HUMAN-ROBOT INTERACTION: A MULTI-LEVEL APPROACH
"... This paper reviews some of the key challenges in affect recognition research for the purpose of designing affect sen-sitive social robots. An important requirement for a social robot is to be endowed with recognition abilities that vary ac-cording to the context of interaction. This paper presents a ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
(Show Context)
This paper reviews some of the key challenges in affect recognition research for the purpose of designing affect sen-sitive social robots. An important requirement for a social robot is to be endowed with recognition abilities that vary ac-cording to the context of interaction. This paper presents an approach for the analysis of different affective cues depending on the distance at which user and robot interact. 1.