Results 1 - 10
of
13
Automatically segmenting lifelog data into events
- In WIAMIS 2008 - 9th International Workshop on Image Analysis for Multimedia Interactive Services
, 2008
"... A personal lifelog of visual information can be very helpful as a human memory aid. The SenseCam, a passively capturing wearable camera, captures an average of 1,785 images per day, which equates to over 600,000 images per year. So as not to overwhelm users it is necessary to deconstruct this substa ..."
Abstract
-
Cited by 34 (16 self)
- Add to MetaCart
(Show Context)
A personal lifelog of visual information can be very helpful as a human memory aid. The SenseCam, a passively capturing wearable camera, captures an average of 1,785 images per day, which equates to over 600,000 images per year. So as not to overwhelm users it is necessary to deconstruct this substantial collection of images into digestable chunks of information, i.e. into distinct events or activities. This paper improves on previous work on automatic segmentation of SenseCam images into events by up to 29.2%, primarily through the introduction of intelligent threshold selection techniques, but also through improvements in the selection of normalisation, fusion, and vector distance techniques. Here we use the most extensive dataset ever used in this domain, 271,163 images collected by 5 users over a time period of one month with manually groundtruthed events. 1.
Now let me see where i was: understanding how lifelogs mediate memory. Proceedings of the 28th international conference on Human factors in computing systems ACM
- Proceedings of the 22nd British HCI Group Annual Conference on People and Computers Culture, Creativity, Interaction - Volume 1 (BCS-HCI '08), 1. British Computer Society
, 2010
"... All in-text references underlined in blue are linked to publications on ResearchGate, letting you access and read them immediately. ..."
Abstract
-
Cited by 19 (1 self)
- Add to MetaCart
(Show Context)
All in-text references underlined in blue are linked to publications on ResearchGate, letting you access and read them immediately.
Making history: intentional capture of future memories
- In Proc. of CHI '09
, 2009
"... ‘Lifelogging ’ technology makes it possible to amass digital data about every aspect of our everyday lives. Instead of focusing on such technical possibilities, here we investigate the way people compose long-term mnemonic representations of their lives. We asked 10 families to create a time capsule ..."
Abstract
-
Cited by 17 (5 self)
- Add to MetaCart
(Show Context)
‘Lifelogging ’ technology makes it possible to amass digital data about every aspect of our everyday lives. Instead of focusing on such technical possibilities, here we investigate the way people compose long-term mnemonic representations of their lives. We asked 10 families to create a time capsule, a collection of objects used to trigger remembering in the distant future. Our results show that contrary to the lifelogging view, people are less interested in exhaustively digitally recording their past than in reconstructing it from carefully selected cues that are often physical objects. Time capsules were highly expressive and personal, many objects were made explicitly for inclusion, however with little object annotation. We use these findings to propose principles for designing technology that supports the active reconstruction of our future past. Author Keywords Autobiographical memory, cultural probes, fieldwork,
Combining image descriptors to effectively retrieve events from visual lifelogs
- In MIR ’08: Proceeding of the 1st ACM international conference on Multimedia information retrieval
, 2008
"... The SenseCam is a wearable camera that passively captures approximately 3,000 images per day, which equates to almost one million images per year. It is used to create a personal visual recording of the wearer’s life and generates information which can be helpful as a human memory aid. For such a la ..."
Abstract
-
Cited by 14 (2 self)
- Add to MetaCart
(Show Context)
The SenseCam is a wearable camera that passively captures approximately 3,000 images per day, which equates to almost one million images per year. It is used to create a personal visual recording of the wearer’s life and generates information which can be helpful as a human memory aid. For such a large amount of visual information to be of any use, it is accepted that it should be structured into“events”, of which there are about 8,000 in a wearer’s average year. In automatically segmenting SenseCam images into events, it will then be useful for users to locate other events similar to a given event e.g. “what other times was I walking in the park?”, “show me other events when I was in a restaurant”. On two datasets of 240k and 1.8M images containing topics with a variety of information needs, we evaluate the fusion of MPEG-7, SIFT, and SURF content-based retrieval techniques to address the event search issue. We have found that our proposed fusion approach of MPEG-7 and SURF offers an improvement on using either of those sources or SIFT individually, and we have also shown how a lifelog event is modeled has a large effect on the retrieval performance.
M.: Investigating keyframe selection methods in the novel domain of passively captured visual lifelogs
- In: CIVR ’08: Proceedings of the 2008 international conference on Content-based image and video retrieval, Niagara Falls
, 2008
"... The SenseCam is a passive capture wearable camera, worn around the neck, and when worn continuously it takes an average of 1,900 images per day. It can be used to create a personal lifelog or visual recording of the wearer’s life which can be helpful as an aid to human memory. For such a large amoun ..."
Abstract
-
Cited by 13 (6 self)
- Add to MetaCart
(Show Context)
The SenseCam is a passive capture wearable camera, worn around the neck, and when worn continuously it takes an average of 1,900 images per day. It can be used to create a personal lifelog or visual recording of the wearer’s life which can be helpful as an aid to human memory. For such a large amount of visual information to be useful, it needs to be structured into “events”, which can be achieved through automatic segmentation. An important component of this structuring process is the selection of keyframes to represent individual events. This work investigates a variety of techniques for the selection of a single representative keyframe image from each event, in order to provide the user with an instant visual summary of that event. In our experiments we use a large test set of 2,232 lifelog events collected by 5 users over a time period of one month each (equating to 194,857 images). We propose a novel keyframe selection technique which seeks to select the image with the highest “quality” as the keyframe. The inclusion of “quality ” approaches in keyframe selection is demonstrated to be useful owing to the high variability in image visual quality within passively captured image collections. 1.
Combining Face Detection and Novelty to Identify Important Events in a Visual
"... The SenseCam is a passively capturing wearable camera, worn around the neck and takes an average of almost 2,000 images per day, which equates to over 650,000 images per year. It is used to create a personal lifelog or visual recording of the wearer’s life and generates information which can be help ..."
Abstract
-
Cited by 7 (4 self)
- Add to MetaCart
(Show Context)
The SenseCam is a passively capturing wearable camera, worn around the neck and takes an average of almost 2,000 images per day, which equates to over 650,000 images per year. It is used to create a personal lifelog or visual recording of the wearer’s life and generates information which can be helpful as a human memory aid. For such a large amount of visual information to be of any use, it is accepted that it should be structured into “events”, of which there are about 8,000 in a wearer’s average year. In automatically segmenting SenseCam images into events, it is desirable to automatically emphasise more important events and decrease the emphasis on mundane/routine events. This paper introduces the concept of novelty to help determine the importance of events in a lifelog. By combining novelty with face-to-face conversation detection, our system improves on previous approaches. In our experiments we use a large set of lifelog images, a total of 288,479 images collected by 6 users over a time period of one month each.
Sonic Souvenirs: Exploring the Paradoxes of Recorded Sound for Family Remembering
- In Proc. of CSCW 2010
"... ABSTRACT Many studies have explored social processes and technologies associated with sharing photos. In contrast, we explore the role of sound as a medium for social reminiscing. We involved 10 families in recording 'sonic souvenirs' of their holidays. They shared and discussed their col ..."
Abstract
-
Cited by 5 (4 self)
- Add to MetaCart
(Show Context)
ABSTRACT Many studies have explored social processes and technologies associated with sharing photos. In contrast, we explore the role of sound as a medium for social reminiscing. We involved 10 families in recording 'sonic souvenirs' of their holidays. They shared and discussed their collections on their return. We compared these sounds with their photo taking activities and reminiscences. Both sounds and pictures triggered active collaborative reminiscing, and attempts to capture iconic representations of events. However sounds differed from photos in that they were more varied, familial and creative. Further, they often expressed the negative or mundane in order to be 'true to life', and were harder to interpret than photos. Finally we saw little use of pure explanatory narrative. We reflect on the relations between sound and family memory and propose new designs on the basis of our findings, to better support the sharing and manipulation of social sounds.
Weaving Memories into Handcrafted Artifacts with Spyn
- CHI2008
, 2008
"... Handcrafted objects, such as knit scarves or sweaters, subtly signify the time and skill involved in their creation. Yet a handcraft artifact itself cannot convey the experience of its creation. We present the design, implementation, and preliminary evaluation of Spyn, a system for knitters to virtu ..."
Abstract
-
Cited by 3 (1 self)
- Add to MetaCart
Handcrafted objects, such as knit scarves or sweaters, subtly signify the time and skill involved in their creation. Yet a handcraft artifact itself cannot convey the experience of its creation. We present the design, implementation, and preliminary evaluation of Spyn, a system for knitters to virtually weave stories into their creations. Using Spyn, a knitter can record, playback and share information involved in the creation of handknit products. Spyn uses patterns of infrared ink printed on yarn in combination with computer vision techniques to correlate locations in knit fabric with events recorded during the knitting process. Using Spyn, knitters can capture their activities as audio, image, video, and spatio-temporal data. When users photograph the knit material, the Spyn system analyzes the ink patterns on the material and visualizes events over the photograph of the knit. In the design of Spyn, we investigate the role that technology can play in preserving and sharing the handcraft process over space and time.
Now Let Me See Where I Was: Understanding How Lifelogs Mediate Memory
"... Lifelogging technologies can capture both mundane and important experiences in our daily lives, resulting in a rich record of the places we visit and the things we see. This study moves beyond technology demonstrations, in aiming to better understand how and why different types of Lifelogs aid memor ..."
Abstract
-
Cited by 2 (1 self)
- Add to MetaCart
(Show Context)
Lifelogging technologies can capture both mundane and important experiences in our daily lives, resulting in a rich record of the places we visit and the things we see. This study moves beyond technology demonstrations, in aiming to better understand how and why different types of Lifelogs aid memory. Previous work has demonstrated that Lifelogs can aid recall, but that they do many other things too. They can help us look back at the past in new ways, or to reconstruct what we did in our lives, even if we don’t recall exact details. Here we extend the notion of Lifelogging to include locational information. We augment streams of Lifelog images with geographic data to examine how different types of data (visual or locational) might affect memory. Our results show that visual cues promote detailed memories (akin to recollection). In contrast locational information supports inferential processes – allowing participants to reconstruct habits in their behaviour. Author Keywords Lifelogging, memory, remembering, SenseCam, GPS, geo-
Social fMRI: Measuring and Designing Social Mechanisms Using Mobile Phones
, 2012
"... A key challenge of data-driven social science is the gathering of high quality multi-dimensional datasets. A second challenge relates to the design and execution of social experiments in the real world that are as reliable as those within a controlled laboratory, yet yield more practical results. We ..."
Abstract
-
Cited by 1 (0 self)
- Add to MetaCart
A key challenge of data-driven social science is the gathering of high quality multi-dimensional datasets. A second challenge relates to the design and execution of social experiments in the real world that are as reliable as those within a controlled laboratory, yet yield more practical results. We introduce the Social Functional Mechanism-design and Relationship Imaging, or “Social fMRI”- an approach that enhances existing computational social science methodologies by bridging rich data collection strategies with experimental interventions. In this thesis, we demonstrate the value of the Social fMRI approach in our Friends and Fam-ily study. We transformed a young-family residential community into a living laboratory for 15 months, through a very fine-grained and longitudinal data collection process combined with targeted experimental interventions. Through the derived dataset of unprecedented quality, the Social fMRI approach allows us to gain insights into intricate social mechanisms and interpersonal relationships within the community in ways not previously possible. This thesis delivers the following contributions: (1) A methodology combining a rich-data experimental approach together with carefully designed interventions, (2) a system supporting the method-
