Expectation Grammars: Leveraging High-Level Expectations for Activity (2003)
| Venue: | in Workshop on Event Mining, Event Detection, and Recognition in Video, held in Conjunction with Computer Vision and Pattern Recognition |
| Citations: | 26 - 5 self |
BibTeX
@INPROCEEDINGS{Minnen03expectationgrammars:,
author = {Recognition David Minnen and David Minnen and Irfan Essa and Thad Starner},
title = {Expectation Grammars: Leveraging High-Level Expectations for Activity},
booktitle = {in Workshop on Event Mining, Event Detection, and Recognition in Video, held in Conjunction with Computer Vision and Pattern Recognition},
year = {2003},
pages = {626}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
Video-based recognition and prediction of a temporally extended activity can benefit from a detailed description of high-level expectations about the activity. Stochastic grammars allow for an efficient representation of such expectations and are well-suited for the specification of temporally well-ordered activities. In this paper, we extend stochastic grammars by adding event parameters, state checks, and sensitivity to an internal scene model. We present an implemented system that uses human-specified grammars to recognize a person performing the Towers of Hanoi task from a video sequence by analyzing object interaction events. Experimental results from several videos show robust recognition of the full task and its constituent sub-tasks even though no appearance models of the objects in the video are provided. These experiments include videos of the task performed with different shaped objects and with distracting and extraneous interactions.
