DMCA
B-spline Polynomial Descriptors for Human Activity Recognition
| Citations: | 5 - 3 self |
BibTeX
@MISC{Oikonomopoulos_b-splinepolynomial,
author = {A. Oikonomopoulos and M. Pantic and I. Patras},
title = {B-spline Polynomial Descriptors for Human Activity Recognition},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
The extraction and quantization of local image and video descriptors for the subsequent creation of visual codebooks is a technique that has proved extremely effective for image and video retrieval applications. In this paper we build on this concept and extract a new set of visual descriptors that are derived from spatiotemporal salient points detected on given image sequences and provide local space-time description of the visual activity. The proposed descriptors are based on the geometrical properties of three-dimensional piecewise polynomials, namely B-splines, that are fitted on the spatiotemporal locations of the salient points that are engulfed within a given spatiotemporal neighborhood. Our descriptors are inherently translation invariant, while the use of the scales of the salient points for the definition of the neighborhood dimensions ensures space-time scaling invariance. Subsequently, a clustering algorithm is used in order to cluster our descriptors across the whole dataset and create a codebook of visual verbs, where each verb corresponds to a cluster center. We use the resulting codebook in a ’bag of verbs ’ approach in order to recover the pose and short-term motion of subjects at a short set of successive frames, and we use Dynamic Time Warping (DTW) in order to align the sequences in our dataset and structure in time the recovered poses. We define a kernel based on the similarity measure provided by the DTW to classify our examples in a Relevane Vector Machine classification scheme. We present results in a well established human activity database to verify the effectiveness of our method. 1.
Keyphrases
b-spline polynomial descriptor human activity recognition salient point geometrical property cluster center three-dimensional piecewise polynomial short-term motion relevane vector machine classification scheme translation invariant recovered pose verb approach video descriptor local space-time description present result local image spatiotemporal location spatiotemporal neighborhood space-time scaling invariance short set subsequent creation human activity database video retrieval application visual codebooks visual verb clustering algorithm spatiotemporal salient point dynamic time warping successive frame similarity measure neighborhood dimension visual activity whole dataset image sequence visual descriptor new set
