Results 1  10
of
349
Behavior recognition via sparse spatiotemporal features
 In VSPETS
, 2005
"... A common trend in object recognition is to detect and leverage the use of sparse, informative feature points. The use of such features makes the problem more manageable while providing increased robustness to noise and pose variation. In this work we develop an extension of these ideas to the spatio ..."
Abstract

Cited by 422 (4 self)
 Add to MetaCart
(Show Context)
A common trend in object recognition is to detect and leverage the use of sparse, informative feature points. The use of such features makes the problem more manageable while providing increased robustness to noise and pose variation. In this work we develop an extension of these ideas to the spatiotemporal case. For this purpose, we show that the direct 3D counterparts to commonly used 2D interest point detectors are inadequate, and we propose an alternative. Anchoring off of these interest points, we devise a recognition algorithm based on spatiotemporally windowed data. We present recognition results on a variety of datasets including both human and rodent behavior. 1.
Blobworld: Image segmentation using ExpectationMaximization and its application to image querying
 IEEE Transactions on Pattern Analysis and Machine Intelligence
, 1999
"... Retrieving images from large and varied collections using image content as a key is a challenging and important problem. We present a new image representation which provides a transformation from the raw pixel data to a small set of image regions which are coherent in color and texture. This "B ..."
Abstract

Cited by 360 (10 self)
 Add to MetaCart
(Show Context)
Retrieving images from large and varied collections using image content as a key is a challenging and important problem. We present a new image representation which provides a transformation from the raw pixel data to a small set of image regions which are coherent in color and texture. This "Blobworld" representation is created by clustering pixels in a joint colortextureposition feature space. The segmentation algorithm is fully automatic and has been run on a collection of 10,000 natural images. We describe a system that uses the Blobworld representation to retrieve images from this collection. An important aspect of the system is that the user is allowed to view the internal representation of the submitted image and the query results. Similar systems do not offer the user this view into the workings of the system; consequently, query results from these systems can be inexplicable, despite the availability of knobs for adjusting the similarity metrics. By finding image regions whi...
Orientation Diffusions
 IEEE Trans. Image Processing
, 1998
"... Abstract—Diffusions are useful for image processing and computer vision because they provide a convenient way of smoothing noisy data, analyzing images at multiple scales, and enhancing discontinuities. A number of diffusions of image brightness have been defined and studied so far; they may be appl ..."
Abstract

Cited by 134 (0 self)
 Add to MetaCart
(Show Context)
Abstract—Diffusions are useful for image processing and computer vision because they provide a convenient way of smoothing noisy data, analyzing images at multiple scales, and enhancing discontinuities. A number of diffusions of image brightness have been defined and studied so far; they may be applied to scalar and vectorvalued quantities that are naturally associated with intervals of either the real line, or other flat manifolds. Some quantities of interest in computer vision, and other areas of engineering that deal with images, are defined on curved manifolds; typical examples are orientation and hue that are defined on the circle. Generalizing brightness diffusions to orientation is not straightforward, especially in the case where a discrete implementation is sought. An example of what may go wrong is presented. A method is proposed to define diffusions of orientationlike quantities. First a definition in the continuum is discussed, then a discrete orientation diffusion is proposed. The behavior of such diffusions is explored both analytically and experimentally. It is shown how such orientation diffusions contain a nonlinearity that is reminiscent of edgeprocess and anisotropic diffusion. A number of open questions are proposed at the end. Index Terms—Orientation analysis, texture analysis, diffusions, scalespace.
The conformal monogenic signal
, 2001
"... The conformal monogenic signal is a novel rotational invariant approach for analyzing i(ntrinsic)1D and i2D local features of twodimensional signals (e.g. images) without the use of any heuristics. It contains the monogenic signal as a special case for i1D signals and combines scalespace, phase, or ..."
Abstract

Cited by 114 (37 self)
 Add to MetaCart
The conformal monogenic signal is a novel rotational invariant approach for analyzing i(ntrinsic)1D and i2D local features of twodimensional signals (e.g. images) without the use of any heuristics. It contains the monogenic signal as a special case for i1D signals and combines scalespace, phase, orientation, energy and isophote curvature in one unified algebraic framework. The conformal monogenic signal will be theoretically illustrated and motivated in detail by the relation of the Radon and the Riesz transform. One of the main ideas is to lift up twodimensional signals to a higher dimensional conformal space where the signal can be analyzed with more degrees of freedom. The most interesting result is that isophote curvature can be calculated in a purely algebraic framework without the need of any derivatives.
A review of statistical approaches to level set segmentation: Integrating color, texture, motion and shape
 International Journal of Computer Vision
, 2007
"... Abstract. Since their introduction as a means of front propagation and their first application to edgebased segmentation in the early 90’s, level set methods have become increasingly popular as a general framework for image segmentation. In this paper, we present a survey of a specific class of reg ..."
Abstract

Cited by 93 (4 self)
 Add to MetaCart
(Show Context)
Abstract. Since their introduction as a means of front propagation and their first application to edgebased segmentation in the early 90’s, level set methods have become increasingly popular as a general framework for image segmentation. In this paper, we present a survey of a specific class of regionbased level set segmentation methods and clarify how they can all be derived from a common statistical framework. Regionbased segmentation schemes aim at partitioning the image domain by progressively fitting statistical models to the intensity, color, texture or motion in each of a set of regions. In contrast to edgebased schemes such as the classical Snakes, regionbased methods tend to be less sensitive to noise. For typical images, the respective cost functionals tend to have less local minima which makes them particularly wellsuited for local optimization methods such as the level set method. We detail a general statistical formulation for level set segmentation. Subsequently, we clarify how the integration of various low level criteria leads to a set of cost functionals and point out relations between the different segmentation schemes. In experimental results, we demonstrate how the level set function is driven to partition the image plane into domains of coherent color, texture, dynamic texture or motion. Moreover, the Bayesian formulation allows to introduce prior shape knowledge into the level set method. We briefly review a number of advances in this domain.
CoherenceEnhancing Diffusion Filtering
, 1999
"... The completion of interrupted lines or the enhancement of flowlike structures is a challenging task in computer vision, human vision, and image processing. We address this problem by presenting a multiscale method in which a nonlinear diffusion filter is steered by the socalled interest operato ..."
Abstract

Cited by 91 (2 self)
 Add to MetaCart
The completion of interrupted lines or the enhancement of flowlike structures is a challenging task in computer vision, human vision, and image processing. We address this problem by presenting a multiscale method in which a nonlinear diffusion filter is steered by the socalled interest operator (secondmoment matrix, structure tensor). An mdimensional formulation of this method is analysed with respect to its wellposedness and scalespace properties. An efficient scheme is presented which uses a stabilization by a semiimplicit additive operator splitting (AOS), and the scalespace behaviour of this method is illustrated by applying it to both 2D and 3D images.
Variational Restoration Of Nonflat Image Features: Models And Algorithms
, 2000
"... We develop both mathematical models and computational algorithms for variational denoising and restoration of nonflat image features. Nonflat image features are those that live on Riemannian manifolds, instead of on the Euclidean spaces. Familiar examples include the orientation feature (from optica ..."
Abstract

Cited by 87 (15 self)
 Add to MetaCart
(Show Context)
We develop both mathematical models and computational algorithms for variational denoising and restoration of nonflat image features. Nonflat image features are those that live on Riemannian manifolds, instead of on the Euclidean spaces. Familiar examples include the orientation feature (from optical flows or gradient flows) that lives on the unit circle S&sup1;, the alignment feature (from fingerprint waves or certain texture images) that lives on the real projective line RP&sup1; and the chromaticity feature (from color images) that lives on the unit sphere S&sup2;. In this paper, we apply the variational method to denoise and restore general nonflat image features. Mathematical models for both continuous image domains and discrete domains (or graphs) are constructed. Riemannian objects such as metric, distance and LeviCivita connection play important roles in the models. Computational algorithms are also developed for the resulting nonlinear equations. The mathematical framework can be applied to restoring general nonflat data outside the scope of image processing and computer vision.
A Tensor Framework for Multidimensional Signal Processing
 Linkoping University, Sweden
, 1994
"... ii About the cover The figure on the cover shows a visualization of a symmetric tensor in three dimensions, G = λ1ê1ê T 1 + λ2ê2ê T 2 + λ3ê3ê T 3 The object in the figure is the sum of a spear, a plate and a sphere. The spear describes the principal direction of the tensor λ1ê1ê T 1, where the lengt ..."
Abstract

Cited by 59 (8 self)
 Add to MetaCart
(Show Context)
ii About the cover The figure on the cover shows a visualization of a symmetric tensor in three dimensions, G = λ1ê1ê T 1 + λ2ê2ê T 2 + λ3ê3ê T 3 The object in the figure is the sum of a spear, a plate and a sphere. The spear describes the principal direction of the tensor λ1ê1ê T 1, where the length is proportional to the largest eigenvalue, λ1. The plate describes the plane spanned by the eigenvectors corresponding to the two largest eigenvalues, λ2(ê1ê T 1 + ê2ê T 2). The sphere, with a radius proportional to the smallest eigenvalue, shows how isotropic the tensor is, λ3(ê1ê T 1 + ê2ê T 2 + ê3ê T 3). The visualization is done using AVS [WWW94]. I am very grateful to Johan Wiklund for implementing the tensor viewer module used. This thesis deals with filtering of multidimensional signals. A large part of the thesis is devoted to a novel filtering method termed “Normalized convolution”. The method performs local expansion of a signal in a chosen filter basis which
Diffusion of General Data on NonFlat Manifolds via Harmonic Maps Theory: The Direction Diffusion Case
 Journal Computer Vision
, 2000
"... Abstract. In a number of disciplines, directional data provides a fundamental source of information. A novel framework for isotropic and anisotropic diffusion of directions is presented in this paper. The framework can be applied both to denoise directional data and to obtain multiscale representati ..."
Abstract

Cited by 56 (6 self)
 Add to MetaCart
Abstract. In a number of disciplines, directional data provides a fundamental source of information. A novel framework for isotropic and anisotropic diffusion of directions is presented in this paper. The framework can be applied both to denoise directional data and to obtain multiscale representations of it. The basic idea is to apply and extend results from the theory of harmonic maps, and in particular, harmonic maps in liquid crystals. This theory deals with the regularization of vectorial data, while satisfying the intrinsic unit norm constraint of directional data. We show the corresponding variational and partial differential equations formulations for isotropic diffusion, obtained from an L2 norm, and edge preserving diffusion, obtained from an L p norm in general and an L1 norm in particular. In contrast with previous approaches, the framework is valid for directions in any dimensions, supports nonsmooth data, and gives both isotropic and anisotropic formulations. In addition, the framework of harmonic maps here described can be used to diffuse and analyze general image data defined on general nonflat manifolds, that is, functions between two general manifolds. We present a number of theoretical results, open questions, and examples for gradient vectors, optical flow, and color images.
Image processing for diffusion tensor magnetic resonance imaging
 In Proceedings of ISMRM’97
, 1997
"... ..."
(Show Context)