Results 1  10
of
247
Behavior recognition via sparse spatiotemporal features
 In VSPETS
, 2005
"... A common trend in object recognition is to detect and leverage the use of sparse, informative feature points. The use of such features makes the problem more manageable while providing increased robustness to noise and pose variation. In this work we develop an extension of these ideas to the spatio ..."
Abstract

Cited by 367 (4 self)
 Add to MetaCart
A common trend in object recognition is to detect and leverage the use of sparse, informative feature points. The use of such features makes the problem more manageable while providing increased robustness to noise and pose variation. In this work we develop an extension of these ideas to the spatiotemporal case. For this purpose, we show that the direct 3D counterparts to commonly used 2D interest point detectors are inadequate, and we propose an alternative. Anchoring off of these interest points, we devise a recognition algorithm based on spatiotemporally windowed data. We present recognition results on a variety of datasets including both human and rodent behavior. 1.
Blobworld: Image segmentation using ExpectationMaximization and its application to image querying
 IEEE Transactions on Pattern Analysis and Machine Intelligence
, 1999
"... Retrieving images from large and varied collections using image content as a key is a challenging and important problem. We present a new image representation which provides a transformation from the raw pixel data to a small set of image regions which are coherent in color and texture. This "Blobwo ..."
Abstract

Cited by 334 (9 self)
 Add to MetaCart
Retrieving images from large and varied collections using image content as a key is a challenging and important problem. We present a new image representation which provides a transformation from the raw pixel data to a small set of image regions which are coherent in color and texture. This "Blobworld" representation is created by clustering pixels in a joint colortextureposition feature space. The segmentation algorithm is fully automatic and has been run on a collection of 10,000 natural images. We describe a system that uses the Blobworld representation to retrieve images from this collection. An important aspect of the system is that the user is allowed to view the internal representation of the submitted image and the query results. Similar systems do not offer the user this view into the workings of the system; consequently, query results from these systems can be inexplicable, despite the availability of knobs for adjusting the similarity metrics. By finding image regions whi...
Orientation Diffusions
 IEEE Trans. Image Processing
, 1998
"... Abstract—Diffusions are useful for image processing and computer vision because they provide a convenient way of smoothing noisy data, analyzing images at multiple scales, and enhancing discontinuities. A number of diffusions of image brightness have been defined and studied so far; they may be appl ..."
Abstract

Cited by 131 (0 self)
 Add to MetaCart
Abstract—Diffusions are useful for image processing and computer vision because they provide a convenient way of smoothing noisy data, analyzing images at multiple scales, and enhancing discontinuities. A number of diffusions of image brightness have been defined and studied so far; they may be applied to scalar and vectorvalued quantities that are naturally associated with intervals of either the real line, or other flat manifolds. Some quantities of interest in computer vision, and other areas of engineering that deal with images, are defined on curved manifolds; typical examples are orientation and hue that are defined on the circle. Generalizing brightness diffusions to orientation is not straightforward, especially in the case where a discrete implementation is sought. An example of what may go wrong is presented. A method is proposed to define diffusions of orientationlike quantities. First a definition in the continuum is discussed, then a discrete orientation diffusion is proposed. The behavior of such diffusions is explored both analytically and experimentally. It is shown how such orientation diffusions contain a nonlinearity that is reminiscent of edgeprocess and anisotropic diffusion. A number of open questions are proposed at the end. Index Terms—Orientation analysis, texture analysis, diffusions, scalespace.
A review of statistical approaches to level set segmentation: Integrating color, texture, motion and shape
 International Journal of Computer Vision
, 2007
"... Abstract. Since their introduction as a means of front propagation and their first application to edgebased segmentation in the early 90’s, level set methods have become increasingly popular as a general framework for image segmentation. In this paper, we present a survey of a specific class of reg ..."
Abstract

Cited by 85 (4 self)
 Add to MetaCart
Abstract. Since their introduction as a means of front propagation and their first application to edgebased segmentation in the early 90’s, level set methods have become increasingly popular as a general framework for image segmentation. In this paper, we present a survey of a specific class of regionbased level set segmentation methods and clarify how they can all be derived from a common statistical framework. Regionbased segmentation schemes aim at partitioning the image domain by progressively fitting statistical models to the intensity, color, texture or motion in each of a set of regions. In contrast to edgebased schemes such as the classical Snakes, regionbased methods tend to be less sensitive to noise. For typical images, the respective cost functionals tend to have less local minima which makes them particularly wellsuited for local optimization methods such as the level set method. We detail a general statistical formulation for level set segmentation. Subsequently, we clarify how the integration of various low level criteria leads to a set of cost functionals and point out relations between the different segmentation schemes. In experimental results, we demonstrate how the level set function is driven to partition the image plane into domains of coherent color, texture, dynamic texture or motion. Moreover, the Bayesian formulation allows to introduce prior shape knowledge into the level set method. We briefly review a number of advances in this domain.
CoherenceEnhancing Diffusion Filtering
, 1999
"... The completion of interrupted lines or the enhancement of flowlike structures is a challenging task in computer vision, human vision, and image processing. We address this problem by presenting a multiscale method in which a nonlinear diffusion filter is steered by the socalled interest operato ..."
Abstract

Cited by 83 (2 self)
 Add to MetaCart
The completion of interrupted lines or the enhancement of flowlike structures is a challenging task in computer vision, human vision, and image processing. We address this problem by presenting a multiscale method in which a nonlinear diffusion filter is steered by the socalled interest operator (secondmoment matrix, structure tensor). An mdimensional formulation of this method is analysed with respect to its wellposedness and scalespace properties. An efficient scheme is presented which uses a stabilization by a semiimplicit additive operator splitting (AOS), and the scalespace behaviour of this method is illustrated by applying it to both 2D and 3D images.
Variational Restoration Of Nonflat Image Features: Models And Algorithms
, 2000
"... We develop both mathematical models and computational algorithms for variational denoising and restoration of nonflat image features. Nonflat image features are those that live on Riemannian manifolds, instead of on the Euclidean spaces. Familiar examples include the orientation feature (from optica ..."
Abstract

Cited by 77 (14 self)
 Add to MetaCart
We develop both mathematical models and computational algorithms for variational denoising and restoration of nonflat image features. Nonflat image features are those that live on Riemannian manifolds, instead of on the Euclidean spaces. Familiar examples include the orientation feature (from optical flows or gradient flows) that lives on the unit circle S¹, the alignment feature (from fingerprint waves or certain texture images) that lives on the real projective line RP¹ and the chromaticity feature (from color images) that lives on the unit sphere S². In this paper, we apply the variational method to denoise and restore general nonflat image features. Mathematical models for both continuous image domains and discrete domains (or graphs) are constructed. Riemannian objects such as metric, distance and LeviCivita connection play important roles in the models. Computational algorithms are also developed for the resulting nonlinear equations. The mathematical framework can be applied to restoring general nonflat data outside the scope of image processing and computer vision.
A Tensor Framework for Multidimensional Signal Processing
 Linkoping University, Sweden
, 1994
"... ii About the cover The figure on the cover shows a visualization of a symmetric tensor in three dimensions, G = λ1ê1ê T 1 + λ2ê2ê T 2 + λ3ê3ê T 3 The object in the figure is the sum of a spear, a plate and a sphere. The spear describes the principal direction of the tensor λ1ê1ê T 1, where the lengt ..."
Abstract

Cited by 53 (8 self)
 Add to MetaCart
ii About the cover The figure on the cover shows a visualization of a symmetric tensor in three dimensions, G = λ1ê1ê T 1 + λ2ê2ê T 2 + λ3ê3ê T 3 The object in the figure is the sum of a spear, a plate and a sphere. The spear describes the principal direction of the tensor λ1ê1ê T 1, where the length is proportional to the largest eigenvalue, λ1. The plate describes the plane spanned by the eigenvectors corresponding to the two largest eigenvalues, λ2(ê1ê T 1 + ê2ê T 2). The sphere, with a radius proportional to the smallest eigenvalue, shows how isotropic the tensor is, λ3(ê1ê T 1 + ê2ê T 2 + ê3ê T 3). The visualization is done using AVS [WWW94]. I am very grateful to Johan Wiklund for implementing the tensor viewer module used. This thesis deals with filtering of multidimensional signals. A large part of the thesis is devoted to a novel filtering method termed “Normalized convolution”. The method performs local expansion of a signal in a chosen filter basis which
Diffusion of General Data on NonFlat Manifolds via Harmonic Maps Theory: The Direction Diffusion Case
 Journal Computer Vision
, 2000
"... Abstract. In a number of disciplines, directional data provides a fundamental source of information. A novel framework for isotropic and anisotropic diffusion of directions is presented in this paper. The framework can be applied both to denoise directional data and to obtain multiscale representati ..."
Abstract

Cited by 52 (6 self)
 Add to MetaCart
Abstract. In a number of disciplines, directional data provides a fundamental source of information. A novel framework for isotropic and anisotropic diffusion of directions is presented in this paper. The framework can be applied both to denoise directional data and to obtain multiscale representations of it. The basic idea is to apply and extend results from the theory of harmonic maps, and in particular, harmonic maps in liquid crystals. This theory deals with the regularization of vectorial data, while satisfying the intrinsic unit norm constraint of directional data. We show the corresponding variational and partial differential equations formulations for isotropic diffusion, obtained from an L2 norm, and edge preserving diffusion, obtained from an L p norm in general and an L1 norm in particular. In contrast with previous approaches, the framework is valid for directions in any dimensions, supports nonsmooth data, and gives both isotropic and anisotropic formulations. In addition, the framework of harmonic maps here described can be used to diffuse and analyze general image data defined on general nonflat manifolds, that is, functions between two general manifolds. We present a number of theoretical results, open questions, and examples for gradient vectors, optical flow, and color images.
Image Processing for Diffusion Tensor Magnetic Resonance Imaging
 In Proceedings of ISMRM’97
, 1999
"... This paper describes image processing techniques for Diffusion Tensor Magnetic Resonance. In Diffusion Tensor MRI, a tensor describing local water diffusion is acquired for each voxel. The geometric nature of the diffusion tensors can quantitatively characterize the local structure in tissues such a ..."
Abstract

Cited by 43 (8 self)
 Add to MetaCart
This paper describes image processing techniques for Diffusion Tensor Magnetic Resonance. In Diffusion Tensor MRI, a tensor describing local water diffusion is acquired for each voxel. The geometric nature of the diffusion tensors can quantitatively characterize the local structure in tissues such as bone, muscles, and white matter of the brain. The close relationship between local image structure and apparent diffusion makes this image modality very interesting for medical image analysis. We present a decomposition of the diffusion tensor based on its symmetry properties resulting in useful measures describing the geometry of the diffusion ellipsoid. A simple anisotropy measure follows naturally from this analysis. We describe how the geometry, or shape, of the tensor can be visualized using a coloring scheme based on the derived shape measures. We show how filtering of the tensor data of a human brain can provide a description of macrostructural diffusion which can...
Color Image Enhancement via Chromaticity Diffusion
 IEEE Transactions on Image Processing
, 2002
"... A novel approach for color image denoising is proposed in this paper. The algorithm is based on separating the color data into chromaticity and brightness, and then processing each one of these components with partial differential equations or diffusion flows. In the proposed algorithm, each color p ..."
Abstract

Cited by 43 (3 self)
 Add to MetaCart
A novel approach for color image denoising is proposed in this paper. The algorithm is based on separating the color data into chromaticity and brightness, and then processing each one of these components with partial differential equations or diffusion flows. In the proposed algorithm, each color pixel is considered as andimensional vector. The vectors' direction, a unit vector, gives the chromaticity, while the magnitude represents the pixel brightness. The chromaticity is processed with a system of coupled diffusion equations adapted from the theory of harmonic maps in liquid crystals. This theory deals with the regularization of vectorial data, while satisfying the intrinsic unit norm constraint of directional data such as chromaticity. Both isotropic and anisotropic diffusion flows are presented for thisdimensional chromaticity diffusion flow. The brightness is processed by a scalar median filter or any of the popular and well established anisotropic diffusion flows for scalar image enhancement. We present the underlying theory, a number of examples, and briefly compare with the current literature. Index TermsBrightness, chromaticity, color image denoising, directions, harmonic maps, isotropic and anisotropic diffusion, liquid crystals, partial differential equations. I.