Results 1  10
of
82
Scaling up Dynamic Time Warping for Datamining Applications
 In Proc. 6th Int. Conf. on Knowledge Discovery and Data Mining
, 2000
"... There has been much recent interest in adapting data mining algorithms to time series databases. Most of these algorithms need to compare time series. Typically some variation of Euclidean distance is used. However, as we demonstrate in this paper, Euclidean distance can be an extremely brittle dist ..."
Abstract

Cited by 59 (3 self)
 Add to MetaCart
There has been much recent interest in adapting data mining algorithms to time series databases. Most of these algorithms need to compare time series. Typically some variation of Euclidean distance is used. However, as we demonstrate in this paper, Euclidean distance can be an extremely brittle distance measure. Dynamic time warping (DTW) has been suggested as a technique to allow more robust distance calculations, however it is computationally expensive. In this paper we introduce a modification of DTW which operates on a higher level abstraction of the data, in particular, a Piecewise Aggregate Approximation (PAA). Our approach allows us to outperform DTW by one to two orders of magnitude, with no loss of accuracy.
Pattern Extraction for Time Series Classification
, 2001
"... In this paper, we propose some new tools to allow machine learning classifiers to cope with time series data. We first argue that many timeseries classification problems can be solved by detecting and combining local properties or patterns in time series. Then, a technique is proposed to find patte ..."
Abstract

Cited by 58 (2 self)
 Add to MetaCart
In this paper, we propose some new tools to allow machine learning classifiers to cope with time series data. We first argue that many timeseries classification problems can be solved by detecting and combining local properties or patterns in time series. Then, a technique is proposed to find patterns which are useful for classification. These patterns are combined to build interpretable classification rules. Experiments, carried out on several artificial and real problems, highlight the interest of the approach both in terms of interpretability and accuracy of the induced classifiers.
Local Discriminant Bases
 Wavelet Applications in Signal and Image Processing II, volume 2303 of SPIE Proceedings
, 1994
"... We describe an extension to the "bestbasis" method to construct an orthonormal basis which maximizes a class separability for signal classification problems. This algorithm reduces the dimensionality of these problems by using basis functions which are well localized in timefrequency pla ..."
Abstract

Cited by 55 (2 self)
 Add to MetaCart
(Show Context)
We describe an extension to the "bestbasis" method to construct an orthonormal basis which maximizes a class separability for signal classification problems. This algorithm reduces the dimensionality of these problems by using basis functions which are well localized in timefrequency plane as feature extractors. We tested our method using two synthetic datasets: extracted features (expansion coefficients of input signals in these basis functions), supplied them to the conventional pattern classifiers, then computed the misclassification rates. These examples show the superiority of our method over the direct application of these classifiers on the input signals. As a further application, we also describe a method to extract signal component from data consisting of signal and textured background. keywords: wavelet packets, local trigonometric transforms, classification, feature extraction, dimensionality reduction, linear discriminant analysis, classification and regression trees 1 I...
Learning Comprehensible Descriptions of Multivariate Time Series
 In Ivan Bratko and Saso Dzeroski, editors, Proceedings of the 16 th International Conference of Machine Learning (ICML99
, 1999
"... Supervised classification is one of the most active areas of machine learning research. Most work has focused on classification in static domains, where an instantaneous snapshot of attributes is meaningful. In many domains, attributes are not static; in fact, it is the way they vary temporally that ..."
Abstract

Cited by 51 (0 self)
 Add to MetaCart
Supervised classification is one of the most active areas of machine learning research. Most work has focused on classification in static domains, where an instantaneous snapshot of attributes is meaningful. In many domains, attributes are not static; in fact, it is the way they vary temporally that can make classification possible. Examples of such domains include speech recognition, gesture recognition and electrocardiograph classification. While it is possible to use ad hoc, domainspecific techniques for "flattening " the time series to a learnerfriendly representation, this fails to take into account both the special problems and special heuristics applicable to temporal data and often results in unreadable concept descriptions. Though traditional time series techniques can sometimes produce accurate classifiers, few can provide comprehensible descriptions. We propose a general architecture for classification and description of multivariate time series. It employs event primitive...
Local discriminant bases and their applications
 Journal of Mathematical Imaging and Vision
, 1995
"... Abstract. We describe an extension to the "bestbasis " method to select an orthonormal basis suitable for signal/image classification problems from a large collection of orthonormal bases consisting of wavelet packets or local trigonometric bases. The original bestbasis algorith ..."
Abstract

Cited by 45 (5 self)
 Add to MetaCart
(Show Context)
Abstract. We describe an extension to the &quot;bestbasis &quot; method to select an orthonormal basis suitable for signal/image classification problems from a large collection of orthonormal bases consisting of wavelet packets or local trigonometric bases. The original bestbasis algorithm selects a basis minimizing entropy from such a &quot;library of orthonormal bases &quot; whereas the proposed algorithm selects a basis maximizing a certain discriminant measure (e.g., relative entropy) among classes. Once such a basis is selected, a small number of most significant coordinates (features) are fed into a traditional classifier such as Linear Discriminant Analysis (LDA) or Classification and Regression Tree (CARTTM). The performance of these statistical methods is enhanced since the proposed methods reduce the dimensionality of the problem at hand without losing important information for that problem. Here, the basis functions which are welllocalized in the timefrequency plane are used as feature extractors. We applied our method to two signal classification problems and an image texture classification problem. These experiments show the superiority of our method over the direct application of these classifiers on the input signals. As a further application, we also describe a method to extract signal component from data consisting of signal and textured background.
Nonlinear processing of a shift invariant DWT for noise reduction
, 1995
"... A novel approach for noise reduction is presented. Similar to Donoho, we employ thresholding in some wavelet transform domain but use a nondecimated and consequently redundant wavelet transform instead of the usual orthogonal one. Another difference is the shift invariance as opposed to the traditio ..."
Abstract

Cited by 40 (8 self)
 Add to MetaCart
A novel approach for noise reduction is presented. Similar to Donoho, we employ thresholding in some wavelet transform domain but use a nondecimated and consequently redundant wavelet transform instead of the usual orthogonal one. Another difference is the shift invariance as opposed to the traditional orthogonal wavelet transform. We show that this new approach can be interpreted as a repeated application of Donoho's original method. The main feature is, however, a dramatically improved noise reduction compared to Donoho's approach, both in terms of the l 2 error and visually, for a large class of signals. This is shown by theoretical and experimental results, including synthetic aperture radar (SAR) images.
Frame Representations for Texture Segmentation
 IEEE Transactions on Image Processing
, 1996
"... We introduce a novel method of feature extraction for texture segmentation that relies on multichannel wavelet frames and twodimensional envelope detection. We describe and compare two algorithms for envelope detection based on (1) the Hilbert transform and (2) zerocrossings. We present criteria ..."
Abstract

Cited by 35 (0 self)
 Add to MetaCart
(Show Context)
We introduce a novel method of feature extraction for texture segmentation that relies on multichannel wavelet frames and twodimensional envelope detection. We describe and compare two algorithms for envelope detection based on (1) the Hilbert transform and (2) zerocrossings. We present criteria for filter selection and discuss quantitatively their effect on feature extraction. The performance of our method is demonstrated experimentally on samples of both natural and synthetic textures. Keywords Feature extraction, image segmentation, wavelet analysis. I. Introduction Features for texture representation are of crucial importance for accomplishing segmentation[1]. Previous multichannel approaches for texture feature extraction utilized the concept of spatialfrequency representation [2] [3], and have been supported by studies of the human visual system [4]. In these methods, both complex and real filters were used. Complex prolate spheroidal sequences were used as channel filter...
Iterative deepening dynamic time warping for time series
 In Proc 2 nd SIAM International Conference on Data Mining
, 2002
"... Time series are a ubiquitous form of data occurring in virtually every scientific discipline and business application. There has been much recent work on adapting data mining algorithms to time series databases. For example, Das et al. attempt to show how association rules can be learned from time s ..."
Abstract

Cited by 34 (8 self)
 Add to MetaCart
(Show Context)
Time series are a ubiquitous form of data occurring in virtually every scientific discipline and business application. There has been much recent work on adapting data mining algorithms to time series databases. For example, Das et al. attempt to show how association rules can be learned from time series [7]. Debregeas and Hebrail [8]
On the Statistics of Best Bases Criteria
, 1995
"... Wavelet packets are a useful extension of wavelets providing an adaptive timescale analysis. In using noisy observations of a signal of interest, the criteria for best bases representation are random variables. The search may thus be very sensitive to noise. In this paper, we characterize the asympt ..."
Abstract

Cited by 23 (3 self)
 Add to MetaCart
(Show Context)
Wavelet packets are a useful extension of wavelets providing an adaptive timescale analysis. In using noisy observations of a signal of interest, the criteria for best bases representation are random variables. The search may thus be very sensitive to noise. In this paper, we characterize the asymptotic statistics of the criteria to gain insight which can in turn, be used to improve on the performance of the analysis. By way of a wellknown informationtheoretic principle, namely the Minimum Description Length, we provide an alternative approach to Minimax methods for deriving various attributes of nonlinear wavelet packet estimates. 1 Introduction Research interest in wavelets and their applications have tremendously grown over the last five years. Only, more recently, however, have their applications been considered in a stochastic setting [Fl1, Wo1, BB + , CH1]. A number of papers which have addressed the optimal representation of a signal in a wavelet/wavelet packet basis, have...
Theory and Applications of the ShiftInvariant, TimeVarying and Undecimated Wavelet Transforms
, 1995
"... In this thesis, we generalize the classical discrete wavelet transform, and construct wavelet transforms that are shiftinvariant, timevarying, undecimated, and signal dependent. The result is a set of powerful and efficient algorithms suitable for a wide variety of signal processing tasks, e.g., d ..."
Abstract

Cited by 17 (3 self)
 Add to MetaCart
In this thesis, we generalize the classical discrete wavelet transform, and construct wavelet transforms that are shiftinvariant, timevarying, undecimated, and signal dependent. The result is a set of powerful and efficient algorithms suitable for a wide variety of signal processing tasks, e.g., data compression, signal analysis, noise reduction, statistical estimation, and detection. These algorithms are comparable and often superior to traditional methods. In this sense, we put wavelets in action.