DMCA
Efficient Algorithms for Mining Outliers from Large Data Sets (2000)
| Citations: | 322 - 0 self |
BibTeX
@MISC{Ramaswamy00efficientalgorithms,
author = {Sridhar Ramaswamy and Rajeev Rastogi and Kyuseok Shim},
title = {Efficient Algorithms for Mining Outliers from Large Data Sets},
year = {2000}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
In this paper, we propose a novel formulation for distance-based outliers that is based on the distance of a point from its k th nearest neighbor. We rank each point on the basis of its distance to its k th nearest neighbor and declare the top n points in this ranking to be outliers. In addition to developing relatively straightforward solutions to finding such outliers based on the classical nestedloop join and index join algorithms, we develop a highly efficient partition-based algorithm for mining outliers. This algorithm first partitions the input data set into disjoint subsets, and then prunes entire partitions as soon as it is determined that they cannot contain outliers. This results in substantial savings in computation. We present the results of an extensive experimental study on real-life and synthetic data sets. The results from a real-life NBA database highlight and reveal several expected and unexpected aspects of the database. The results from a study on synthetic data sets demonstrate that the partition-based algorithm scales well with respect to both data set size and data set dimensionality.
Keyphrases
large data set efficient algorithm synthetic data set efficient partition-based algorithm extensive experimental study top point input data real-life nba database highlight partition-based algorithm scale index join algorithm classical nestedloop join straightforward solution novel formulation substantial saving disjoint subset prune entire partition distance-based outlier unexpected aspect contain outlier
