Depth-first non-derivable itemset mining

DMCA

Depth-first non-derivable itemset mining (2005)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Toon Calders , Bart Goethals

Venue:	In SIAM Int. Conf. on Data Mining (SDM’05
Citations:	57 - 7 self

BibTeX

@INPROCEEDINGS{Calders05depth-firstnon-derivable,
    author = {Toon Calders and Bart Goethals},
    title = {Depth-first non-derivable itemset mining},
    booktitle = {In SIAM Int. Conf. on Data Mining (SDM’05},
    year = {2005}
}

OpenURL

Abstract

Mining frequent itemsets is one of the main problems in data mining. Much effort went into developing efficient and scalable algorithms for this problem. When the support threshold is set too low, however, or the data is highly correlated, the number of frequent itemsets can become too large, independently of the algorithm used. Therefore, it is often more interesting to mine a reduced collection of interesting itemsets, i.e., a condensed representation. Recently, in this context, the non-derivable itemsets were proposed as an important class of itemsets. An itemset is called derivable when its support is completely determined by the support of its subsets. As such, derivable itemsets represent redundant information and can be pruned from the collection of frequent itemsets. It was shown both theoretically and experimentally that the collection of non-derivable frequent itemsets is in general much smaller than the complete set of frequent itemsets. A breadth-first, Apriori-based algorithm, called NDI, to find all non-derivable itemsets was proposed. In this paper we present a depth-first algorithm, dfNDI, that is based on Eclat for mining the non-derivable itemsets. dfNDI is evaluated on real-life datasets, and experiments show that dfNDI outperforms NDI with an order of magnitude. 1

Keyphrases

frequent itemsets non-derivable itemsets depth-first non-derivable itemset mining derivable itemsets complete set depth-first algorithm important class apriori-based algorithm redundant information real-life datasets reduced collection condensed representation non-derivable frequent itemsets dfndi outperforms ndi much effort scalable algorithm main problem data mining support threshold

DMCA