## Calculating a New Data Mining Algorithm for Market Basket Analysis (2000)

### Cached

### Download Links

- [www.ipl.t.u-tokyo.ac.jp]
- [www.ipl.t.u-tokyo.ac.jp]
- [scholar.lib.vt.edu]
- DBLP

### Other Repositories/Bibliography

Citations: | 4 - 1 self |

### BibTeX

@MISC{Hu00calculatinga,

author = {Zhenjiang Hu and Wei-ngan Chin and Masato Takeichi},

title = {Calculating a New Data Mining Algorithm for Market Basket Analysis},

year = {2000}

}

### OpenURL

### Abstract

The general goal of data mining is to extract interesting correlated information from large

### Citations

2868 |
UCI repository of machine learning databases [http://www.ics.uci.edu/∼mlearn/mlrepository.html
- Blake, Merz
- 1998
(Show Context)
Citation Context ...in Haskell by representing sets using lists. The input sample data was extracted from the Richard Forsyth's zoological database, which is available in the UCI Repository of Machine Learning Databases =-=[BM98]-=-. It contains 17 objects (corresponding to 17 boolean attributes in the database) and 101 transactions (corresponding to 101 instances). We set the threshold to be 20 (20% of frequency), and did exper... |

2675 | Fast algorithms for mining association rules - Agrawal, Srikant - 1994 |

2439 | Mining Association Rules between Sets of Items in Large Databases
- Agrawal, Imielinski, et al.
(Show Context)
Citation Context ...tly enough - exceeding a given threshold. More concrete explanation of the problem can be found in Section 2. The most well-known classical algorithm for finding frequent set is the Apriori algorithm =-=[AIS93]-=- (from which many improved versions have been proposed) which relies on the property that a set can only be frequent if and only if all of its subsets are frequent. This algorithm builds a tree of fre... |

1310 | The essence of functional programming - Wadler |

696 |
The art of computer programming., volume 3: Sorting and searching
- Knuth
- 1974
(Show Context)
Citation Context ...We can preprocess the database to fit our algorithm by transposing it through a single pass. This preprocessing can be done in an efficient way even for a huge database saved in external storage (see =-=[Knu97]-=-). In fact, as such preprocessing need only be done once for a given transaction database, we can easily amortize its costs over many data mining runs for the discovery of interesting information/rule... |

486 | Dynamic itemset counting and implication rules for market basket data
- BRIN, MOTWANI, et al.
- 1997
(Show Context)
Citation Context ...-- The database that records all transactions is likely to be very large, so it is often beneficial for as much information to be discovered from each pass, so as to reduce the total number of passes =-=[BMUT97]-=-. -- In each pass, we hope that counting can be done efficiently and less candidates are generated for later check. This has led to the studies of different pruning algorithms as in [Toi96, LK98]. Two... |

319 | New algorithms for fast discovery of association rules - ZAKI, PARTHASARATHY, et al. - 1997 |

215 |
Introduction to Functional Programming using Haskell, 2nd edition
- Bird
- 1998
(Show Context)
Citation Context ... the filter-map property (that is commonly used in program derivation e.g. [Bir84]): (p⊳) ◦ ((x :)∗) =((x :)∗) ◦ ((p ◦ (x :))⊳) (1) 1 We assume that the readers are familiar with the Haskell language =-=[Bir98]-=- in this paper. In addition, we say that our Haskell programs are “pseudo” in the sense that they include some additional notations for sets. 4sand the filter-pipeline property: (p⊳) ◦ (q⊳) =(λx.(p x ... |

195 | A short cut to deforestation - Gill, Launchbury, et al. - 1993 |

116 | Parallel and Distributed Association Mining: A Survey
- Zaki
- 1999
(Show Context)
Citation Context ...ransaction-id-lists 13sof the lexicographically first two (k − 1)-length subsets that share common prefix to reduce searching space. However, their approach still needs more than three database scans =-=[Zak99]-=-. Comparatively, our algorithm adopts a simpler strategy to reduce searching space by organizing the intermediate frequent sets in a tree with specific constraints on sibling nodes. As a nice conseque... |

102 | Pincer search: A new algorithm for discovering the maximum frequent set - LIN, KEDEM - 1998 |

91 | Shortcut to Deforestation in Calculational Form - Takano, Meijer - 1995 |

89 | Multiple Uses of Frequent Sets and Condensed Representations (Extended Abstract
- Mannila, Toivonen
- 1996
(Show Context)
Citation Context ... Such a study needs to take account of both the distribution as well as the size of data sample. Rather we use a simple experiment to compare our algorithm with an existing improved Apriori algorithm =-=[MT96]-=-, one of the best algorithms used in the data mining community. We start by considering the case of a small database which can be put in the memory. We tested three algorithms in Haskell: our initial ... |

87 |
The Promotion and Accumulation Strategies in Transformational Programming
- Bird
- 1984
(Show Context)
Citation Context ...ion, we use the shorten notation: # to denote function length, and p/ to denote f ilter p. The filter operator enjoys the filter-element-map property (that is commonly used in program derivation e.g. =-=[Bir84]-=-): (p/) ffi ((x :)3) = ((x :)3) ffi ((p ffi (x :))/) and the filter-pipeline property: (p/) ffi (q/) = (x:(p xsq x)) / : In addition, xs `isSublist` ys is true if xs is a sublist of ys, and false othe... |

70 | Fast sequential and parallel algorithms for association rule mining: a comparison
- MUELLER
- 1995
(Show Context)
Citation Context ... if #vss ≥ least then {[]} else {} fs (o : os) vss least = fs os vss least ∪ (o :)∗(fs os ((o ∈) ⊳vss) least) The benefits of our fusion optimization can be compared to the technique of pass-bundling =-=[Mue95]-=- which is used to eliminate some unnecessary candidates that end up infrequent in the partitioned parallel association rule algorithm. Compared to that in [Mue95], our study is more formal and general... |

67 | Tabulation techniques for recursive programs - Bird - 1980 |

60 |
Safe fusion of functional expressions
- Chin
- 1992
(Show Context)
Citation Context ...n. Specifically, we will derive an efficient program for finding frequent sets from the specification fs os vss least = (fsp vss least) / (subs os) by using the known calculation techniques of fusion =-=[Chi92]-=-, generalization (accumulation) [Bir84, HIT99], base-case filter promotion [Chi90], and tabulation [Bir80, CH95]. 5 3.1 Fusion Fusion is used to merge two passes (from nested recursive calls) into a s... |

48 | W.Li. Parallel algorithms for fast discovery of association rules - Zaki, Parthasarathy, et al. - 1997 |

37 | Theories for Algorithm Calculation
- Jeuring
- 1993
(Show Context)
Citation Context ...ed program calculation [Bir89, BdM96], as opposed to simply program derivation. Many attempts have been made to apply the program calculation for the derivation of various kinds of efficient programs =-=[Jeu93]-=-, and for the construction of optimization passes of compilers [GLJ93, TM95]. However, people are still expecting more convincing and practical applications where program calculation can give a better... |

35 | Discovery of frequent patterns in large data collections
- Toivonen
- 1996
(Show Context)
Citation Context ...th respect to the initial straightforward specification, because the whole derivation is done in a semantics-preserving manner. In contrast, the correctness of existing algorithms, well summarized in =-=[Toi96]-=-, are often proved in an ad-hoc manner. Simplicity Our derived algorithm is surprisingly simple, compared to the existing algorithms which pass over the database many times and use complicated and cos... |

34 |
Automatic Methods for Program Transformation
- Chin
- 1990
(Show Context)
Citation Context ...m the specification fs os vss least = (fsp vss least) / (subs os) by using the known calculation techniques of fusion [Chi92], generalization (accumulation) [Bir84, HIT99], base-case filter promotion =-=[Chi90]-=-, and tabulation [Bir80, CH95]. 5 3.1 Fusion Fusion is used to merge two passes (from nested recursive calls) into a single one, by eliminating intermediate the data structure passing between the two ... |

33 | Tupling calculation eliminates multiple data traversals - Hu, Iwasaki, et al. - 1997 |

33 | A Calculational Fusion System HYLO - Onoue, Hu, et al. - 1997 |

32 | Parallelization in calculational forms
- Hu, Takeichi, et al.
- 1998
(Show Context)
Citation Context ...ets in P i+1 could be merged with frequent sets computed in P i . Note that this parallel algorithm can be obtained directly from the sequential program tab in Figure 1 by parallelization calculation =-=[HTC98]-=-, which is omitted here. Practical Issues The derived algorithm can be used practically to win over the existing algorithms. To be able to compare our results more convincingly with those in data mini... |

16 | Calculating accumulations - Hu, Iwasaki, et al. - 1999 |

9 | A transformational method for dynamic-sized tabulation - Chin, Hagiya - 1995 |

5 | A compiler for HDC - Herrmann, Lengauer, et al. - 1999 |

4 | Program transformation in calculational form
- Takano, Hu, et al.
- 1998
(Show Context)
Citation Context ...n and tabulation. These calculation techniques are quite well-known in the functional programming community. This work is a continuation of our effort to apply calculational transformation techniques =-=[THT98]-=- to the development of efficient programs [OHIT97, HITT97, HTC98]. Our previous work put emphasis on mechanical implementation of the transformation techniques, while this paper shows that this calcul... |