DMCA
Document Clustering using Word Clusters via the Information Bottleneck Method (2000)
Cached
Download Links
| Venue: | In ACM SIGIR 2000 |
| Citations: | 181 - 17 self |
BibTeX
@INPROCEEDINGS{Slonim00documentclustering,
author = {Noam Slonim and Naftali Tishby and Y I(x Y},
title = {Document Clustering using Word Clusters via the Information Bottleneck Method},
booktitle = {In ACM SIGIR 2000},
year = {2000},
pages = {208--215},
publisher = {ACM press}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
We present a novel implementation of the recently introduced information bottleneck method for unsupervised document clustering. Given a joint empirical distribution of words and documents, p(x; y), we first cluster the words, Y , so that the obtained word clusters, Y_hat , maximally preserve the information on the documents. The resulting joint distribution, p(X; Y_hat ), contains most of the original information about the documents, I(X; Y_hat ) ~= I(X;Y ), but it is much less sparse and noisy. Using the same procedure we then cluster the documents, X , so that the information about the word-clusters is preserved. Thus, we first find word-clusters that capture most of the mutual information about the set of documents, and then find document clusters, that preserve the information about the word clusters. We tested this procedure over several document collections based on subsets taken from the standard 20Newsgroups corpus. The results were assessed by calculating the correlation between the document clusters and the correct labels for these documents. Finding from our experiments show that this double clustering procedure, which uses the information bottleneck method, yields significantly superior performance compared to other common document distributional clustering algorithms. Moreover, the double clustering procedure improves all the distributional clustering methods examined here.
Keyphrases
information bottleneck method word cluster document clustering document cluster double clustering procedure mutual information novel implementation superior performance joint empirical distribution obtained word cluster unsupervised document clustering joint distribution common document distributional clustering algorithm several document collection original information distributional clustering method correct label
