Abstract

This paper presents a simple unsupervised learning algorithm for recognizing synonyms, based on statistical data acquired by querying a Web search engine. The algorithm, called PMI-IR, uses Pointwise Mutual Information (PMI) and Information Retrieval (IR) to measure the similarity of pairs of words. PMI-IR is empirically evaluated using 80 synonym test questions from the Test of English as a Foreign Language (TOEFL) and 50 synonym test questions from a collection of tests for students of English as a Second Language (ESL). On both tests, the algorithm obtains a score of 74%. PMI-IR is contrasted with Latent Semantic Analysis (LSA), which achieves a score of 64% on the same 80 TOEFL questions. The paper discusses potential applications of the new unsupervised learning algorithm and some implications of the results for LSA and LSI (Latent Semantic Indexing).

Citations

2168	R.A.: Indexing by latent semantic analysis - Deerwester, Dumais, et al. - 1990
1996	WordNet: An Electronic Lexical Database - Fellbaum, editor - 1998
764	S.: A solution to plato’s problem: The latent semantic analysis theory of acquisition, induction and representation of knowledge. Psychological Review 104 - Landauer, Dumais - 1997
627	Word association norms, mutual information, and lexicography - Church, Hanks - 1990
528	Automatic retrieval and clustering of similar words - Lin - 1998
521	Foundations of statistical natural language processing - Manning, Schütze - 1999
412	Dynamic itemset counting and implication rules for market basket data - Brin, Motwani, et al. - 1997
395	Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy - Jiang, Conrath - 1997
320	Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language - Resnik - 1999
210	Latent semantic indexing: A probabilistic analysis - Papadimitriou, Tamaki, et al. - 1998
187	EuroWordNet A Multilingual Database with Lexical Semantic Networks - Vossen, ed - 1998
139	Automatic query expansion using smart: TREC-3 - Buckley, Salton, et al. - 1995
131	Using statistics in lexical analysis - Church, Gale, et al. - 1991
94	Learning Algorithms for Keyphrase Extraction - Turney - 2000
62	A synopsis of linguistic theory 1930–1955 - Firth - 1957
59	T.: Computational Methods for Intelligent Information Access - Berry, Dumais, et al. - 1995
58	Information retrieval based on conceptual distance in IS-A hierarchies - Lee, Kim, et al. - 1993
36	Using WordNet as a Knowledge Base for Measuring Semantic Similarity Between Words - Richardson, Smeaton, et al. - 1994
17	Finding Semantic Similarity in Raw Text: the Deese Antonyms - Grefenstette - 1992
5	Search Engine Sizes. SearchEngineWatch.com, internet.com Corporation - Sullivan - 2000
3	Interlingual BRICO - Haase
2	Basic 2000 Words - Synonym Match 1 - Tatsuki - 1998
1	of English as a Foreign Language (TOEFL), Educational Testing Service - Test
1	K.: Comparison Between TREC2 and TREC3 - Jones - 1994