Abstract

challenge to NLP applications. We present a method for automatic identification of non-compositional expressions using their statistical properties in a text corpus. Our method is based on the hypothesis that when a phrase is non-composition, its mutual information differs significantly from the mutual informations of phrases obtained by substituting one of the word in the phrase with a similar word.

Citations

642	Accurate methods for the statistics of surprise and coincidence - Dunning - 1993
129	Word Sense Disambiguation Using a Second Language Monolingual Corpus - Dagan, Itai - 1994
28	Looking for needles in a haystack, or: locating interesting collocational expressions in large textual databases - Choueka - 1988