Weakly supervised named entity transliteration and discovery from multilingual comparable corpora

Weakly supervised named entity transliteration and discovery from multilingual comparable corpora (2006)

Cached

Download Links

[acl.ldc.upenn.edu]
[www.cs.jhu.edu]

Other Repositories/Bibliography

DBLP

by Alexandre Klementiev , Dan Roth

Venue:	In Association for Computational Linguistics
Citations:	16 - 6 self

Versions

Version History

Metadata Version 1

Datum	Value	Source
TITLE	Weakly supervised named entity transliteration and discovery from multilingual comparable corpora	INFERENCE
AUTHOR NAME	Alexandre Klementiev	SVM HeaderParse 0.2
AUTHOR AFFIL	Dept. of Computer Science; University of Illinois	SVM HeaderParse 0.2
AUTHOR ADDR	Urbana, IL 61801	SVM HeaderParse 0.2
AUTHOR NAME	Dan Roth	SVM HeaderParse 0.2
AUTHOR AFFIL	Dept. of Computer Science; University of Illinois	SVM HeaderParse 0.2
AUTHOR ADDR	Urbana, IL 61801	SVM HeaderParse 0.2
ABSTRACT	Named Entity recognition (NER) is an important part of many natural language processing tasks. Current approaches often employ machine learning techniques and require supervised data. However, many languages lack such resources. This paper presents an (almost) unsupervised learning algorithm for automatic discovery of Named Entities (NEs) in a resource free language, given a bilingual corpora in which it is weakly temporally aligned with a resource rich language. NEs have similar time distributions across such corpora, and often some of the tokens in a multi-word NE are transliterated. We develop an algorithm that exploits both observations iteratively. The algorithm makes use of a new, frequency based, metric for time distributions and a resource free discriminative approach to transliteration. Seeded with a small number of transliteration pairs, our algorithm discovers multi-word NEs, and takes advantage of a dictionary (if one exists) to account for translated or partially translated NEs. We evaluate the algorithm on an English-Russian corpus, and show high level of NEs discovery in Russian. 1	SVM HeaderParse 0.2
YEAR	2006	INFERENCE
VENUE	In Association for Computational Linguistics	INFERENCE
VENUE TYPE	CONFERENCE	INFERENCE
PAGES	817--824	INFERENCE
CITATIONS	16 found	ParsCit 1.0