DMCA
A parallel computing approach to creating engineering concept spaces for semantic retrieval: The Illinois Digital Library Initiative project (1996)
| Venue: | Ieee Transactions on Pattern Analysis and Machine Intelligence |
| Citations: | 50 - 12 self |
BibTeX
@ARTICLE{Chen96aparallel,
author = {Hsinchun Chen and Bruce Schatz and Tobun Ng and Joanne Martinez and Amy Kirchhoff and Chienting Lin and E Computer Society},
title = {A parallel computing approach to creating engineering concept spaces for semantic retrieval: The Illinois Digital Library Initiative project},
journal = {Ieee Transactions on Pattern Analysis and Machine Intelligence},
year = {1996},
pages = {771782}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract-This research presents preliminary results generated from the semantic retrieval research component of the Illinois Digital Library Initiative (DLI) project. Using a variation of the automatic thesaurus generation techniques, to which we refer as the concept space approach, we aimed to create graphs of domain-specific concepts (terms) and their weighted co-occurrence relationships for all major engineering domains. Merging these concept spaces and providing traversal paths across different concept spaces could potentially help alleviate the vocabulary (difference) problem evident in large-scale information retrieval. We have experimented previously with such a technique for a smaller molecular biology domain (Worm Community System, with IO+ MBs of document collection) with encouraging results. In order to address the scalability issue related to large-scale information retrieval and analysis for the current Illinois DLI project, we recently conducted experiments using the concept space approach on parallel supercomputers. Our test collection included 2+ GBs of computer science and electrical engineering abstracts extracted from the INSPEC database. The concept space approach called for extensive textual and statistical analysis (a form of knowledge discovery) based on automatic indexing and cooccurrence analysis algorithms, both previously tested in the biology domain. Initial testing results using a 512-node CM-5 and a 16processor SGI Power Challenge were promising. Power Challenge was later selected to create a comprehensive computer engineering concept space of about 270,000 terms and 4,000,000+ links using 24.5 hours of CPU time. Our system evaluation involving 12 knowledgeable subjects revealed that the automatically-created computer engineering concept space generated
Keyphrases
illinois digital library initiative project engineering concept space concept space approach semantic retrieval large-scale information retrieval current illinois dli project traversal path document collection automatic indexing worm community system scalability issue io mb 512-node cm-5 power challenge statistical analysis automatically-created computer engineering concept space weighted co-occurrence relationship different concept space test collection semantic retrieval research component parallel supercomputer molecular biology domain problem evident knowledgeable subject comprehensive computer engineering concept space computer science abstract-this research present preliminary result biology domain concept space cpu time encouraging result major engineering domain electrical engineering abstract sgi power challenge domain-specific concept illinois digital library initiative automatic thesaurus generation technique inspec database cooccurrence analysis algorithm knowledge discovery system evaluation
