DMCA
SmartStore: A New Metadata Organization Paradigm with (2009)
Cached
Download Links
| Venue: | Semantic-Awareness ,” FAST Work-in-Progress Report and Poster Session |
| Citations: | 19 - 5 self |
BibTeX
@INPROCEEDINGS{Hua09smartstore:a,
author = {Yu Hua and Hong Jiang and Yifeng Zhu and Dan Feng and Lei Tian},
title = {SmartStore: A New Metadata Organization Paradigm with},
booktitle = {Semantic-Awareness ,” FAST Work-in-Progress Report and Poster Session},
year = {2009}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Existing storage systems using hierarchical directory tree do not meet scalability and functionality requirements for exponentially growing datasets and increasingly complex queries in Exabyte-level systems with billions of files. This paper proposes semantic-aware organization, called SmartStore, which exploits metadata semantics of files to judiciously aggregate correlated files into semanticaware groups by using information retrieval tools. Decentralized design improves system scalability and reduces query latency for complex queries (range and top-k queries), which is conducive to constructing semantic-aware caching, and conventional filenamebased query. SmartStore limits search scope of complex query to a single or a minimal number of semantically related groups and avoids or alleviates brute-force search in entire system. Extensive experiments using real-world traces show that SmartStore improves system scalability and reduces query latency over basic database approaches by one thousand times. To the best of our knowledge, this is the first study implementing complex queries in large-scale file systems. 1.
Keyphrases
complex query new metadata organization paradigm system scalability information retrieval tool exabyte-level system storage system top-k query real-world trace correlated file brute-force search thousand time first study semantic-aware caching basic database approach large-scale file system decentralized design conventional filenamebased query metadata semantics semantic-aware organization functionality requirement entire system hierarchical directory tree extensive experiment semanticaware group minimal number
