DMCA
WebPIE: A Web-scale parallel inference engine using
BibTeX
@MISC{A_webpie:a,
author = {Jacopo Urbani A and Spyros Kotoulas A and Jason Maassen A and Frank Van Harmelen A and Henri Bal A},
title = {WebPIE: A Web-scale parallel inference engine using},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
The large amount of Semantic Web data and its fast growth pose a significant computational challenge in performing efficient and scalable reasoning. On a large scale, the resources of single machines are no longer sufficient and we are required to distribute the process to improve performance. In this article, we propose a distributed technique to perform materialization under the RDFS and OWL ter Horst semantics using the MapReduce programming model. We will show that a straightforward implementation is not efficient and does not scale. Our technique addresses the challenge of distributed reasoning through a set of algorithms which, combined, significantly increase performance. We have implemented WebPIE (Web-scale Inference Engine) and we demonstrate its performance on a cluster of up to 64 nodes. We have evaluated our system using very large real-world datasets (Bio2RDF, LLD, LDSR) and the LUBM synthetic benchmark, scaling up to 100 billion triples. Results show that our implementation scales linearly and vastly outperforms current systems in terms of maximum data size and inference speed.
Keyphrases
web-scale parallel inference engine semantic web data mapreduce programming model maximum data size large scale web-scale inference engine significant computational challenge increase performance straightforward implementation fast growth owl ter horst semantics large real-world datasets scalable reasoning distributed technique outperforms current system inference speed single machine lubm synthetic benchmark large amount
