DMCA
Pregel: A system for large-scale graph processing (2010)
Cached
Download Links
| Venue: | IN SIGMOD |
| Citations: | 495 - 0 self |
BibTeX
@INPROCEEDINGS{Malewicz10pregel:a,
author = {Grzegorz Malewicz and Matthew H. Austern and Aart J. C. Bik and James C. Dehnert and Ilan Horn and Naty Leiser and Grzegorz Czajkowski},
title = {Pregel: A system for large-scale graph processing},
booktitle = {IN SIGMOD},
year = {2010},
pages = {135--146},
publisher = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Many practical computing problems concern large graphs. Standard examples include the Web graph and various social networks. The scale of these graphs—in some cases billions of vertices, trillions of edges—poses challenges to their efficient processing. In this paper we present a computational model suitable for this task. Programs are expressed as a sequence of iterations, in each of which a vertex can receive messages sent in the previous iteration, send messages to other vertices, and modify its own state and that of its outgoing edges or mutate graph topology. This vertex-centric approach is flexible enough to express a broad set of algorithms. The model has been designed for efficient, scalable and fault-tolerant implementation on clusters of thousands of commodity computers, and its implied synchronicity makes reasoning about programs easier. Distributionrelated details are hidden behind an abstract API. The result is a framework for processing large graphs that is expressive and easy to program.
Keyphrases
large-scale graph processing various social network commodity computer graph topology web graph efficient processing outgoing edge edge pose challenge vertex-centric approach large graph implied synchronicity fault-tolerant implementation broad set case billion previous iteration computational model abstract api problem concern large graph
