DMCA
Shared Memory, Message Passing, and Hybrid Merge Sorts for Standalone and Clustered SMPs
| Citations: | 6 - 0 self |
BibTeX
@MISC{Radenski_sharedmemory,,
author = {Atanas Radenski},
title = {Shared Memory, Message Passing, and Hybrid Merge Sorts for Standalone and Clustered SMPs},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract – While merge sort is well-understood in parallel algorithms theory, relatively little is known of how to implement parallel merge sort with mainstream parallel programming platforms, such as OpenMP and MPI, and run it on mainstream SMP-based systems, such as multi-core computers and multi-core clusters. This is misfortunate because merge sort is not only a fast and stable sort algorithm, but it is also an easy to understand and popular representative of the rich class of divide-and-conquer methods; hence better understanding of merge sort parallelization can contribute to better understanding of divide-and-conquer parallelization in general. In this paper, we investigate three parallel merge-sorts: shared memory merge sort that runs on SMP systems with OpenMP; message-passing merge sort that runs on computer clusters with MPI; and combined hybrid merge sort, with both OpenMP and MPI, that runs on clustered SMPs. We have experimented with our parallel merge sorts on a dedicated Rocks SMP cluster and on a virtual SMP luster in the Amazon Elastic Compute Cloud. In our experiments, shared memory merge sort with OpenMP has achieved best speedup. We believe that we are the first ones to concurrently experiment with- and compare – shared memory, message passing, and hybrid merge sort. Our results can help in the parallelization of specific practical merge sort routines and, even more important, in the practical parallelization of other divide-and-conquer algorithms for mainstream SMP-based systems.
Keyphrases
hybrid merge sort clustered smps message passing shared memory merge sort memory merge sort parallel merge sort mainstream smp-based system amazon elastic compute cloud message-passing merge sort merge sort parallelization divide-and-conquer parallelization first one dedicated rock smp cluster divide-and-conquer algorithm specific practical merge sort routine multi-core cluster stable sort algorithm computer cluster smp system practical parallelization parallel algorithm theory popular representative virtual smp luster divide-and-conquer method mainstream parallel programming platform multi-core computer rich class parallel merge-sorts
