DMCA
OpenMP for Clusters via Translation to Global Arrays ∗ (2004)
BibTeX
@MISC{Huang04openmpfor,
author = {Lei Huang and Barbara Chapman and Zhenying Liu and Lei Huang and Barbara Chapman and Zhenying Liu},
title = {OpenMP for Clusters via Translation to Global Arrays ∗},
year = {2004}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
This paper discusses a novel approach to implementing OpenMP on clusters. Traditional approaches to do so rely on Software Distributed Shared Memory systems to handle shared data. We discuss these and then introduce an alternative approach that translates OpenMP to Global Arrays (GA), explaining the basic strategy. GA requires a data distribution. We do not expect the user to supply this; rather, we show how we perform data distribution and work distribution according to the user-supplied OpenMP static loop schedules. An inspector-executor strategy is employed for irregular applications in order to gather information on accesses to potentially non-local data, group non-local data transfers and overlap communications with local computations. Furthermore, a new directive INVARIANT is proposed to provide information about the dynamic scope of data access patterns. This directive can help us generate efficient codes for irregular applications using the inspector-executor approach. We also illustrate how to deal with some hard cases containing reshaping and strided accesses during the translation. Our experiments show promising results for the corresponding regular and irregular GA codes.
Keyphrases
global array data distribution irregular application group non-local data transfer novel approach dynamic scope hard case strided access non-local data inspector-executor approach local computation new directive invariant user-supplied openmp static loop schedule basic strategy overlap communication irregular ga code efficient code traditional approach software distributed shared memory system alternative approach data access pattern inspector-executor strategy work distribution promising result
