## Scalability Issues Affecting the Design of a Dense Linear Algebra Library (1994)

Venue: | JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING |

Citations: | 24 - 12 self |

### BibTeX

@ARTICLE{Dongarra94scalabilityissues,

author = {Jack J. Dongarra and Robert A. van de Geijn and David W. Walker},

title = { Scalability Issues Affecting the Design of a Dense Linear Algebra Library},

journal = {JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING},

year = {1994},

volume = {22},

pages = {523--537}

}

### OpenURL

### Abstract

This paper discusses the scalability of Cholesky, LU, and QR factorization routines on MIMD distributed memory concurrent computers. These routines form part of the ScaLAPACK mathematical software library that extends the widely-used LAPACK library to run efficiently on scalable concurrent computers. To ensure good scalability and performance, the ScaLAPACK routines are based on block-partitioned algorithms that reduce the frequency of data movement between different levels of the memory hierarchy, and particularly between processors. The block cyclic data distribution, that is used in all three factorization algorithms, is described. An outline of the sequential and parallel block-partitioned algorithms is given. Approximate models of algorithms' performance are presented to indicate which factors in the design of the algorithm have an impact upon scalability. These models are compared with timings results on a 128-node Intel iPSC/860 hypercube. It is shown that the routines are highl...