DMCA
Hybrid mpi/openmp parallel linear support vector machine training
| Venue: | JMLR |
| Citations: | 7 - 1 self |
BibTeX
@ARTICLE{Woodsend_hybridmpi/openmp,
author = {Kristian Woodsend and Jacek Gondzio and Sören Sonnenburg and Vojtech Franc and Elad Yom-tov and Michele Sebag},
title = {Hybrid mpi/openmp parallel linear support vector machine training},
journal = {JMLR},
year = {},
pages = {2009}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Support vector machines are a powerful machine learning technology, but the training process involves a dense quadratic optimization problem and is computationally challenging. A parallel implementation of linear Support Vector Machine training has been developed, using a combination of MPI and OpenMP. Using an interior point method for the optimization and a reformulation that avoids the dense Hessian matrix, the structure of the augmented system matrix is exploited to partition data and computations amongst parallel processors efficiently. The new implementation has been applied to solve problems from the PASCAL Challenge on Large-scale Learning. We show that our approach is competitive, and is able to solve problems in the Challenge many times faster than other parallel approaches. We also demonstrate that the hybrid version performs more efficiently than the version using pure MPI.
Keyphrases
augmented system matrix parallel implementation support vector machine dense hessian matrix parallel processor dense quadratic optimization problem training process large-scale learning hybrid version performs interior point method new implementation powerful machine linear support vector machine training pure mpi pascal challenge parallel approach challenge many time
