Text-only
Table of Contents (
frame
/
no frame
)
(20) Hybrid OpenMP/MPI Programming
Hybrid MPI/OpenMP Programs
MPI/OpenMP paradigm can work well for clusters of SMP computers
Use MPI across nodes and OpenMP within nodes
Avoids the extra communication overhead with MPI within the same node
Works well for problems with two-level parallelism
OpenMP works well for fine-grained parallelism
MPI works well for coarse-grained parallelism
Strategies for Hybrid Parallelization
From serial code decompose first with MPI and then add OpenMP
Simplest and least error-prone method
use MPI outside parallel region
allow only master thread to communicate between MPI tasks.
could use MPI with parallel region with thread-safe MPI
hybrid.src last modified Mar 23, 2009
Introduction
Table of Contents
(
frame
/
no frame
)
Printable
(single file)
© Dartmouth College