Parallel Programming Models

• Directives-based parallel programming language
  
• OpenMP (most widely used)
• High Performance Fortran (HPF)
• directives tell processor how to distribute data and work across the processors
  
• directives appear as comments in the serial code
  
• implemented on shared memory architectures

• Message Passing (MPI)
  
• pass messages to send/receive data between processes
  
• each process has its own local variables
  
• can be used on either shared or distributed memory architectures
• outgrowth of PVM software