MPI: A standard message passing interface

MPI is a proposed standard message passing interface whose use on massively parallel computers and networks of workstations is becoming widespread. The design of MPI was a collective effort involving researchers in the United States and Europe from many organizations and institutions. MPI includes point-to-point and collective communication routines, as well as support for general datatypes, application topologies, and the construction of safe and modular parallel application libraries through the communicator abstraction. While making use of new ideas where appropriate, the MPI standard is based largely on current practice.