Collective Communication
摘要
The previous chapter discussed point-to-point communication: how to send and receive messages between individual processes in an MPI program. This chapter deals with collective communication: how to send and receive messages among many different processes at the same time. Collective communications include various forms of one-to-all, all-to-one, and all-to-all communication patterns. We now launch into the basic functionality MPI has for dealing with these different collective communication scenarios.