Gravel: A Communication Library to Fast Path MPI
Author : Danalis, Anthony; Brown, Aaron; Pollock, Lori; Swany, Martin; Cavazos, John
Booktitle : EuroPVM/MPI 2008, LNCS 5205
Date : Sep 2008
Editor : Lastovetsky, A.
Publisher : Springer-Verlag Berlin Heidelberg
Pages : 111–119
Keyword(s) : MPI, RDMA, Overlapping, Communication protocols, Cluster computing
Document Type : In Conference Proceedings
Remote Direct Memory Access (RDMA) technology allows data to move from the memory of one system into another system’s memory without involving either one’s CPU. This capability enables communication-computation overlapping, which is highly desirable for addressing the costly communication overhead in cluster computing. This paper describes the consumer-initiated and producer-initiated protocols of a companion library for MPI called Gravel. Gravel works in concert with MPI to achieve increased communication-computation overlap by separating the meta-data exchange from the application data exchange, thus allowing different communication protocols to be implemented at the application layer. We demonstrate performance improvements using Gravel for a set of communication patterns commonly found in MPI scientific applications.