Gravel: A Communication Library to Fast Path MPI

Author : Danalis, Anthony; Brown, Aaron; Pollock, Lori; Swany, Martin; Cavazos, John
Booktitle : EuroPVM/MPI 2008, LNCS 5205
Date : Sep 2008
Editor : Lastovetsky, A.
Publisher : Springer-Verlag Berlin Heidelberg
Pages : 111–119
Keyword(s) : MPI, RDMA, Overlapping, Communication protocols, Cluster computing
Document Type : In Conference Proceedings

Abstract :

Remote Direct Memory Access (RDMA) technology allows data to move from the memory of one system into another system’s memory without involving either one’s CPU. This capability enables communication-computation overlapping, which is highly desirable for addressing the costly communication overhead in cluster computing. This paper describes the consumer-initiated and producer-initiated protocols of a companion library for MPI called Gravel. Gravel works in concert with MPI to achieve increased communication-computation overlap by separating the meta-data exchange from the application data exchange, thus allowing different communication protocols to be implemented at the application layer. We demonstrate performance improvements using Gravel for a set of communication patterns commonly found in MPI scientific applications.

Paper Link