Presentation

· Contributors · Organizations · Search Program · My Schedule · Happening Now · Maps

This content is available for: Workshop Reg Pass. Upgrade Registration

Evaluating the Performance of One-Sided Communication on CPUs and GPUs

Session2023 International Workshop on Performance, Portability, and Productivity in HPC (P3HPC)

DescriptionAs high-performance GPU computing becomes the trend, GPU-initiated one-sided communication becomes a viable solution for multi-GPU scaling. It also raises attention to the use of one-sided communication on CPUs. However, the lack of deep understanding of one-sided communication performance and its impact on an application's performance becomes a hurdle. In this paper, we overcome this hurdle by proposing a Message Roofline model, which characterizes an application’s sustained messaging performance (GB/s) as a function of its message size, number of messages per synchronization, peak network bandwidth, and network latency. We use three benchmarks to demonstrate the potentials of one-sided communication on CPUs and GPUs. These benchmarks include Stencils, Sparse Triangular Solve and Distributed HashTable. Our evaluation provides insights into practically understanding the two-sided and one-sided communications in MPI applications, and can also guide hardware vendors with design principles lest the potential performance of one-sided communications being under-utilized.

Author/Presenters