Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
Embracing Irregular Parallelism in HPC with YGM
SessionMessage Passing Innovations
DescriptionYGM is a general-purpose asynchronous distributed computing library for C++/MPI, designed to handle the irregular data access patterns and small messages of graph algorithms and data science applications. It uses data serialization to give an easily usable active message interface and message aggregation to maximize application throughput. Our design philosophy makes a tradeoff that increases network bandwidth utilization at the cost of added latency. We provide a suite of benchmarks showcasing YGM’s performance. Compared to similar distributed active message benchmark implementations that do not provide message buffering, we are able to achieve over 10x throughput on thousands of cores at a latency cost that can be as small as 2x or as large as 100x, depending on the machine being used. For applications that can be written to be latency-tolerant, this represents a significant potential performance improvement through using YGM.
Event Type
Paper
TimeTuesday, 14 November 20234pm - 4:30pm MST
Location403-404
Distributed Computing
Message Passing
Programming Frameworks and System Software
TP