Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
Toward Collaborative Continuous Benchmarking for HPC
DescriptionBenchmarking is integral to procurement of HPC systems, communicating HPC center workloads to HPC vendors, and verifying performance of the delivered HPC systems. Currently, HPC bench- marking is manual and challenging at every step, posing a high barrier to entry, and hampering reproducibility of the benchmarks across different HPC systems. We propose collaborative continuous benchmarking to enable functional reproducibility, automation, and community collaboration in HPC benchmarking. We define the minimal requirements for collaborative continuous benchmarking and develop a common language to streamline the interactions between HPC centers, vendors, and researchers. We demonstrate the initial implementation of collaborative continuous benchmarking, and introduce an open source continuous bench-marking repository, Benchpark, for community collaboration. We believe collaborative continuous benchmarking will help overcome the human bottleneck in HPC benchmarking, enabling better evaluation of our systems and enabling a more productive collaboration within the HPC community.
Author/Presenters
Event Type
Workshop
TimeFriday, 17 November 202310:55am - 11:20am MST
Location503-504
Applications
Exascale
Heterogeneous Computing
Programming Frameworks and System Software
State of the Practice
W