Presentation
Sign in to view this presentation
[ll_login_link linktext="sign in"]
Exploiting User Activeness for Data Retention in HPC Systems
DescriptionHPC systems typically rely on the fixed-lifetime (FLT) data retention strategy, which only considers temporal locality of data accesses to parallel file systems. Our extensive analysis based on the leadership-class HPC system traces, however, suggests that the FLT approach often fails to capture the dynamics in users' behavior and leads to undesired data purge. In this study, we propose an activeness-based data retention (ActiveDR) solution, which advocates considering the data retention approach from a holistic activeness-based perspective. By evaluating the frequency and impact of users' activities, ActiveDR prioritizes the file purge process for inactive users and rewards active users with extended file lifetime on parallel storage. Our extensive evaluations based on the traces of the prior Titan supercomputer show that, when reaching the same purge target, ActiveDR achieves up to 37% file miss reduction as compared to the current FLT retention methodology.
Event Type
Paper
TimeThu, 18 Nov3:30pm - 4pm CST
Location240-241-242
Applications
Big Data
Datacenter
File Systems and I/O
Machine Learning and Artificial Intelligence
State of the Practice
Storage
TP
Download PDF
Archive view
