Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
Invited Talk: I/O Profiling and Benchmarking for AI Applications
DescriptionTraining artificial intelligence (AI) models involves repeatedly loading large amounts of datasets. Data loading and transferring can potentially become one of the bottlenecks. AI training has different Input/Output (I/O) patterns compared with traditional scientific simulations. It is read intensive, involving heavy metadata operations, complex data formats, random access patterns, multithreading asynchronous I/O, etc. It is crucial to capture the I/O behavior and understand the requirement of storage and I/O in these workloads. In this talk, we will present our efforts in developing profiling tools and benchmark suites to address the need. Our study shines light on how to better design storage hardware and I/O software to support AI workloads.
Event Type
Workshop
TimeSunday, 12 November 20233:50pm - 4:14pm MST
Location704-706
Accelerators
Codesign
Heterogeneous Computing
Task Parallelism
W