Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
ADT-FSE: A New Encoder for SZ
SessionData Compression
DescriptionSZ is a lossy floating-point data compressor that excels in compression ratio and throughput for high-performance computing (HPC), time series databases, and deep learning applications. However, SZ performs poorly for small chunks and has slow decompression. We pinpoint the Huffman tree in the quantization factor encoder as the bottleneck of SZ. In this paper, we propose ADT-FSE, a new quantization factor encoder for SZ. Based on the Gaussian distribution of quantization factors, we design an adaptive data transcoding (ADT) scheme to map quantization factors to codes for better compressibility, and then use finite state entropy (FSE) to compress the codes. Experiments show that ADT-FSE improves the quantization factor compression ratio, compression and decompression throughput by up to 5x, 2x and 8x, respectively, over the original SZ Huffman encoder. On average, SZ_ADT is over 2x faster than ZFP in decompression.
Event Type
Paper
TimeWednesday, 15 November 202311:30am - 12pm MST
Location405-406-407
Accelerators
Data Analysis, Visualization, and Storage
Data Compression
TP
