Authors
Kai Zhao, Sheng Di, Maxim Dmitriev, Thierry-Laurent D Tonellot, Zizhong Chen, Franck Cappello
Publication date
2021/4/19
Conference
2021 IEEE 37th International Conference on Data Engineering (ICDE)
Pages
1643-1654
Publisher
IEEE
Description
Today's scientific simulations are producing vast volumes of data that cannot be stored and transferred efficiently because of limited storage capacity, parallel I/O bandwidth, and network bandwidth. The situation is getting worse over time because of the ever-increasing gap between relatively slow data transfer speed and fast-growing computation power in modern supercomputers. Error-bounded lossy compression is becoming one of the most critical techniques for resolving the big scientific data issue, in that it can significantly reduce the scientific data volume while guaranteeing that the reconstructed data is valid for users because of its compression-error-bounding feature. In this paper, we present a novel error-bounded lossy compressor based on a state-of-the-art prediction-based compression framework. Our solution exhibits substantially better compression quality than all of the existing error-bounded lossy …
Total citations
2020202120222023202416215528
Scholar articles
K Zhao, S Di, M Dmitriev, TLD Tonellot, Z Chen… - 2021 IEEE 37th International Conference on Data …, 2021