The Design of an Efficient Lossy Compressor for Time Series Databases

doi:10.1145/3767158

CSpace

	The Design of an Efficient Lossy Compressor for Time Series Databases
	Zou, Xiangyu 1; Wang, Shihao 1; Shi, Yang 1; Chen, Xinyu 2; Jin, Sian 3; Tao, Dingwen 4; Xia, Wen 1,5
	2025-12-01
发表期刊	ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION
ISSN	1544-3566
卷号	22 期号:4 页码:27
摘要	Time-series databases (denoted as TSDB), which are designed for handling rapidly growing time-series data, usually apply compression techniques to reduce storage overhead. However, existing compressors are limited in key metrics for TSDB compression, such as compression ratio or decompression speed, primarily due to a mismatch between their design and the features specific to TSDB. To this end, we propose a lossy compressor Machete. It achieves a much higher compression ratio and fast decompression speed, while promising a user-specific and point-wise error bound to preserve the analytical value of the data. First, Machete proposes a pattern-based predictor and an efficient hybrid encoder to monitor data trends, which successfully achieve higher compression rates through better understanding of the data. Second, Machete proposes a SIMD-based decompression acceleration technique, which exploits the repeatedly intermediate calculations in decompression and shares them in decompression iterations through parallelism.Our evaluation on four real-world datasets shows that Machete outperforms state-of-the-art compressors by 69%-114% on compression ratio and achieves the fastest decompression speed on two datasets. When applied to a well-known time series database InfluxDB, Machete saves disk usage 40%-72% and improves the query performance of the InfluxDB database by saving I/O.
关键词	IoT database time-series data lossy compression
DOI	10.1145/3767158
收录类别	SCI
语种	英语
WOS研究方向	Computer Science
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods
WOS记录号	WOS:001667658800009
出版者	ASSOC COMPUTING MACHINERY
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/42840
专题	中国科学院计算技术研究所
通讯作者	Xia, Wen
作者单位	1.Harbin Inst Technol Shenzhen, Inst Cyberspace Secur, Shenzhen, Peoples R China 2.Washington State Univ, Pullman, WA 99164 USA 3.Temple Univ, Philadelphia, PA USA 4.Chinese Acad Sci, Inst Comp Technol, State Key Lab Processors, Beijing 100190, Peoples R China 5.Pengcheng Lab, Shenzhen, Peoples R China
推荐引用方式 GB/T 7714	Zou, Xiangyu,Wang, Shihao,Shi, Yang,et al. The Design of an Efficient Lossy Compressor for Time Series Databases[J]. ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION,2025,22(4):27.
APA	Zou, Xiangyu.,Wang, Shihao.,Shi, Yang.,Chen, Xinyu.,Jin, Sian.,...&Xia, Wen.(2025).The Design of an Efficient Lossy Compressor for Time Series Databases.ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION,22(4),27.
MLA	Zou, Xiangyu,et al."The Design of an Efficient Lossy Compressor for Time Series Databases".ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION 22.4(2025):27.