Residential College | false |
Status | 已發表Published |
TICC: Transparent inter-column compression for column-oriented database systems | |
Liu, Hao1; Ji, Yudian1; Xiao, Jiang2,4; Tan, Haoyu1; Luo, Qiong1; Ni, Lionel M.3 | |
2017-11-06 | |
Conference Name | 26th ACM International Conference on Information and Knowledge Management, CIKM 2017 |
Source Publication | International Conference on Information and Knowledge Management, Proceedings |
Volume | Part F131841 |
Pages | 2171-2174 |
Conference Date | 11 6, 2017 - 11 10, 2017 |
Conference Place | Singapore, Singapore |
Author of Source | Association for Computing Machinery |
Abstract | In this paper, we present TICC, an automatic data compression component that can transparently eliminate data redundancies across columns in column-oriented database systems. We further propose two approaches to integrate inter-column compression into existing database systems. One approach is to use User Defined Functions (UDFs), and the other is native. We implement these two approaches on top of Hive based on the ORC file, a common data format in column stores, and evaluate the performance of TICC using real-world datasets. The experimental results demonstrate that TICC can significantly reduce the storage overhead and process a variety of queries over large-scale data with up to 20% performance improvement over the original Hive. © 2017 Association for Computing Machinery. |
DOI | 10.1145/3132847.3133077 |
Language | 英語English |
WOS ID | WOS:000440845300246 |
Scopus ID | 2-s2.0-85037365433 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | University of Macau |
Affiliation | 1.Department of Computer Science and Engineering, HKUST, Hong Kong; 2.Huazhong University of Science and Technology, China; 3.University of Macau, China; 4.Services Computing Technology and System Lab and Cluster and Grid Computing Lab, School of Computer Science and Technology, China |
Recommended Citation GB/T 7714 | Liu, Hao,Ji, Yudian,Xiao, Jiang,et al. TICC: Transparent inter-column compression for column-oriented database systems[C]. Association for Computing Machinery, 2017, 2171-2174. |
APA | Liu, Hao., Ji, Yudian., Xiao, Jiang., Tan, Haoyu., Luo, Qiong., & Ni, Lionel M. (2017). TICC: Transparent inter-column compression for column-oriented database systems. International Conference on Information and Knowledge Management, Proceedings, Part F131841, 2171-2174. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment