UM
Residential Collegefalse
Status已發表Published
TICC: Transparent inter-column compression for column-oriented database systems
Liu, Hao1; Ji, Yudian1; Xiao, Jiang2,4; Tan, Haoyu1; Luo, Qiong1; Ni, Lionel M.3
2017-11-06
Conference Name26th ACM International Conference on Information and Knowledge Management, CIKM 2017
Source PublicationInternational Conference on Information and Knowledge Management, Proceedings
VolumePart F131841
Pages2171-2174
Conference Date11 6, 2017 - 11 10, 2017
Conference PlaceSingapore, Singapore
Author of SourceAssociation for Computing Machinery
Abstract

In this paper, we present TICC, an automatic data compression component that can transparently eliminate data redundancies across columns in column-oriented database systems. We further propose two approaches to integrate inter-column compression into existing database systems. One approach is to use User Defined Functions (UDFs), and the other is native. We implement these two approaches on top of Hive based on the ORC file, a common data format in column stores, and evaluate the performance of TICC using real-world datasets. The experimental results demonstrate that TICC can significantly reduce the storage overhead and process a variety of queries over large-scale data with up to 20% performance improvement over the original Hive. © 2017 Association for Computing Machinery.

DOI10.1145/3132847.3133077
Language英語English
WOS IDWOS:000440845300246
Scopus ID2-s2.0-85037365433
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionUniversity of Macau
Affiliation1.Department of Computer Science and Engineering, HKUST, Hong Kong;
2.Huazhong University of Science and Technology, China;
3.University of Macau, China;
4.Services Computing Technology and System Lab and Cluster and Grid Computing Lab, School of Computer Science and Technology, China
Recommended Citation
GB/T 7714
Liu, Hao,Ji, Yudian,Xiao, Jiang,et al. TICC: Transparent inter-column compression for column-oriented database systems[C]. Association for Computing Machinery, 2017, 2171-2174.
APA Liu, Hao., Ji, Yudian., Xiao, Jiang., Tan, Haoyu., Luo, Qiong., & Ni, Lionel M. (2017). TICC: Transparent inter-column compression for column-oriented database systems. International Conference on Information and Knowledge Management, Proceedings, Part F131841, 2171-2174.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liu, Hao]'s Articles
[Ji, Yudian]'s Articles
[Xiao, Jiang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liu, Hao]'s Articles
[Ji, Yudian]'s Articles
[Xiao, Jiang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liu, Hao]'s Articles
[Ji, Yudian]'s Articles
[Xiao, Jiang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.