UM
Residential Collegefalse
Status已發表Published
TICC: Transparent Inter-Column Compression for Column-Oriented Database Systems
Liu, Hao; Ji, Yudian; Xiao, Jiang; Tan, Haoyu; Luo, Qiong; Ni, Lionel M.; Assoc Comp Machinery
2017
Conference NameCIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT
Pages2171-2174
Conference DateNOV 06-10, 2017
Conference PlaceSingapore, SINGAPORE
Publication Place1515 BROADWAY, NEW YORK, NY 10036-9998 USA
PublisherASSOC COMPUTING MACHINERY
Abstract

In this paper, we present TICC, an automatic data compression component that can transparently eliminate data redundancies across columns in column-oriented database systems. We further propose two approaches to integrate inter-column compression into existing database systems. One approach is to use User Defined Functions (UDFs), and the other is native. We implement these two approaches on top of Hive based on the ORC file, a common data format in column stores, and evaluate the performance of TICC using real-world datasets. The experimental results demonstrate that TICC can significantly reduce the storage overhead and process a variety of queries over large-scale data with up to 20% performance improvement over the original Hive.

KeywordData Compression Cross-column Redundancy Column Store
DOI10.1145/3132847.3133077
URLView the original
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Information Systems ; Computer Science, Theory & Methods
WOS IDWOS:000440845300246
The Source to ArticleWOS
Scopus ID2-s2.0-85037365433
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionUniversity of Macau
Recommended Citation
GB/T 7714
Liu, Hao,Ji, Yudian,Xiao, Jiang,et al. TICC: Transparent Inter-Column Compression for Column-Oriented Database Systems[C], 1515 BROADWAY, NEW YORK, NY 10036-9998 USA:ASSOC COMPUTING MACHINERY, 2017, 2171-2174.
APA Liu, Hao., Ji, Yudian., Xiao, Jiang., Tan, Haoyu., Luo, Qiong., Ni, Lionel M.., & Assoc Comp Machinery (2017). TICC: Transparent Inter-Column Compression for Column-Oriented Database Systems. , 2171-2174.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liu, Hao]'s Articles
[Ji, Yudian]'s Articles
[Xiao, Jiang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liu, Hao]'s Articles
[Ji, Yudian]'s Articles
[Xiao, Jiang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liu, Hao]'s Articles
[Ji, Yudian]'s Articles
[Xiao, Jiang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.