JSW 2013 Vol.8(5): 1086-1093 ISSN: 1796-217X
doi: 10.4304/jsw.8.5.1086-1093
doi: 10.4304/jsw.8.5.1086-1093
The Key as Dictionary Compression Method of Inverted Index Table under the Hbase Database
Pengsen Cheng, Junxiu An
Chengdu University of Information Technology, Chengdu, P.R.China
Abstract—Starting with Hbase's own characteristics, this paper designs an inverted index table which includes key word, document ID and position list, and the table can saves a lot of storage space. After then, on the basis of the table, the paper provides key as dictionary compression with high compression ratio and high decompression rate for the data block. At last, this paper tests the effectiveness of the compression method by comparing it with Lzo and Gzip which supported by Hbase.
Index Terms—Hbase, inverted index table, key as dictionary compression.
Abstract—Starting with Hbase's own characteristics, this paper designs an inverted index table which includes key word, document ID and position list, and the table can saves a lot of storage space. After then, on the basis of the table, the paper provides key as dictionary compression with high compression ratio and high decompression rate for the data block. At last, this paper tests the effectiveness of the compression method by comparing it with Lzo and Gzip which supported by Hbase.
Index Terms—Hbase, inverted index table, key as dictionary compression.
Cite: Pengsen Cheng, Junxiu An, "The Key as Dictionary Compression Method of Inverted Index Table under the Hbase Database," Journal of Software vol. 8, no. 5, pp. 1086-1093, 2013.
General Information
ISSN: 1796-217X (Online)
Frequency: Quarterly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, CNKI, Google Scholar, ProQuest, INSPEC(IET), ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsweditorialoffice@gmail.com
-
Mar 01, 2024 News!
Vol 19, No 1 has been published with online version [Click]
-
Apr 26, 2021 News!
Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec) [Click]
-
Nov 18, 2021 News!
Papers published in JSW Vol 16, No 1- Vol 16, No 6 have been indexed by DBLP [Click]
-
Jan 04, 2024 News!
JSW will adopt Article-by-Article Work Flow
-
Nov 02, 2023 News!
Vol 18, No 4 has been published with online version [Click]