A new compression algorithm for fast text search

Carus, Aydin; Mesut, Altan

doi:10.3906/elk-1407-178

Cited by 3 publications

(2 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Carus and Mesut created a compression algorithm that uses a semistatic model and a dictionary that contains the most frequently used trigrams [14]. The main dictionary consists of several subdictionaries that contain the most frequently used trigrams after a particular digram.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

A new word-based compression model allowing compressed pattern matching

Buluş¹,

Carus²,

Mesut³

2017

Turk J Elec Eng & Comp Sci

Self Cite

View full text Add to dashboard Cite

Abstract:In this study a new semistatic data compression model that has a fast coding process and that allows compressed pattern matching is introduced. The name of the proposed model is chosen as tagged word-based compression algorithm (TWBCA) since it has a word-based coding and word-based compressed matching algorithm. The model has two phases. In the first phase a dictionary is constructed by adding a phrase, paying attention to word boundaries, and in the second phase compression is done by using codewords of phrases in this dictionary. The first byte of the codeword determines whether the word is compressed or not. By paying attention to this rule, the CPM process can be conducted as word based. In addition, the proposed method makes it possible to also search for the group of consecutively compressed words. Any of the previous pattern matching algorithms can be chosen to use in compressed pattern matching as a black box. The duration of the CPM process is always less than the duration of the same process on the texts coded by Gzip tool. While matching longer patterns, compressed pattern matching takes more time on the texts coded by compress and end-tagged dense code (ETDC). However, searching shorter patterns takes less time on texts coded by our approach than the texts compressed with compress. Besides this, the compression ratio of our algorithm has a better performance against ETDC only on a file that has been written in Turkish. The compression performance of TWBCA is stable and does not vary over 6% on different text files.

show abstract

Section: Related Workmentioning

confidence: 99%

“…While some works [7][8][9] deal with the problem of CPM over known compression algorithms, some other studies [10][11][12][13][14][15][16][17] present a new compression algorithm that is suitable for CPM.…”

Section: Related Workmentioning

confidence: 99%