First second- and third-order entropies of Arabic text (Corresp.)

Wanas, M. A.; Zayed, Ahmed E.; Shaker, Marwan; Taha, Ekhlass M.

doi:10.1109/tit.1976.1055498

Cited by 14 publications

(6 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Both joint entropy per character and conditional entropy show a downward trend with increased number of orders. 1 st -3 rd order entropies are more than that of English text [14], this should be because of more number and type of characters that Thai text contains.…”

Section: Criteria For the Performance Comparisonmentioning

confidence: 93%

Entropy rate of Thai text and testing author authenticity using character combination distribution

Kiatdarakun

Suksompong

2012

2012 Second International Conference on Digital Information and Communication Technology and It's Applications (DICTAP)

View full text Add to dashboard Cite

This paper has two main goals. The first goal is to estimate the entropy rate of Thai text which is found to be roughly 2 bits/character. The second goal is to come up with methods for text authentication based on probability distribution and information theoretic quantities. Using proposed methods, we found that digital books composed by the same author give close numerical values, while those from different authors give much higher differences. Among the three techniques under consideration, we found that the entropy-based method provides the best test. Thirty Thai text sources of various styles are tested to increase reliability of the study. Additionally, the comparison of the effectiveness of proposed methods is shown here.

show abstract

Section: Criteria For the Performance Comparisonmentioning

confidence: 93%

Entropy rate of Thai text and testing author authenticity using character combination distribution

Kiatdarakun

Suksompong

2012

2012 Second International Conference on Digital Information and Communication Technology and It's Applications (DICTAP)

View full text Add to dashboard Cite

show abstract

“…After that, many other papers used Shannon's method to calculate the entropy of English on different passages and context lengths [19][20][21][22]. Other papers use Shannon's technique to measure the entropy of other languages [23][24][25][26][27]. Shannon's method was modified by Cover and King [28] who asked their subjects to gamble on the next character.…”

Section: Related Workmentioning

confidence: 99%

Humans Outperform Machines at the Bilingual Shannon Game

Ghazvininejad¹,

Knight²

2016

Entropy

View full text Add to dashboard Cite

show abstract

“…Kontoyiannis reported a value of 1.77 bits per character using a method based on string matching, resembling that of universal coding based on a one milloin character sample from a same author [5]. In Arabic language, Wanas et al calculated the first, second, and third order entropies of written Arabic text [6]. In Telugu, P.Balasubrahmanyam et al constructed an optimum code for the Telugu alphabet and estimates of one gram entropies of the different forms of prose writings were also obtained [7].…”

Section: Introductionmentioning

confidence: 99%

Entropy of Malayalam language and text compression using Huffman coding

Kuruvila

Gopinath

2014

2014 First International Conference on Computational Systems and Communications (ICCSC)

View full text Add to dashboard Cite

Entropy is a statistical parameter which measures how much information is produced on the average for each letter of a text in the language. Every language normally has certain hidden statistically significant features and certain redundancy. These features can be utilized to form a suitable text compression tool for the optimum use of resources. Being motivated by the language studies of English and other languages based on Shannon theory, an informational analysis of Malayalam language text is done in this paper. Entropy of Malayalam language is calculated and is obtained as 4.8 bits per character. The Malayalam text compressor discussed in this paper, follows Huffman coding technique which takes both Malayalam and English alphabets along with arithmetic numbers and most probable character is represented by less number of bits. It is found that the Huffman compression algorithm achieves a compression ratio of 66 percentage for a standard Malayalam database taken. A comparison is made on compression ratio for different databases taken.

show abstract

First second- and third-order entropies of Arabic text (Corresp.)

Cited by 14 publications

References 1 publication

Entropy rate of Thai text and testing author authenticity using character combination distribution

Entropy rate of Thai text and testing author authenticity using character combination distribution

Humans Outperform Machines at the Bilingual Shannon Game

Entropy of Malayalam language and text compression using Huffman coding

Contact Info

Product

Resources

About