Basic concepts of entropy, order, organization, information, knowledge, and meaning

Shterenberg, M. I.

doi:10.3103/s0147688213030039

Cited by 4 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One rather technical point is that physical entropy is an extensive property: that is to say crudely that if an amount of substance has a certain entropy, then twice as much substance will have twice as much entropy. Although this seems sensible for the physical quantity, it does not seem intuitively sensible to suggest that the larger amount of material is “twice as disordered.” To deal with this problem, and the fact that entropy is not always additive, a variety of “extended entropies,” most notably those of Lansberg, Tsallis, Renyi, and Vedral, have been developed, which characterize disorder in somewhat different ways (Davison & Shiner, ); Shterenberg similarly considers new formulations of the entropy concept to relate to ideas of order, orderliness, and organization (), whereas Schneider and Sagan () note such proliferations as metric, topological, algorithmic, and Galois entropies.…”

Section: Entropy and Order; Oddities Paradoxes And New Viewsmentioning

confidence: 99%

“A few exciting words”: Information and entropy revisited

Bawden

Robinson

2015

Asso for Info Science & Tech

View full text Add to dashboard Cite

This is the accepted version of the paper.This version of the publication may differ from the final published version. Permanent repository link AbstractA review is presented of the relation between information and entropy, focusing on two main issues: the similarity of the formal definitions of physical entropy, according to statistical mechanics, and of information, according to information theory; and the possible subjectivity of entropy considered as missing information. The paper updates the 1983 analysis of Shaw and Davis. The difference in the interpretations of information given respectively by Shannon and by Wiener, significant for the information sciences, receives particular consideration.Analysis of a range of material, from literary theory to thermodynamics, is used to draw out the issues. Emphasis is placed on recourse to the original sources, and on direct quotation, to attempt to overcome some of the misunderstandings and oversimplifications which have occurred with these topics.While it is strongly related to entropy, information is neither identical with it, nor its opposite. Information is related to order and pattern, but also to disorder and randomness. The relations between information and the 'interesting complexity', which embodies both pattern and randomness, are worthy of attention."A few exciting words": information and entropy revisited THOMASINA: When you stir your rice pudding, Septimus, the spoonful of jam spreads itself round making red trails like the picture of the meteor in my astronomical atlas. But if need stir backward, the jam will not come together again. Indeed, the pudding does not notice and continues to turn pink just as before. Do you think this odd? SEPTIMUS: No THOMASINA: Well, I do. You cannot stir things apart. SEPTIMUS: No more you can, time must needs run backward, and since it will not, we must stir our way onward mixing as we go, disorder out of disorder into disorder until pink is complete, unchanging and unchangeable, and we are done with it forever. This is known as free will or self-determination. Tom Stoppard, Arcadia, (Act 1, Scene 1), London: Faber and Faber, 1993 If information is pattern, the non-information should be the absence of pattern, that is, randomness. This commonsense expectation ran into unexpected complications when certain developments within information theory implied that information could be equated with randomness as well as with pattern. Identifying information with both pattern and randomness proved to be a powerful paradox (Hayles 1999, p. 25) IntroductionThis paper re-examines the relations between information and entropy, a topic of debate for nearly a century. It can be seen as updating, thirty years on, of the analysis of Shaw and Davis (1983), presenting new findings and new perspectives. In order to make proper sense of these, it is necessary to delve into the historical development of the issues. Where possible, we have used quotations from original sources, as this is an area where there has been much misunderstanding ...

show abstract

Section: Entropy and Order; Oddities Paradoxes And New Viewsmentioning

confidence: 99%

“A few exciting words”: Information and entropy revisited

Bawden

Robinson

2015

Asso for Info Science & Tech

View full text Add to dashboard Cite

show abstract

Research and analysis of threshold segmentation algorithms in image processing

Niu

2019

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Image segmentation is one of the most difficult and important tasks in digital image processing. The accuracy and effect of segmentation determine the final success or failure of the calculation and analysis process. Therefore, analysis and improvement on basic image segmentation algorithms should be paid attention to in a quite wide range of applications. This paper mainly introduces and studies the principle and characteristics of threshold segmentation algorithm, and analyses the application scenarios of global threshold segmentation and adaptive local threshold segmentation related algorithms, which has certain reference significance for digital image processing related research.

show abstract

Understanding synergistics and systemic programs of evolution

Shterenberg

2014

Autom. Doc. Math. Linguist.

View full text Add to dashboard Cite

Basic concepts of entropy, order, organization, information, knowledge, and meaning

Cited by 4 publications

References 4 publications

“A few exciting words”: Information and entropy revisited

“A few exciting words”: Information and entropy revisited

Research and analysis of threshold segmentation algorithms in image processing

Understanding synergistics and systemic programs of evolution

Contact Info

Product

Resources

About