Infodynamics, Information Entropy and the Second Law of Thermodynamics

Abstract

Information and Energy are related. The Second Law of Thermodynamics applies to changes in energy and heat, but it does not apply to information dynamics. Advances in Infodynamics have made it clear that Total Information contains Useful Information and Noise, both of which may be gained or lost in irreversible processes. Increases in Free Energy of open systems require more Useful Information, reducing or increasing Thermodynamic Entropy. Empirical data show that the more Free Energy is created, the more Useful Information is required; and the more Useful Information is produced the more Free Energy is spent. The Energy – Information relationship underlies all processes where novel structures, forms and systems emerge. Although science cannot predict the structure of information that will produce Free Energy, engineers have been successful in finding Useful Information that increases Free Energy. Here I explore the fate of information in irreversible processes and its relation with the Second Law of Thermodynamics.