In this review, we establish a relation between information erasure and continuous phase transitions. The order parameter, which characterizes these transitions, measures the order of the systems. It varies between 0, when the system is completely disordered, and 1, when the system is completely ordered. This ordering process can be seen as information erasure by resetting a certain number of bits to a standard value. The thermodynamic entropy in the partially ordered phase is given by the information-theoretic expression for the generalized Landauer bound in terms of error probability. We will demonstrate this for the Hopfield neural network model of associative memory, where the Landauer bound sets a lower limit for the work associated with ‘remembering’ rather than ‘forgetting’. Using the relation between the Landauer bound and continuous phase transition, we will be able to extend the bound to analog computing systems. In the case of the erasure of an analog variable, the entropy production per degree of freedom is given by the logarithm of the configurational volume measured in units of its minimal quantum.