We develop a Thermodynamic Formalism for bounded continuous potentials defined on the sequence space X ≡ E N , where E is a general standard Borel space. In particular, we introduce meaningful concepts of entropy and pressure for shifts acting on X and obtain the existence of equilibrium states as finitely additive probability measures for any bounded continuous potential. Furthermore, we establish convexity and other structural properties of the set of equilibrium states, prove a version of the Perron-Frobenius-Ruelle theorem under additional assumptions on the regularity of the potential and show that the Yosida-Hewitt decomposition of these equilibrium states does not have a purely finite additive part.We then apply our results to the construction of invariant measures of timehomogeneous Markov chains taking values on a general Borel standard space and obtain exponential asymptotic stability for a class of Markov operators. We also construct conformal measures for an infinite collection of interacting random paths which are associated to a potential depending on infinitely many coordinates. Under an additional differentiability hypothesis, we show how this process is related after a proper scaling limit to a certain infinite-dimensional diffusion.2010 Mathematics Subject Classification. 37D35, 28Dxx.