We present a model of discrete-time mean-field game with compact state and action spaces and average reward. Under some strong ergodicity assumption, we show it possesses a stationary mean-field equilibrium. We present an example showing that in general an equilibrium for this game may not be a good approximation of Nash equilibria of the n-person stochastic game counterparts of the mean-field game for large n. Finally, we identify two cases when the approximation is good.

No abstract

Stationary anonymous sequential games with undiscounted rewards are a special class of games that combine features from both population games (infinitely many players) with stochastic games. We extend the theory for these games to the cases of total expected reward as well as to the expected average reward. We show that in the anonymous sequential game equilibria correspond to the limits of those of related finite population games as the number of players grows to infinity. We provide examples to illustrate our results.