“…Clearly, the set of dynamic game environments is very large; however, there are some patterns in the literature. For example, Battaglini, Nunnari, and Palfrey (), Battaglini, Nunnari, and Palfrey (), Vespa (forthcoming), and Salz and Vespa (forthcoming) study well‐known dynamic games with relatively large state‐spaces and find that equilibrium Markov strategies approximate behavior well . In contrast, the literature on the infinitely repeated prisoner's dilemma has characterized the conditions under which history‐dependent play is likely to prevail.…”