“…), and medicine (diagnosing patients, sequencing treatments, etc.). An illustrative list of references for such applications includes [69,72,79,84,98,126,166,220,240,241,252,307,348,354,392,396,421,427]. Sequential decision making is an old subject, but one that has become increasingly important with the need for new models and algorithms as the traditional methods for making decisions sequentially do not scale.…”