“…In this paper, we model blood inventory as a Markov decision process -MDP. MDPs are designed for sequential decision making under uncertainty (Puterman, 2014), hence their frequent use in medical applications (e.g., Andersen et al, 2019;Arruda et al, 2019;Steimle and Denton, 2017;Bennett and Hauser, 2013;Alagoz et al, 2010) and in blood inventory problems (e.g., Attari et al, 2019b;Hosseinifard et al, 2019). The use of an MDP ensures more flexibility as it allows an optimal decision for each available state, while also ensuring optimality in the long run.…”