“…Given an SDES H, an MDP M can be constructed to show all the possible insertion functions or strategies in MDP's term [24] with the following assumption to guarantee that the resulting M has a finite state space. In our case, where the model is a PSDES P H = (Q, Σ, P, π 0 , V ), with Assumption 2 and 3, we could follow the same algorithm to obtain a PMDP M = (S,ŝ, A, T, V ).…”