“…Our decision model is a marked temporal point process (MTPP) (Aalen et al, 2008), which is a natural tool to model discrete events in continuous time. It has been widely applied and become increasingly popular in various domains, including social science (Butts and Marcum, 2017), medical analytics (Liu et al, 2018), finance (Hawkes, 2018), and stochastic optimal control (Tabibian et al, 2019). In our example application of Section 1.1, each follow-up visitation is an event: the visitation time is assumed to be stochastically scheduled according to the probability distribution characterized by the proposed MTPP; and the assigned tacrolimus dosage, when the visitation happens, is treated as the corresponding "mark.…”