The partially observable Markov decision processes in healthcare: an application to patients with ischemic heart disease (IHD)

Vozikis, Athanassios; Goulionis, John E.; Benos, V. K.

doi:10.1007/s12351-010-0095-x

Cited by 3 publications

(2 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The authors used a hierarchical Bayesian belief network to denote the disease dynamics, and they exploited regularities and specificity of the problem domain to improve the computational performance of the POMDP model. Vozikis et al (2012) also considered an ischemic heart disease management problem using a POMDP model. The authors proposed a heuristic method to alleviate the computational obstacle of the POMDP model and tradeoff for speed.…”

Section: Pomdp-based Approachesmentioning

confidence: 99%

See 1 more Smart Citation

Optimization of active surveillance strategies for heterogeneous patients with prostate cancer

Zhang

Denton

Morgan

2022

Production and Operations Management

View full text Add to dashboard Cite

Prostate cancer (PCa) is common in American men with long latent periods, during which the disease is asymptomatic. Active surveillance is a monitoring strategy commonly used for patients diagnosed with low‐risk PCa who may harbor latent high‐risk PCa. The optimal monitoring strategy attempts to minimize the disutility of testing while ensuring that the patient is detected at the earliest time when the disease progresses. Unfortunately, guidelines for the active surveillance of PCa are often one‐size‐fits‐all strategies that ignore the heterogeneity among multiple patient types. In contrast, personalized strategies based on partially observable Markov decision process (POMDP) models are challenging to implement in practice given the large number of possible strategies that can be used. This article presents a two‐stage stochastic programming approach that selects a set of strategies for predefined cardinality based on patients' disease risks. The first‐stage decision variables include binary variables for the selection of periods at which to test patients in each strategy and the assignment of multiple patient types to strategies. The objective is to maximize a weighted reward function that considers the need for cancer detection, missed detection, and cost of monitoring patients. We discuss the structure and complexity of the model and reformulate a logic‐based Bender's decomposition formulation that can solve realistic instances to optimality. We present a case study for the active surveillance of PCa and show that our model results in strategies that vary in intensity according to patient disease risk. Finally, we show that our model can generate a small number of strategies that can significantly improve the existing “one‐size‐fits‐all” guideline strategies used in practice.

show abstract

Section: Pomdp-based Approachesmentioning

confidence: 99%

“…Vozikis et al. (2012) also considered an ischemic heart disease management problem using a POMDP model. The authors proposed a heuristic method to alleviate the computational obstacle of the POMDP model and trade‐off for speed.…”

Section: Literature Reviewmentioning

confidence: 99%