Optimal scheduling in cloud healthcare system using Q-learning algorithm

Abstract

Cloud healthcare system (CHS) can provide the telemedicine services, which is helpful to cope with the difficulty of patients getting medical service in the traditional medical systems. However, resource scheduling in CHS has to face with a great of challenges since managing the trade-off of efficiency and quality becomes complicated due to the uncertainty of patient choice behavior. Motivated by this, a resource scheduling problem with multi-stations queueing network in CHS is studied in this paper. A Markov decision model with uncertainty is developed to optimize the match process of patients and scarce resources with the objective of minimizing the total medical costs that consist of three conflicting sub-costs, i.e., medical costs, waiting time costs and the penalty costs caused by unmuting choice behavior of patients. For solving the proposed model, a three-stage dynamic scheduling method is designed, in which an improved Q-learning algorithm is employed to achieve the optimal schedule. Numerical experimental results show that this Q-learning-based scheduling algorithm outperforms two traditional scheduling algorithms significantly, as well as the balance of the three conflicting sub-costs is kept and the service efficiency is improved.

Machine Learning Based Healthcare Service Dissemination Using Social Internet of Things and Cloud Architecture in Smart Cities

“…The proposed framework maximizes the quality and feasibility range of services provided to the patients. Li et al [20] introduced a Q-learning algorithm-based optimal scheduling approach for cloud healthcare systems. Q-learning is mainly used here to solve optimization problems during the scheduling process.…”

Guest editorial on “data-driven operations management”

“…In the third paper, "DP-TABU: an algorithm to solve single-depot multi-line vehicle scheduling problem" [3], the authors considered the multi-line scheduling problem of single deport to unified dispatch of vehicles to execute the schedule of multiple routes with the objective of reducing the resources of public vehicles. They developed a DP-TABU algorithm to solve the problem, and applied this algorithm to the three lines S105, S107, and S159 of Zhengzhou Public Transport Corporation.…”

Optimized multi‐objective Q‐learning with enhanced beetle swarm optimization based scientific workflows scheduling on cloud computing environment

“…This technique has given better results compared to the other meta‐heuristic‐based scheduling techniques. Similarly, Li et al 25 developed a Q‐learning algorithm based on task scheduling on the cloud for health‐ care applications. A Markov decision model was developed to optimize the match process of patients and which has to effectively reduce the cost.…”