Traffic signal control is of critical importance for the effective use of transportation infrastructures. The rapid increase of vehicle traffic and changes in traffic patterns make traffic signal control more and more challenging. Reinforcement Learning (RL)-based algorithms have demonstrated their potential in dealing with traffic signal control. However, most existing solutions require a large amount of training data, which is unacceptable for many real-world scenarios. This paper proposes a novel modelbased meta-reinforcement learning framework (ModelLight) for traffic signal control. Within ModelLight, an ensemble of models for road intersections and the optimization-based meta-learning method are used to improve the data efficiency of an RL-based traffic light control method. Experiments on real-world datasets demonstrate that ModelLight can outperform state-of-the-art traffic light control algorithms while substantially reducing the number of required interactions with the real-world environment.
Prophylactic anticoagulation is a standard strategy for patients undergoing total hip arthroplasty (THA) to prevent deep venous thromboembolism (DVT) and pulmonary embolism (PE). Nevertheless, some patients still experience these complications during their hospital stay. Current risk assessment methods like the Caprini and Geneva scores are not specifically designed for THA and may not accurately predict DVT or PE postoperatively. This study used machine learning techniques to establish models for early diagnosis of DVT and PE in patients undergoing THA. Data were collected from 1481 patients who received perioperative prophylactic anticoagulation. Model establishment and parameter tuning were performed using a training set and evaluated using a test set. Among the models, extreme gradient boosting (XGBoost) performed the best, with an area under the receiver operating characteristic curve (AUC) of 0.982, sensitivity of 0.913, and specificity of 0.998. The main features used in the XGBoost model were direct and indirect bilirubin, partial activation prothrombin time, prealbumin, creatinine, D-dimer, and C-reactive protein. Shapley Additive Explanations analysis was conducted to further analyze these features. This study presents a model for early diagnosis DVT or PE after THA and demonstrates bilirubin could be a potential predictor in the assessment of DVT or PE. Compared to traditional risk assessment, XGBoost has a high sensitivity and specificity to predict DVT and PE in the clinical setting. Furthermore, the results of this study were converted into a web calculator that can be used in clinical practice.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.