Dynamic Bicycle Dispatching of Dockless Public Bicycle-sharing Systems Using Multi-objective Reinforcement Learning

Abstract

As a new generation of Public Bicycle-sharing Systems (PBS), the Dockless PBS (DL-PBS) is an important application of cyber-physical systems and intelligent transportation. How to use artificial intelligence to provide efficient bicycle dispatching solutions based on dynamic bicycle rental demand is an essential issue for DL-PBS. In this article, we propose MORL-BD, a dynamic bicycle dispatching algorithm based on multi-objective reinforcement learning to provide the optimal bicycle dispatching solution for DL-PBS. We model the DL-PBS system from the perspective of cyber-physical systems and use deep learning to predict the layout of bicycle parking spots and the dynamic demand of bicycle dispatching. We define the multi-route bicycle dispatching problem as a multi-objective optimization problem by considering the optimization objectives of dispatching costs, dispatch truck's initial load, workload balance among the trucks, and the dynamic balance of bicycle supply and demand. On this basis, the collaborative multi-route bicycle dispatching problem among multiple dispatch trucks is modeled as a multi-agent and multi-objective reinforcement learning model. All dispatch paths between parking spots are defined as state spaces, and the reciprocal of dispatching costs is defined as a reward. Each dispatch truck is equipped with an agent to learn the optimal dispatch path in the dynamic DL-PBS network. We create an elite list to store the Pareto optimal solutions of bicycle dispatch paths found in each action, and finally get the Pareto frontier. Experimental results on the actual DL-PBS show that compared with existing methods, MORL-BD can find a higher quality Pareto frontier with less execution time.

Prefix-Pruning-Based Distributed Frequent Trajectory Pattern Mining Algorithm

“…can be inferred. One can also obtain the user's movement route between location nodes, and further combine the actual route or semantic information to roughly infer the user's travel mode and road section conditions, which is of great help to traffic management and route inference [16][17][18][19][20][21]. Next, we conducted experiments on algorithm efficiency, distributed speedup, and algorithm scalability.…”

Influence Factors of Bike-Sharing System and Sustainable Strategies: A Case Study in Jersey City, USA

“…Numerous studies have demonstrated distinct spatial clustering patterns within bike-sharing systems, primarily concentrated in high-traffic zones such as commercial districts and transportation hubs [2]. Moreover, research has highlighted issues of resource oversupply in some areas while others grapple with shortages, underscoring the uneven distribution and utilization efficiency stemming from the large-scale deployment of bike-sharing systems [3]. Such disparities can result in overcrowding and resource wastage, necessitating more precise management and planning strategies.…”

Multilayer Deep Deterministic Policy Gradient for Static Safety and Stability Analysis of Novel Power Systems

“…An increasing number of sensors have been installed in novel power systems [6]. Tese sensors bring a huge amount of data to the dispatch center [7]. Te current methods of data processing are still far from adequate to fully utilize the data that the dispatch center can receive.…”