No abstract

Dynamic pricing plays an important role in solving the problems such as traffic load reduction, congestion control, and revenue improvement. Efficient dynamic pricing strategies can increase capacity utilization, total revenue of service providers, and the satisfaction of both passengers and drivers. Many proposed dynamic pricing technologies focus on short-term optimization and face poor scalability in modeling long-term goals for the limitations of solution optimality and prohibitive computation. In this article, a deep reinforcement learning framework is proposed to tackle the dynamic pricing problem for ride-hailing platforms. A soft actor-critic (SAC) algorithm is adopted in the reinforcement learning framework. First, the dynamic pricing problem is translated into a Markov Decision Process (MDP) and is set up in continuous action spaces, which is no need for the discretization of action space. Then, a new reward function is obtained by the order response rate and the KL-divergence between supply distribution and demand distribution. Experiments and case studies demonstrate that the proposed method outperforms the baselines in terms of order response rate and total revenue.

Traffic signal control is a significant part of the construction of intelligent transportation. An efficient traffic signal control strategy can reduce traffic congestion, improve urban road traffic efficiency and facilitate people's lives. Existing reinforcement learning approaches for traffic signal control mainly focus on learning through a separate neural network. Such an independent neural network may fall into the local optimum of the training results. Worse more, the collected data can only be sampled once, so the data utilization rate is low. Therefore, we propose the Random Ensemble Double DQN Light (RELight) model. It can dynamically learn traffic signal control strategies through reinforcement learning and combine random ensemble learning to avoid falling into the local optimum to reach the optimal strategy. Moreover, we introduce the Update-To-Data (UTD) ratio to control the number of data reuses to improve the problem of low data utilization. In addition, we have conducted sufficient experiments on synthetic data and real-world data to prove that our proposed method can achieve better traffic signal control effects than the existing optimal methods.

The detection of anomalies in spatiotemporal traffic data is not only critical for intelligent transportation systems and public safety but also very challenging. Anomalies in traffic data often exhibit complex forms in two aspects, (i) spatiotemporal complexity (i.e. we need to associate individual locations and time intervals formulating a panoramic view of an anomaly) and (ii) multi-source complexity (i.e. we need an algorithm that can model the anomaly degree of the multiple data sources of different densities, distributions and scales). To tackle these challenges, we proposed a three-step method that uses factor analysis to extract features, then uses the goodness-of-fit test to obtain the anomaly score of a single data point and then uses one class support vector machine to synthesize the anomaly score. Finally, we conduct extensive experiments on real-world trip data include taxi and bike data. And these extensive experiments demonstrate the effectiveness of our proposed approach.