A deep q-learning-based optimization of the inventory control in a linear process chain

Abstract

Due to growing globalized markets and the resulting globalization of production networks across different companies, inventory and order optimization is becoming increasingly important in the context of process chains. Thus, an adaptive and continuously self-optimizing inventory control on a global level is necessary to overcome the resulting challenges. Advances in sensor and communication technology allow companies to realize a global data exchange to achieve a holistic inventory control. Based on deep q-learning, a method for a self-optimizing inventory control is developed. Here, the decision process is based on an artificial neural network. Its input is modeled as a state vector that describes the current stocks and orders within the process chain. The output represents a control vector that controls orders for each individual station. Furthermore, a reward function, which is based on the resulting storage and late order costs, is implemented for simulations-based decision optimization. One of the main challenges of implementing deep q-learning is the hyperparameter optimization for the training process, which is investigated in this paper. The results show a significant sensitivity for the leaning rate α and the exploration rate ε. Based on optimized hyperparameters, the potential of the developed methodology could be shown by significantly reducing the total costs compared to the initial state and by achieving stable control behavior for a process chain containing up to 10 stations.

Optimizing Supply Chain Management Through BO-CNN-LSTM for Demand Forecasting and Inventory Management

“…The application of reinforcement learning methods in supply chain management mainly focuses on optimizing decision-making problems, such as inventory management, logistics scheduling and pricing strategies. Mainly include Markov decision process (MDP) (Oroojlooyjadid, 2022), Q-learning and policy gradient methods (Dittrich, 2021). Markov Decision Process (MDP) is a framework for modeling supply chain management problems in which the state of the system changes over time and the decision maker selects an action based on the current state and receives a reward or cost based on the action.…”

Diverse Effective Relationship Exploration for Cooperative Multi-Agent Reinforcement Learning

“…One of the key challenges in this field is the implementation of Due to the generalization and applicability of reinforcement learning algorithms, they are increasingly being applied to inventory management problems. Examples include Deep Q-Network (DQN) [50], QMIX [51], QTRAN [52], IPPO and MAPPO [53], and CD-PPO [54]. These RL algorithms demonstrate promising capabilities for addressing inventory management challenges and may provide performance improvement and better adaptability.…”

Inteligência artificial aplicada a sistemas ERP: uma revisão sistemática da literatura

“…Um Q-learning profundo foi desenvolvido por[Dittrich and Fohlmeister 2021], que utilizou como base um método para um controle de estoque auto otimizado. Neste método, o processo de decisão é baseado em uma rede neural artificial.…”