Power Control for Cognitive Users of Perception Layer in Complex Industrial CPS Based on DQN

Abstract

Wireless communication is a significant auxiliary technology of data transmission for industrial Cyber-Physical system (CPS). While for the complex industrial scenario of coal mine with long and narrow laneway, lifetime of wireless perception nodes is a potential and nonnegligible problem for safety production. In order to deal with this problem, a power control algorithm based on deep Q network (DQN) is adopted to train micro base station (MBS) by two steps so that the MBS can learn an optimal policy to help the cognitive users (CUs) communicate with a proper transmit power. Firstly, the selection range of transmit power for CUs is calculated by the lower bound of Signal-to-Interference plus-Noise Ratio (SINR) to guarantee the transmission condition of both users. Then, the power control problem is modeled as a Markov Decision Process (MDP) with unknown transition function, where the energy consumption is decreased by giving the upper bound of CUs' SINR or threshold of transmit power in formulation of reward. In modeled MDP, the system state, which collected by primary users (PUs) and fed back to MBS, is reduced dimension by method of principal component analysis and then treated as the input of DQN. After that, DQN is used to train a power control optimal policy by minimizing the loss function. Simulation results demonstrate that the proposed power control algorithm based on DQN has a good performance that the average transition step and energy utility are 3.56 and 1580h, which is better than the existing solutions.

Application of Internet of Things Technology in Optimization of Electronic Assembly Process Parameters

“…Its existence has greatly improved the reliability of the Internet of things on the original basis. e role of the application layer is to use scientific and intelligent methods to process relevant data and then design corresponding personalized services according to the actual needs of customers [6,7].…”

Linear Anti-interference Algorithm for Digital Signal Transmission in Fiber Optic Communication Networks based on Link Analysis

“…Due to the surge in wireless communication traffic and the increasing complexity of long-distance communication transmission environments, as well as the need for high frequency spectrum utilization in multi-system communication requirements. We have started to adopt multi antenna multi interface technology (MIMO), which has array gain and coding characteristics, which can effectively suppress transmission channel interference, significantly increase data transmission rate, and expand communication capacity [16,8].…”

Integrated Cooperative Spectrum Sensing and Access Control for Cognitive Industrial Internet of Things

“…Dynamic multiobjective optimization was proposed for power and spectrum allocation of CR in [23], which achieved comprehensive performance improvement in terms of energy efficiency, fairness, spectrum utilization, etc. In [24], deep Q network (DQN) was used to allocate proper transmit power for the users in a CRbased industrial cyber-physical system, and the transmit power of each user was calculated by the lower bound of SNR to guarantee its transmission performance. A low-complexity optimal power control scheme was proposed for a CR system in [25], which maximized the achievable rate in the low-power regime by controlling the interference between the CR and PU.…”