Reinforcement Learning (RL)-Based Energy Efficient Resource Allocation for Energy Harvesting-Powered Wireless Body Area Network

Abstract

Wireless body area networks (WBANs) have attracted great attention from both industry and academia as a promising technology for continuous monitoring of physiological signals of the human body. As the sensors in WBANs are typically battery-driven and inconvenient to recharge, an energy efficient resource allocation scheme is essential to prolong the lifetime of the networks, while guaranteeing the rigid requirements of quality of service (QoS) of the WBANs in nature. As a possible alternative solution to address the energy efficiency problem, energy harvesting (EH) technology with the capability of harvesting energy from ambient sources can potentially reduce the dependence on the battery supply. Consequently, in this paper, we investigate the resource allocation problem for EH-powered WBANs (EH-WBANs). Our goal is to maximize the energy efficiency of the EH-WBANs with the joint consideration of transmission mode, relay selection, allocated time slot, transmission power, and the energy constraint of each sensor. In view of the characteristic of the EH-WBANs, we formulate the energy efficiency problem as a discrete-time and finite-state Markov decision process (DFMDP), in which allocation strategy decisions are made by a hub that does not have complete and global network information. Owing to the complexity of the problem, we propose a modified Q-learning (QL) algorithm to obtain the optimal allocation strategy. The numerical results validate the effectiveness of the proposed scheme as well as the low computation complexity of the proposed modified Q-learning (QL) algorithm.

Learning for Multiple-Relay Selection in a Vehicular Delay Tolerant Network

“…The "Q" named function returns a reward value, namely, the "quality" of the action taken in a given state [24]. However,…”

Multi‐objective design of energy harvesting enabled wireless networks based on evolutionary genetic optimisation

“…Moreover, it implemented transmission power control and spatial frequency reuse for performance enhancement of information relaying nodes. The resource allocation problem for energy optimisation in wireless body area networks is investigated in [17 ]. The proposed scheme utilised the modified Q‐learning algorithm and discrete‐time Markov model for addressing the relay node selection, time slot assignment, and energy harvesting issues.…”

Resource Allocation Challenges and Strategies for RF-Energy Harvesting Networks Supporting QoS

“…Energy constraints impose limitations on wireless sensor networks, thereby restricting their lifespan and hindering overall network performance. RF energy harvesting networks (RF-EHNs) have rapidly gained popularity in various domains such as wireless sensor networks [3], wireless body networks [4], and wireless charging systems. This is primarily due to their ability to harness radio waves as a power source.…”