MRL-CC: a novel cooperative communication protocol for QoS provisioning in wireless sensor networks

Abstract

Abstract:Cooperative communications have been demonstrated to be effective in combating the multiple fading effects in wireless networks, and improving the network performance in terms of adaptivity, reliability, data throughput and network lifetime. In this paper, we investigate the use of cooperative communications for quality of service (QoS) provisioning in resource-constrained wireless sensor networks, and propose MRL-CC, a Multi-agent Reinforcement Learning based multi-hop mesh Cooperative Communication mechanism. In MRL-CC, a multi-hop mesh cooperative structure is constructed for reliable data disseminations. The cooperative mechanism that defines cooperative partner assignments, and coding and transmission schemes is implemented using a multi-agent reinforcement learning algorithm. We compare the network performance of MRL-CC with MMCC (Chen et al., 2009), a Multi-hop Mesh structure based Cooperative Communication scheme, and investigate the impacts of network traffic load, interference and sensor node's mobility on the network performance. Simulation results show that MRL-CC performs well in terms of a number of QoS metrics, and fits well in large-scale networks and highly dynamic environments.

QoS and Energy Aware Cooperative Routing Protocol for Wildfire Monitoring Wireless Sensor Networks

“…

State : the CN groups are modeled to be the environment states: $\begin{array}{c}{s}_n=\left\{k\right\},\hspace{1em}\text{where}\hspace{0.17em}\hspace{0.17em}k\in \left\{\dots ,V_{n-\mathrm{1}},V_n,V_{n+\mathrm{1}},\dots \right\}.\end{array}$

Action : an agent can operate one of these two actions:

a f : forwarding of the packet from V n to V n +1 ,

a m : monitoring the forwarded packet;

so: A = { a f , a m }.

In our study, we have considered two approaches. The first approach is proposed in [1] where the RL strategy (policy, behaviors, and rewards) for the sensor nodes considers the packet delay and the packet loss rate. This technique has been called the MRL-CC algorithm.…”

“…In recent works, this concept has been proposed to exploit the spatial diversity gains in wireless networks [1–3]. Data aggregation in WSN often uses multihop transmission techniques.…”

“…Recently, a cooperative communication protocol for quality-of-service (QoS) provisioning has been proposed and named MRL-CC, a multiagent reinforcement learning-based cooperative communication routing algorithm [1]. The RL concept consists in considering the cooperative nodes as multiple agents learning their optimal policy through experiences and rewards.…”

Cooperative network-coding system for wireless sensor networks

“…Hence, protocols that reduce the node power)consumption by cutting down on communications are a key requirement for practical WSN applications. This motivated research into power)efficient protocols with minimal communications overhead and relay)based approaches to extend the coverage area of the WSN via novel techniques such as network coding (NC) [1], cooperative communications [2,3], and cooperative NC [4]. An efficient implementation of NC with low computational power is presented in [1].…”

“…An efficient implementation of NC with low computational power is presented in [1]. In [2], network cooperative communications has been investigated for quality of service (QoS) provisioning in resource)constrained WSN and a multi)agent reinforcement learning)based multi)hop mesh cooperative communication mechanism proposed. Both NC and cooperative techniques are proposed in [4], analysing relay's location and resulting in increased coverage area.…”