Adaptive channel recommendation for dynamic spectrum access

Abstract

We propose a dynamic spectrum access scheme where secondary users recommend "good" channels to each other and access accordingly. We formulate the problem as an average reward based Markov decision process. Since the action space of the Markov decision process is continuous (i.e., transmission probabilities), it is difficult to find the optimal policy by simply discretizing the action space and use the policy iteration, or value iteration. Instead, we propose a new algorithm based on the Model Reference Adaptive Search method, and prove its convergence to the optimal policy. Numerical results show that the proposed algorithm achieves up to 18% performance improvement than the static channel recommendation scheme and up to 63% performance improvement than the random access scheme, and is robust to channel dynamics.

Evolutionary Hypernetworks based Radio Spectrum Profiling in Cognitive Radio Ad hoc Networks

“…The information about channels derived through spectrum sensing has also been considered for CR optimization outside the context of prediction. The authors in [9] present a channel recommendation framework in which distributed CR nodes complement each other's channel access by recommending a successfully used channel. They derive the inspiration from customer reviews system associated with major online retail systems.…”

Distributed Resource Map: A database-driven network support architecture for Cognitive Radio ad hoc networks

“…Techniques such as fusion of variate data [21] and voting based schemes [22] have been shown to work for localization of transmitters and dynamic spectrum access. For cooperative abstraction of radio spectrum, techniques such as spectrum recommendation [23], correlation-based statistics for differential data, and collaborative filtering can be used. Apart from the costs of individual abstraction mainly relating to energy and computation, cooperative abstraction will incur additional costs of communication which may be more expensive in a CR ad hoc network where resource identification and utilization is difficult.…”

Improving Channel Usage in Networks Employing Dynamic Spectrum Access

“…One example of parametrization considered by many works is average spectrum use. In [4], [5], [6], [7], [8], [9] the authors consider spectrum availability in their communication protocols. These studies demonstrate that understanding primary communication is fundamental to improve network use.…”