In this paper, we consider the problem of scheduling the power of a sensor when transmitting over an unknown Gilbert-Elliott (GE) channel for remote state estimation. The sensor supports two power modes, namely low power and high power, which are to be selected for transmission over the channel in order to minimize a cost on the error covariance, while satisfying the energy constraints. The remote estimator provides error-free acknowledgement/negative-acknowledgement (ACK/NACK) messages to the sensor only when low power is utilized. We first consider the Partially Observable Markov Decision Process (POMDP) problem for the case of known GE channels and derive conditions for optimality of a stationary schedule. Next, a Bayesian inference approach is used through which the channels statistics are approximately learned when they are initially unknown. An algorithm is proposed in which the sensor adjusts its scheduling policy based on the energy constraint.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.