Reinforcement learning application to satellite constellation sensor tasking

Abstract

Machine learning and artificial intelligence algorithms have expanded dramatically in use across diverse fields of research and practice. Despite the extensive benefits that these algorithms can bring to researchers, system designers, and operators alike, the adoption of these algorithms in space-related scenarios has lagged behind other fields. In order to encourage the increased adoption of artificial intelligence and machine learning techniques to space-domain-related problems, flexible modeling and simulation capabilities are needed to build stakeholder trust in these techniques. This research presents the development of a flexible Python-based modeling and simulation environment for applying Reinforcement Learning to Low Earth Orbit satellite Hyper Spectral Imaging sensor tasking. With the transition away from small numbers of highly exquisite on-orbit systems to proliferated architectures characterized by constellations of lower cost and complexity spacecraft, the methods by which payload sensors are tasked have become dynamic and complex, making the problem of determining effective sensor tasking methods an important area of research. Such a problem lends itself well to the application of Reinforcement Learning. The focus of this work is on developing the role of intelligent systems in improving the data acquisition process in a space-based hyperspectral imaging system, and showing how the developed modeling and simulation framework can be successfully employed to improve the acquisition of targets of interest. A key strength of the presented reinforcement learning application framework is its non-commercial, extensible nature, suitable for both research and educational purposes.