Asynchronous FDRL-Based Low-Latency Computation Offloading for Integrated Terrestrial and Non-Terrestrial Power IoT

Abstract

Integrated terrestrial and non-terrestrial power internet of things (IPIoT) has emerged as a paradigm shift to three-dimensional vertical communication networks for power systems in the 6G era. Computation offloading plays key roles in enabling real-time data processing and analysis for electric services. However, computation offloading in IPIoT still faces challenges of coupling between task offloading and computation resource allocation, resource heterogeneity and dynamics, and degraded model training caused by electromagnetic interference (EMI). In this article, we propose an asynchronous federated deep reinforcement learning (AFDRL)-based computation offloading framework for IPIoT, where models are uploaded asynchronously for federated averaging to relieve network congestion and improve global model training. Then, we propose Asynchronous fedeRated deep reinforcemenT learnIng-baSed low-laTency computation offloading algorithm (ARTIST) to realize low-latency computation offloading through joint optimization of task offloading and computation resource allocation. Particularly, ARTIST adopts EMI-aware federated set determination to remove aberrant local models from federated averaging and improve training accuracy. Next, a case study is developed to validate the excellent performance of ARTIST in reducing task offloading and total queuing delays.Index Terms-6G, integrated terrestrial and non-terrestrial power internet of things, computation offloading, asynchronous federated deep reinforcement learning, electromagnetic interference awareness I. INTRODUCTIONPower internet of things (PIoT) provides comprehensive interconnection among human, machine, and things through all the aspects of power generation, transmission, distribution, and consumption. PIoT requires low latency, flexible coverage, and high security to support delay-sensitive power services and connection of external devices into the grid. However, in