Horizontally Distributed Inference of Deep Neural Networks for AI-Enabled IoT

Abstract

Motivated by the pervasiveness of artificial intelligence (AI) and the Internet of Things (IoT) in the current “smart everything” scenario, this article provides a comprehensive overview of the most recent research at the intersection of both domains, focusing on the design and development of specific mechanisms for enabling a collaborative inference across edge devices towards the in situ execution of highly complex state-of-the-art deep neural networks (DNNs), despite the resource-constrained nature of such infrastructures. In particular, the review discusses the most salient approaches conceived along those lines, elaborating on the specificities of the partitioning schemes and the parallelism paradigms explored, providing an organized and schematic discussion of the underlying workflows and associated communication patterns, as well as the architectural aspects of the DNNs that have driven the design of such techniques, while also highlighting both the primary challenges encountered at the design and operational levels and the specific adjustments or enhancements explored in response to them.

Modeling Impact of Transportation Infrastructure-Based Accessibility on the Development of Mixed Land Use Using Deep Neural Networks: Evidence from Jiang’an District, City of Wuhan, China

“…For instance, Maerten et al [35] explores AI-generated art, examining DNN architectures and models used, from classic convolutional networks to cutting-edge diffusion models. In addition, Rodriguez-Conde et al [36] presents a comprehensive overview of recent research that explores the convergence of artificial intelligence (AI) and the Internet of Things (IoT) within the framework of "smart everything". It focuses on designing mechanisms for collaborative inference across edge devices to execute complex DNN in resource-constrained infrastructures.…”

Validation of Instruments for the Improvement of Interprofessional Education through Educational Management: An Internet of Things (IoT)-Based Machine Learning Approach

“…The Internet of things (IoT) and artificial intelligence (AI) are two game-changing technologies that are rapidly merging to build more intelligent and interconnected systems [16][17][18]. The development and comprehension of intelligent systems are supported by a broad range of ideas [19], methods, and principles that constitute the theoretical framework of artificial intelligence (AI).…”