DART: Fast and Efficient Distributed Stream Processing Framework for Internet of Things

Abstract

With the advent of the Internet‐of‐Things paradigm, the amount of data production has grown exponentially and the user demand for responsive consumption of data has increased significantly. Herein, we present DART, a fast and lightweight stream processing framework for the IoT environment. Because the DART framework targets a geospatially distributed environment of heterogeneous devices, the framework provides (1) an end‐user tool for device registration and application authoring, (2) automatic worker node monitoring and task allocations, and (3) runtime management of user applications with fault tolerance. To maximize performance, the DART framework adopts an actor model in which applications are segmented into microtasks and assigned to an actor following a single responsibility. To prove the feasibility of the proposed framework, we implemented the DART system. We also conducted experiments to show that the system can significantly reduce computing burdens and alleviate network load by utilizing the idle resources of intermediate edge devices.

A cost- and performance-effective approach for task scheduling based on collaboration between cloud and fog computing

“…We see CEP for the IoT as a potential application. 10 CEP is an event processing that deals with the task of processing multiple events with the goal of identifying the meaningful events within the event cloud. We consider an IoT deployment scenario with a user-defined analytics workflow composed of CEP queries (tasks) that need to be performed on multiple event streams generated at the edge (e.g.…”

“…CEP-based systems interpret input data as event streams and accept a user-defined analytics workflow composed of CEP queries (tasks) that need to be performed on these streams in order to derive semantically enriched ''complex'' event from a series of simpler events. 9,10 With the growing prevalence of cloud-fog computing system, it is inevitable that such DAG-based applications will be naturally distributed and embedded in an environment with numerous connected computing devices with heterogeneous capabilities. As streaming data travel from its point of origin (e.g.…”

Predicting required licensed spectrum for the future considering big data growth

“…Consequently, to solve this, a new parameter pertaining to the accessing network probability was introduced. Thus, the actual network traffic, M ANT , can be evaluated as a function of the total number of subscriber N T UEs À Á , average equivalent download speed per subscriber B UE DL À Á , and accessing network probability F ð Þ, as given in (11).…”

Secure IoT solution for wearable health care applications, case study Electric Imp development platform

“…With today's rapid pace, Modern life is strongly influenced by this emerging Internet of Things (IoT) technology. 1,5,7 The internet especially cloud technology affords enormous assets. 1,5,6 Without a doubt, the IoT is forcing the emergence of new class of computing and controller units; all new devices must support standard input-output handshake, as well as real computing of traditional embedded schemes that have to support at least one of the various wireless links as Wi-Fi or 4G cellular LTE specifications.…”