Towards sustainable in-situ server systems in the big data era

Abstract

Recent years have seen an explosion of data volumes from a myriad of distributed sources such as ubiquitous cameras and various sensors. The challenges of analyzing these geographically dispersed datasets are increasing due to the significant data movement overhead, time-consuming data aggregation, and escalating energy needs. Rather than constantly move a tremendous amount of raw data to remote warehouse-scale computing systems for processing, it would be beneficial to leverage in-situ server systems (InS) to pre-process data, i.e., bringing computation to where the data is located. This paper takes the first step towards designing server clusters for data processing in the field. We investigate two representative in-situ computing applications, where data is normally generated from environmentally sensitive areas or remote places that lack established utility infrastructure. These very special operating environments of in-situ servers urge us to explore standalone (i.e., off-grid) systems that offer the opportunity to benefit from local, self-generated energy sources. In this work we implement a heavily instrumented proof-of-concept prototype called InSURE: in-situ server systems using renewable energy. We develop a novel energy buffering mechanism and a unique joint spatio-temporal power management strategy to coordinate standalone power supplies and in-situ servers. We present detailed deployment experiences to quantify how our design fits with in-situ processing in the real world. Overall, InSURE yields 20%~60% improvements over a state-of-the-art baseline. It maintains impressive control effectiveness in under-provisioned environment and can economically scale along with the data processing needs. The proposed design is well complementary to today's grid-connected cloud data centers and provides competitive cost-effectiveness.

Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing

“…Batteries are used to balance the power supply and demand. In a solar+wind system, photovoltaic modules and wind turbines can combine their output to power the edge system and charge the batteries [6]. When their combined efforts are insufficient, batteries take over to ensure steady operation of the edge system.…”

“…Effective operation of MEC is contingent upon efficient power provisioning for the edge system. However, providing reliable and stable grid power supply in remote areas and hazardous locations can be extremely costly and even infeasible since construction and operation of transmission lines are often prohibitive, and grid-tied servers can violate environmental quality regulations in rural areas that are ecologically sensitive [6]. For instance, in many developing countries, the majority of base stations have to be powered by continuously operating diesel generators because the electric grid is too unreliable [7].…”

A Survey on Edge Computing Systems and Tools

“…In [53], a rack-scale green-energy powered edge infrastructure, InSURE (in-situ server system using renewable energy) is implemented for data pre-processing at the edge. InSURE can be powered by standalone (solar/wind) power and with batteries as the energy backup.…”

Data Center Challenges and Their Power Electronics

“…In more conventional scenarios, in which PUE does not include power supply losses and impacts, reduced computation energy has much larger impact at the input. Dynamic optimization has a key role to play in long-term data center operation [91].…”