Green Cloud Software Engineering for Big Data Processing

Abstract

Internet of Things (IoT) coupled with big data analytics is emerging as the core of smart and sustainable systems which bolsters economic, environmental and social sustainability. Cloud-based data centers provide high performance computing power to analyze voluminous IoT data to provide invaluable insights to support decision making. However, multifarious servers in data centers appear to be the black hole of superfluous energy consumption that contributes to 23% of the global carbon dioxide (CO2) emissions in ICT (Information and Communication Technology) industry. IoT-related energy research focuses on low-power sensors and enhanced machine-to-machine communication performance. To date, cloud-based data centers still face energy–related challenges which are detrimental to the environment. Virtual machine (VM) consolidation is a well-known approach to affect energy-efficient cloud infrastructures. Although several research works demonstrate positive results for VM consolidation in simulated environments, there is a gap for investigations on real, physical cloud infrastructure for big data workloads. This research work addresses the gap of conducting real physical cloud infrastructure-based experiments. The primary goal of setting up a real physical cloud infrastructure is for the evaluation of dynamic VM consolidation approaches which include integrated algorithms from existing relevant research. An open source VM consolidation framework, Openstack NEAT is adopted and experiments are conducted on a Multi-node Openstack Cloud with Apache Spark as the big data platform. Open sourced Openstack has been deployed because it enables rapid innovation, and boosts scalability as well as resource utilization. Additionally, this research work investigates the performance based on service level agreement (SLA) metrics and energy usage of compute hosts. Relevant results concerning the best performing combination of algorithms are presented and discussed.

Adoption of cloud computing tools for sustainable construction: a structural equation modelling approach

“…Construction stakeholders have an enormous struggle to formulate, present and integrate novel technologies for these alterations in these phenomena. Superior-performance managing capacity is produced by cloud-based data centres that analyse large volumes of Internet of Things (IoT) data to deliver valuable intuition concerning decision-making (Ganesan et al , 2020). Thus, observing the methods that can be applied to support this situation, reflecting the developments in CC and their effect on the construction industry, is vital for constructing the construction projects (Zainon et al , 2011).…”

“…However, the provision of computing facilities is via collaborative server networks and used simultaneously by many users (Pańkowska et al , 2020). High-performance computational resources are offered to administer a high volume of IoT data that can provide valuable evidence to recuperate policy-making (Ganesan et al , 2020).…”

Assessment of Cloud Computing Success Factors for Sustainable Construction Industry: The Case of Nigeria

“…This phenomenon places huge pressure on building managers to prepare, introduce, and incorporate new technological strategies for these changes. High-performance processing capacity is generated by cloud-based data centers that analyze vast volumes of IoT data to provide useful insight into decision making [8]. Therefore, looking at the approaches that can be used to assist in this situation, we must consider the advances in cloud computing and their impact on the construction industry [9].…”

Barriers to Digital Technology Deployment in Value Management Practice

“…This will allow corrections to be made on time to avoid unnecessary cost, time and material wastage during construction [1]. Also, through BDA, the VM team can collect, store, and analyse data easily to make informed decisions necessary for the project's success [18,19]. Unfortunately, the use of digital technologies in the construction industry of developing countries like South Africa has been extremely slow due to several challenges facing the industry [2].…”