Bio-Inspired Cost-Effective Access to Big Data

Abstract

With the rapid proliferation of services and cloud computing, Big Data has become a significant phenomenon across many scientific disciplines and sectors of society, wherever huge amounts of data are generated and processed daily. End users will always seek higher-quality data access at lower prices. This demand poses challenges to service composers, service providers and data providers, who should maintain their service and data provision as cost-effectively as possible. This paper will apply bio-inspired approaches to achieving equilibrium among the otherwise competitive stakeholders. In addition to novel models of cost for Big Data provision, bio-inspired algorithms will be developed and validated for dynamic optimisation. Furthermore, the optimised algorithms will also be applied in the data-mining research on the Alpha Magnetic Spectrometer (AMS) experiment, which is aiming to find dark matter in the universe. This experiment typically receives 200G and generates 700G data daily. ABSTRACTWith the rapid proliferation of services and cloud computing, Big Data has become a significant phenomenon across many scientific disciplines and sectors of society, wherever huge amounts of data are generated and processed daily. End users will always seek higher-quality data access at lower prices. This demand poses challenges to service composers, service providers and data providers, who should maintain their service and data provision as cost-effectively as possible. This paper will apply bio-inspired approaches to achieving equilibrium among the otherwise competitive stakeholders. In addition to novel models of cost for Big Data provision, bio-inspired algorithms will be developed and validated for dynamic optimisation. Furthermore, the optimised algorithms will also be applied in the data-mining research on the Alpha Magnetic Spectrometer (AMS) experiment, which is aiming to find dark matter in the universe. This experiment typically receives 200G and generates 700G data daily.

The Difference of Machine Learning and Deep Learning Algorithms

“…Deep learning is generally more complex, so you'll need at least a few thousand images to get reliable results. Having a highperformance GPU means the model will take less time to analyse all those images [14].…”

Bio-inspired computation for big data fusion, storage, processing, learning and visualization: state of the art and future directions

“…Fortunately, bio-inspired computation can effectively help legacy technologies to cope with challenges stemming from the above features. In terms of volume, for example, bio-inspired optimization metaheuristics can contribute to the feasibility of traditional data mining models for large datasets under assorted strategies, including instance reduction, feature selection, or model simplification [23]. Indeed the compliance of the optimization problems formulated in these strategies with the typical volumes of Big Data is among the motivations for the upsurge of largescale global optimization, a subarea within bio-inspired optimization that deals with problems of very high dimensionality (thousands to millions of decision variables [24]).…”

Understanding the Features of Internet of Things (IoT) and Big Data Analysis

“…The data centres and databases store huge amounts of data, which is still rapidly growing. With the exponential growth of data, organizations often find it difficult to rightly store this data [14].…”