Two-mode data distribution scheme for heterogeneous storage in data centers

Xie, Wei; Zhou, Jiangcong; Reyes, Mark; Jason, N. Bazil; Chen, Yong

doi:10.1109/bigdata.2015.7363772

Cited by 15 publications

(5 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…With this strategy, authors solved the issues such as load balancing, scalability and fault-tolerance. In this work, authors described consistent hashing with elasticity [32,33]. An elastic consistent hashing adapts to the existing consistent hashing method and in addition to it provides the optimized power and resource utilization.…”

Section: Data Placement Using Various Hashing Techniquesmentioning

confidence: 99%

Systematic Approaches to Data Placement, Replication and Migration in Heterogeneous Edge-Cloud Computing Systems: A Comprehensive Literature Review

Venkatesh¹,

Chandrashekar²,

Srinivas³

et al. 2023

ISI

View full text Add to dashboard Cite

The advent of Online Social Networks (OSNs) and the Internet-of-Things (IoT) has catalyzed an unprecedented surge in data generation at smart device endpoints. This phenomenon necessitates robust strategies for efficient data distribution and processing on data servers. Furthermore, the burgeoning volume of data intensifies challenges associated with data placement, replication, and migration in edge-cloud computing paradigms. Considerations such as access delay, cost implications, workload balance, and data security become critical parameters in the storage and processing of data from OSNs and IoT devices. Researchers have proposed various strategies to optimize data placement costs, access latency, migration costs, and load balancing constraints. This paper presents an extensive survey on the existing strategies for data placement, data replication, and data migration. The future research directions in edge-cloud computing informed by this survey are also delineated herein.

show abstract

Section: Data Placement Using Various Hashing Techniquesmentioning

confidence: 99%

Systematic Approaches to Data Placement, Replication and Migration in Heterogeneous Edge-Cloud Computing Systems: A Comprehensive Literature Review

Venkatesh¹,

Chandrashekar²,

Srinivas³

et al. 2023

ISI

View full text Add to dashboard Cite

show abstract

“…Chang et al [22] use a probability-based algorithm in order to select the best coordination of services that achieved the maximum availability based on a given budget. Other studied approaches regarding data allocation are [23,24,25], focusing on load balancing in heterogeneous storage environments. In most of the mentioned related works, only one or two aspects of storage are considered.…”

Section: Related Workmentioning

confidence: 99%

“…In most of the mentioned related works, only one or two aspects of storage are considered. For example, [21] and [22] mainly focus on availability and cost, while [23,24,25] focus on capacity, access frequency, and performance.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

BoxBroker: A Policy-Driven Framework for Optimizing Storage Service Federation

2018

KSII TIIS

View full text Add to dashboard Cite

Storage services integration can be done for achieving high availability, improving data access performance and scalability while preventing vendor lock-in. However, multiple services environment management and interoperability have become a critical issue as a result of service architectures and communication interfaces heterogeneity. Storage federation model provides the integration of multiple heterogeneous and self-sufficient storage systems with a single control point and automated decision making about data distribution. In order to integrate diverse heterogeneous storage services into a single storage pool, we are proposing a storage service federation framework named BoxBroker. Moreover, an automated decision model based on a policy-driven data distribution algorithm and a service evaluation method is proposed enabling BoxBroker to make optimal decisions. Finally, a demonstration of our proposal capabilities is presented and discussed.

show abstract

“…In response, researchers have shown that storage systems using a massive number of SSDs [1] can give I/O performance benefits allowing computational chemistry and life sciences applications to compute problems at scales that were simply not feasible when using traditional storage systems [2]. A hybrid design combining SSDs and HDDs provides a costeffective way of improving the performance of the storage system [3][4][5]. It has already been adopted in major IT companies and high performance computing facilities.…”

Section: Introductionmentioning

confidence: 99%

ASA-FTL: An adaptive separation aware flash translation layer for solid state drives

Xie¹,

Chen²,

Roth³

2017

Parallel Computing

Self Cite

View full text Add to dashboard Cite

The flash-memory based Solid State Drive (SSD) presents a promising storage solution for increasingly critical dataintensive applications due to its low latency (high throughput), high bandwidth, and low power consumption. Within an SSD, its Flash Translation Layer (FTL) is responsible for exposing the SSD's flash memory storage to the computer system as a simple block device. The FTL design is one of the dominant factors determining an SSD's lifespan and performance. To reduce the garbage collection overhead and deliver better performance, we propose a new, low-cost, adaptive separation-aware flash translation layer (ASA-FTL) that combines sampling, data clustering and selective caching of recency information to accurately identify and separate hot/cold data while incurring minimal overhead. We use sampling for lightweight identification of separation criteria, and our dedicated selective caching mechanism is designed to save the limited RAM resource in contemporary SSDs. Using simulations of ASA-FTL with both real-world and synthetic workloads, we have shown that our proposed approach reduces the garbage collection overhead by up to 28% and the overall response time by 15% compared to one of the most advanced existing FTLs. We find that the data clustering using a small sample size provides significant performance benefit while only incurring a very small computation and memory cost. In addition, our evalu

show abstract

Two-mode data distribution scheme for heterogeneous storage in data centers

Cited by 15 publications

References 13 publications

Systematic Approaches to Data Placement, Replication and Migration in Heterogeneous Edge-Cloud Computing Systems: A Comprehensive Literature Review

Systematic Approaches to Data Placement, Replication and Migration in Heterogeneous Edge-Cloud Computing Systems: A Comprehensive Literature Review

BoxBroker: A Policy-Driven Framework for Optimizing Storage Service Federation

ASA-FTL: An adaptive separation aware flash translation layer for solid state drives

Contact Info

Product

Resources

About