A New Approach to Double I/O Performance for Ceph Distributed File System in Cloud Computing

Zhang, Xiao; Wang, Yanqiu; Wang, Qing; Zhao, Xiaonan

doi:10.1109/icdis.2019.00018

Cited by 9 publications

(2 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A more recent survey on Cloud Storage [25] which covers more on data placement and file system is the article entitled "A survey on data storage and placement methodologies for Cloud-Big Data ecosystem" done in 2019. Systems such as IBM [26], VoltDB [27], MongoDB [28], Couchbase [29], Cassandra [30], HBase [31], and Ceph [32,33] were reviewed.…”

Section: Previous Workmentioning

confidence: 99%

On the Adoption of Erasure Code for Cloud Storage by Major Distributed Storage Systems

Chiniah¹,

Mungur²

2022

EAI Endorsed Transactions on Cloud Systems

View full text Add to dashboard Cite

INTRODUCTION: Traditional Cloud Systems are struggling to cope with the exponential growth of data in todays' distributed application environment. The amount of data online has continuously increased since 2003. From an estimated 5 Exabyte in 2003 to 988 Exabyte in 2010. Presently it is estimated that 5 Exabyte of data are produced daily. To cope with such astronomical load of data, Distributed Storage Systems such as Amazon, Google and Microsoft Azure are becoming the de-facto method for the storage of data. Replication is the method used for providing redundancy. However Erasure Coding is a worthy alternative. OBJECTIVES: The purpose of this paper is to assess the most used distributed storage systems using different evaluation criteria and identifying how erasure code can be integrated into them. METHODS: This paper provides a survey of well-known Distributed Storage Systems by using the CAP (Consistency, Availability and Partition Tolerance) Theorem. We go by presenting the solution according to the objectives set and tradeoff acknowledged by the designers. RESULTS: A comprehensive survey is presented using five evaluation criteria (design principle, data model, failure detection and recovery, consistency and security). Adoption of erasure code in Distributed Storage Systems is discussed and its advantages are deliberated. Several open challenges are also put forward. CONCLUSION: This paper provides researchers in the field with a comprehensive review of Distributed Storage Systems and how the adoption of erasure codes will enhance their capabilities.

show abstract

Section: Previous Workmentioning

confidence: 99%

On the Adoption of Erasure Code for Cloud Storage by Major Distributed Storage Systems

Chiniah¹,

Mungur²

2022

EAI Endorsed Transactions on Cloud Systems

View full text Add to dashboard Cite

show abstract

“…In today's medium and large data centers, this feature reduces the data risks and lowers operating costs when replacing equipment. But the mapping algorithm [7] can't sense the state of the device where the data will be written, and if the device is overloaded, the data writes are denied, at which point the upper-level systems with Ceph as the base storage (such as Openstack [8], which provides block storage [15] primarily for applications such as its virtual machines) will crash.…”

Section: Introductionmentioning

confidence: 99%

A New Collaborative Scheduling Mechanism Based on Grading Mapping for Resource Balance in Distributed Object Cloud Storage System

Chen

et al. 2021

Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

View full text Add to dashboard Cite

An algorithmic mapping of storage locations brings high storage efficiency to the storage system, but the loss of efficient scheduling makes systems prone to crashing at low usage. This paper uses the Ceph storage system as a research sample to analyze these issues and proposes a grading mapping adaptive storage resource collaborative optimization mechanism. This approach grading both the storage device and the storage content, and introduced random factors and influence factors as two-factors to quantify the grading mapping relationship between the two of them. This relation coordinates the storage systems' performance and reliability. In addition, a collaborative storage algorithm is proposed to realize balanced storage efficiency and control data migration. The experimental results show that in comparison with the inherent mechanism in the traditional Ceph system, the proposed cooperative storage adaptation mechanism for data balancing has increased the average system usage by 17% and reduces data migration by 50% compared to the traditional research approach.

show abstract

TDC: Pool-Level Object Cache Replacement Algorithm Based on Temperature Density

Lu,

Wang,

Chen

et al. 2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

A New Approach to Double I/O Performance for Ceph Distributed File System in Cloud Computing

Cited by 9 publications

References 10 publications

On the Adoption of Erasure Code for Cloud Storage by Major Distributed Storage Systems

On the Adoption of Erasure Code for Cloud Storage by Major Distributed Storage Systems

A New Collaborative Scheduling Mechanism Based on Grading Mapping for Resource Balance in Distributed Object Cloud Storage System

TDC: Pool-Level Object Cache Replacement Algorithm Based on Temperature Density

Contact Info

Product

Resources

About