Providing hybrid block storage for virtual machines using object-based storage

Ma, Sixiang; Chen, Haopeng; Shen, Yuxi; Lu, Heng; Wu, Bin; He, Pujiang

doi:10.1109/padsw.2014.7097803

Cited by 5 publications

(2 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…With the expanding development of the big data era, a huge number of small les that are needed to be used exibly have been generated. Due to the needs of both planeness and exibility of the data organization of the object storage system, the e orts of storing those les in an orderly manner grow signi cantly [1][2][3][4][5]. Just a few massive sets of examples dealing with those issues are Amazon Simple Storage Service (Amazon S3) [6], Lustre [7,8], Ceph [9], Sheepdog [10], and OpenStack Object Storage (Swift) [11].…”

Section: Introductionmentioning

confidence: 99%

Optimizing Object Storage System by the Object Multi-Tiered Balanced Organization

Zhang

Feng

Lei

2022

Mathematical Problems in Engineering

View full text Add to dashboard Cite

The era of big data has been constantly producing a huge amount of small files that will cause problems such as uneven distribution of copies and massive random readings and writings, resulting in delays in data accessions and degrading performances. By aiming at resolving the problems of an object storage system concerning the organization of small file objects such as layout imbalance, uneven loading, and adaptability of poor data migration, this article introduces a new strategy for object organization called object multi-tiered balanced organization strategy (OMBOS) with improved performance on massive small files in a real object storage system. Apart from the conventional strategy, the OMBOS achieves a multi-level balanced object by establishing weight indicators that reflect the comprehensive performance of nodes, including the balanced distribution of objects between replica sets and the balanced distribution of I/O requests in the replica sets as well as adapting to the equilibrium of the scale changes of the system dynamics. The OMBOS establishes a comprehensive performance evaluation model based on the fuzzy analytic hierarchy process and calculates the performance weights of the nodes of the object storages and replica sets. Then, the consistent hash-based object placement between the replica sets algorithm (BROP) and the I/O-loading balance in the replica set algorithm (IRIB) are utilized to implement performance-weighted objects in the object storage system through a tiered organization when the performance weights are taken into account. When the system scale changes flexibly, data migration is the only performed process in the nodes by adding or removing nodes, so data will not be migrated between existing nodes. Hence, the amount of data migration reaches the theoretical setting. Experiments show that the OMBOS achieves a balanced layout of objects based on performance weights, which meets the balancing and adaptability requirements of data organization. When compared to the original layout strategy through the balanced layout of objects, it performs nearly double the random access method.

show abstract

Section: Introductionmentioning

confidence: 99%

Optimizing Object Storage System by the Object Multi-Tiered Balanced Organization

Zhang

Feng

Lei

2022

Mathematical Problems in Engineering

View full text Add to dashboard Cite

show abstract

“…The proposed system consolidates existing works, e.g. Hint-K [113], Demote [114], and Promote [115], together to enhance the [79,81,82,85,88,93,94] and device controlled tiered structure [78,83,84,86,87,89]. In the host controlled tiered structure, the data movement is controlled by the system host by using the host side information.…”

Section: Ssd As a Write-back Cachementioning

confidence: 68%

Hybrid system analysis and design for scale-out storage environments

Niu¹

View full text Add to dashboard Cite

First of all, I would like to express my great appreciation to my supervisor, Prof. Lihua Xie, for his continuous guidance, encouragement and support throughout my research efforts towards this dissertation. Without his inspiration, deep insight, and invaluable advice, this thesis would not have been possible. I have benefited tremendously from his extensive knowledge, professional experience, and strong commitment towards the excellence of research.

show abstract

BOSS: An Efficient Data Distribution Strategy for Object Storage Systems With Hybrid Devices

Zhuge

Sha

et al. 2017

IEEE Access

View full text Add to dashboard Cite

Providing hybrid block storage for virtual machines using object-based storage

Cited by 5 publications

References 11 publications

Optimizing Object Storage System by the Object Multi-Tiered Balanced Organization

Optimizing Object Storage System by the Object Multi-Tiered Balanced Organization

Hybrid system analysis and design for scale-out storage environments

BOSS: An Efficient Data Distribution Strategy for Object Storage Systems With Hybrid Devices

Contact Info

Product

Resources

About