A Read-leveling Data Distribution Scheme for Promoting Read Performance in SSDs with Deduplication

Lu, Mengting; Wang, Fang; Feng, Dan; Hu, Yuchong

doi:10.1145/3337821.3337884

Cited by 10 publications

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Limited to the computational and storage capacity of a single node, Cloud Deduplication (CD) makes use of the powerful storage capacity and parallelism of clustered systems so that deduplication can be used in large-scale distributed storage systems [57][58][59][60]. Cloud deduplication is benefit for data routing strategy to send data to each storage node and implement data deduplicate at each storage node, or the data is deduplicated before it is sent to the storage node.…”

Section: Introductionmentioning

confidence: 99%

Research on Data Routing Strategy of Deduplication in Cloud Environment

Zhang

Bian

et al. 2022

IEEE Access

View full text Add to dashboard Cite

The application of data deduplication technology reduces the demand for data storage and improves resource utilization. Compared with limited storage capacity and computing capacity of a single node, cluster data deduplication technology has great advantages. However, the cluster data duplication technology also brings new issues on deduplication rate reduction and load balancing of storage nodes. The application of data routing strategy can well balance the problem of deduplication rate and load balancing. Therefore, this paper proposes a data routing strategy based on distributed Bloom Filter. 1)Superchunk is used as the basic unit of data routing to improve system throughput. According to Broder's theorem, k leastsized fingerprints are selected as the Superchunk features and send to the storage node. The optimal node is selected as the routing node by matching the BloomFilter, and the storage capacity of the node and maintained in the memory of the storage node. 2) Design and implement system prototypes. The specific parameters of all kinds of routing strategies are obtained through experiments, and the routing strategies proposed in this paper are tested. The theoretical analysis and experimental results prove the feasibility of the strategies proposed by this paper. Compared with the other routing strategies, our method improved 3% of the deduplication rate, reduces the communication query overhead by more than 36% and improves the load balancing degree of the storage system.

show abstract

Section: Introductionmentioning

confidence: 99%