An evaluation of data replication for bioinformatics workflows on NoSQL systems

Lima, Iasmini Virgínia Oliveira; Oliveira, Margareth Silva; Kieckbusch, Diego S.; Holanda, Maristela; Walter, Maria Emília M. T.; Araújo, Aletéia; Victorino, Marcio; Silva, Waldeyr M. C.; Lifschitz, Sérgio

doi:10.1109/bibm.2016.7822644

Cited by 5 publications

(6 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The authors gave a profound explanation and description of the two used models of replication: Master/ slave and replica-set models. An interesting study (Lima et al, 2016) has been conducted to evaluate the impact of biological data replication on MongoDB and Cassandra. Some setting in the cluster and replication factors can certainly affect the results.…”

Section: Results Analysis Of the Proposed Strategymentioning

confidence: 99%

“…Some works have focused their attention on the improvement of auto-sharding, load balance, and auto-scaling algorithms, e.g., (Liu et al, 2012;Gu et al, 2015;Mohamed, 2015). Other works analyse the differences of Mongo's data model, query and replication model with relational database management systems, e.g., (Lima et al, 2016;Mansouri and Asadi, 2014). Many of these works are trying to take a closer look to performance by comparing capabilities of MongoDB with other NoSQL systems, e.g., performance comparison between MongoDB and Cassandra in (Haughian et al, 2016).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A data replication strategy for document-oriented NoSQL systems

Tabet

Mokadem

Laouar

2019

IJGUC

View full text Add to dashboard Cite

Cloud providers aim to maximise their profits while satisfying tenant requirements, e.g., performance. The relational database management systems face many obstacles in achieving this goal. Therefore, the use of NoSQL databases becomes necessary when dealing with heterogeneous workloads and voluminous data. In this context, we propose a new data replication strategy that balances the workload of nodes and dynamically adjusts the number of replicas while the provider profit is taken into account. Result analysis shows that the proposed strategy reduces the resource consumption, which improves the provider profit while satisfying the tenant performance requirement.

show abstract

Section: Results Analysis Of the Proposed Strategymentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

A data replication strategy for document-oriented NoSQL systems

Tabet

Mokadem

Laouar

2019

IJGUC

View full text Add to dashboard Cite

show abstract

“…introduced an innovative method for data replication in data grid systems, with an emphasis on enhancing resource allocation while taking economic considerations into account. [5] Li. T et.…”

Section: Related Workmentioning

confidence: 99%

“…This functionality ensures that the secondary nodes stay synchronized and uphold data consistency with the primary node. [2][4] [5] [8] The Oplog is structured as a capped collection, which implies that it has a predefined size limit. When the Oplog reaches this limit, it automatically deletes older entries to free up space for storing new entries.…”

Section: Introductionmentioning

confidence: 99%

MongoDB Oplog Archiving: Strategies And Experimental Analysis

Kapadia,

Kanungo,

Pandya

et al. 2024

EATP

View full text Add to dashboard Cite

MongoDB is a widely used NoSQL database system. Archiving within MongoDB involves placing historical or outdated data in a distinct location or structure. This is usually done to release resources within the active database, leading to an enhancement in overall performance. The purpose of this approach is to enable organizations to efficiently handle substantial volumes of data and uphold a system that remains responsive for ongoing operations. MongoDB, known for being a NoSQL database, offers multiple methods for the archival of data. MongoDB depends on the Oplog (operation log) to record real-time database changes. This essential component plays a vital role in enabling features like replication and sharding, which are crucial for maintaining data consistency and ensuring high availability. Nevertheless, handling and archiving Oplog data can present notable difficulties, especially in extensive MongoDB deployments. This research delves into different Oplog archiving approaches and offers an empirical analysis of their performance and efficiency.

show abstract

“…This model is known as cloud bursting and makes a secure connection between a private cloud and a public cloud, where the private and public clouds we respectively call consumer and donor. When a data-intensive application running on a private cloud and requiring a resource (e.g., a VM instance) the application provider subscribes to a public cloud and creates it in the public cloud using either automation tools such as Terraform Ansible 15 , or APIs provided by the public cloud. After that, the private cloud makes a connection with the public cloud through WireGuard.…”

Section: On-demand Usage Modelmentioning

confidence: 99%

An Automated Implementation of Hybrid Cloud for Performance Evaluation of Distributed Databases

Mansouri¹,

Prokhorenko²,

Babar³

2020

Preprint

View full text Add to dashboard Cite

A Hybrid cloud is an integration of resources between private and public clouds. It enables users to horizontally scale their on-premises infrastructure up to public clouds in order to improve performance and cut up-front investment cost. This model of applications deployment is called cloud bursting that allows data-intensive applications especially distributed database systems to have the benefit of both private and public clouds.In this work, we present an automated implementation of a hybrid cloud using (i) a robust and zero-cost Linux-based VPN to make a secure connection between private and public clouds, and (ii) Terraform as a software tool to deploy infrastructure resources based on the requirements of hybrid cloud. We also explore performance evaluation of cloud bursting for six modern and distributed database systems on the hybrid cloud spanning over local OpenStack and Microsoft Azure. Our results reveal that MongoDB and MySQL Cluster work efficient in terms of throughput and operations latency if they burst into a public cloud to supply their resources. In contrast, the performance of Cassandra, Riak, Redis, and Couchdb reduces if they significantly leverage their required resources via cloud bursting.

show abstract

An evaluation of data replication for bioinformatics workflows on NoSQL systems

Cited by 5 publications

References 26 publications

A data replication strategy for document-oriented NoSQL systems

A data replication strategy for document-oriented NoSQL systems

MongoDB Oplog Archiving: Strategies And Experimental Analysis

An Automated Implementation of Hybrid Cloud for Performance Evaluation of Distributed Databases

Contact Info

Product

Resources

About