Blockchain Evaluation Approaches: State-of-the-Art and Future Perspective

Smetanin, Sergey; Ometov, Aleksandr; Komarov, Mikhail; Mašek, Pavel; Koucheryavy, Yevgeni

doi:10.3390/s20123358

Cited by 76 publications

(45 citation statements)

References 67 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, compared to traditional centralized solutions, blockchain's decentralized nature limits its performance [8], and this becomes a significant constraint on applying blockchain in production more broadly [9]. Moreover, blind development of blockchain-based systems without initial performance evaluation may have an immense negative impact during the actual deployment stage [10]. Therefore, performance evaluation is a crucial topic for blockchain and all distributed ledger technologies (DLTs).…”

Section: Introductionmentioning

confidence: 99%

A Systematic Review and Empirical Analysis of Blockchain Simulators

2021

View full text Add to dashboard Cite

In recent years, distributed ledger technologies, and especially blockchain, have gained tremendous interest from academia, government, and industry. Although various blockchain-based solutions were created, the lack of tools to evaluate these complex distributed systems may hinder the development of the field. Many advantages of blockchain systems can be demonstrated only at large scales, e.g., using thousands of nodes. An investigation of different implementations and design choices is complicated and hardly feasible on real systems. Meanwhile, blockchain simulators give the possibility to repeat the complex real-world processes at a low cost. This work provides the first and an up-to-date systematic review and empirical analysis of blockchain simulators. Simulators are easily extensible and can test the performance of distributed ledgers using different settings and parameters on a single computer. The features and limitations of selected simulators are summarized and experimentally validated. Finally, recommendations for potential future research directions in the field are provided. INDEX TERMS Bitcoin, distributed ledger technology, blockchain, simulators, systematic review.

show abstract

Section: Introductionmentioning

confidence: 99%

A Systematic Review and Empirical Analysis of Blockchain Simulators

2021

View full text Add to dashboard Cite

show abstract

“…To observe the overall situation of the dynamic performance of each public blockchain project, we calculated the geometric mean of the monthly indicators of each blockchain, as shown in Table 5. For a more detailed analysis, we divided the 24 periods into four stages (May 2018 to November 2018, November 2018 to May 2019, May 2019 to November 2019, November 2019 to April 2020), as shown in table 6.…”

Section: B Analyses From the Modified Gm Indexmentioning

confidence: 99%

“…Dinh et al pointed out that the blockchain is maintained by a group of nodes that do not fully trust each other, which is a shared digital ledger [5]. Smetanin et al provided a systematic review of current blockchain evaluation approaches [6]. Previous studies on blockchain evaluation include both analytical and simulation-based approaches.…”

Section: Introductionmentioning

confidence: 99%

Dynamic Performance Evaluation of Blockchain Technologies

Zhou

Cao³

et al. 2020

IEEE Access

View full text Add to dashboard Cite

In recent years, the rapid development of blockchain technologies have attracted worldwide attention. Its application has been extended to many fields, such as digital finance, supply chain management, and digital asset transactions. For some enterprises and users, how to choose the most effective platform from many blockchains to control costs and share data is an important issue. To comprehensively evaluate the blockchain technologies, we first construct three-level evaluation indicators in terms of technical, market, and popularity indicators. Then, we propose an improved global DEA-Malmquist index without explicit inputs to assess the dynamic performance of blockchain technologies. Finally, we carry out an empirical analysis to evaluate 31 public blockchains' performance from May 2018 to April 2020. The results indicate that the overall performance of blockchain technologies is basically on the rise. Some blockchain technologies that have not yet received widespread attention have shown good dynamic performance.

show abstract

“…In current studies, pre-selected consensus nodes are normally assumed to be trusted in order to authorise the data access and to transport users’ private data in a consensus network [ 11 ]. However, one important issue that has not been considered is that users’ private data can be utilised by the pre-selected nodes in the consensus network during authorisation, since these nodes may be manipulated by the attacker to be untrusted (malicious).…”

Section: Introductionmentioning

confidence: 99%

A Challenge-Response Assisted Authorisation Scheme for Data Access in Permissioned Blockchains

Zhang

Liu

Chai

et al. 2020

Sensors

View full text Add to dashboard Cite

Permissioned blockchains can be applied for sharing data among permitted users to authorise the data access requests in a permissioned blockchain. A consensus network constructed using pre-selected nodes should verify a data requester’s credentials to determine if he or she have the correct permissions to access the queried data. However, current studies do not consider how to protect users’ privacy for data authorisation if the pre-selected nodes become untrusted, e.g., the pre-selected nodes are manipulated by attackers. When a user’s credentials are exposed to pre-selected nodes in the consensus network during authorisation, the untrusted (or even malicious) pre-selected nodes may collect a user’s credentials and other private information without the user’s right to know. Therefore, the private data exposed to the consensus network should be tightly restricted. In this paper, we propose a challenge-response based authorisation scheme for permissioned blockchain networks named Challenge-Response Assisted Access Authorisation (CRA3) to protect users’ credentials during authorisation. In CRA3, the pre-selected nodes in the consensus network do not require users’ credentials to authorise data access requests to prevent privacy leakage when these nodes are compromised or manipulated by attackers. Furthermore, the computational burden on the consensus network for authorisation is reduced because the major computing work of the authorisation is executed by the data requester and provider in CRA3.

show abstract

Blockchain Evaluation Approaches: State-of-the-Art and Future Perspective

Cited by 76 publications

References 67 publications

A Systematic Review and Empirical Analysis of Blockchain Simulators

A Systematic Review and Empirical Analysis of Blockchain Simulators

Dynamic Performance Evaluation of Blockchain Technologies

A Challenge-Response Assisted Authorisation Scheme for Data Access in Permissioned Blockchains

Contact Info

Product

Resources

About