SoK: Benchmarking the Performance of a Quantum Computer

Abstract

The quantum computer has been claimed to show more quantum advantage than the classical computer in solving some specific problems. Many companies and research institutes try to develop quantum computers with different physical implementations. Currently, most people only focus on the number of qubits in a quantum computer and consider it as a standard to evaluate the performance of the quantum computer intuitively. However, it is quite misleading in most times, especially for investors or governments. This is because the quantum computer works in a quite different way than classical computers. Thus, quantum benchmarking is of great importance. Currently, many quantum benchmarks are proposed from different aspects. In this paper, we review the existing performance benchmarking protocols, models, and metrics. We classify the benchmarking techniques into three categories: physical benchmarking, aggregative benchmarking, and application-level benchmarking. We also discuss the future trend for quantum computer’s benchmarking and propose setting up the QTOP100.

Beyond Bits: A Review of Quantum Embedding Techniques for Efficient Information Processing

“…For instance, IBM scientists introduced an end-to-end quantum error correction (QEC) protocol that implements fault-tolerant memory based on a family of low-density parity check (LDPC) codes with a high encoding rate that achieves an error threshold of 0.8% for the standard circuit-based noise model [157]. In addition, some applications, such as QEC firmware and "Surface Code" techniques are designed to mitigate gate errors and improve overall accuracy [43], [158], [159]. Also, recently, the Fluxonium-Transmon-Fluxonium (FTF) architecture has showcased a single-qubit gate fidelity of 99.99% and a two-qubit gate fidelity of 99.90% [160].…”

Benchmarking Simulated and Physical Quantum Processing Units Using Quantum and Hybrid Algorithms

“…For more information on the current state of quantum benchmarking, ref. [65] provides an excellent summary of many benchmarking papers. In that paper, Wang et al separate quantum benchmarks into three classes: physical, aggregative, and application-level.…”

A Bird's Eye View on Quantum Computing: Current and Future Trends

“…Besides readout, also gate operations open up higher chances for qubit's decoherence when modifying its state. These operations introduce errors during the computation, which can accumulate during the quantum circuit's execution [45]. Therefore, the result of the elaboration may significantly differ from the ideal desired state, as the probability of getting the correct results diminishes exponentially with the number of applied gates [5].…”