“…The vast majority of published benchmarking work in QA considers application-level tests [3,[53][54][55] using models with more than 100 qubits, which presents significant challenges for validation by comparison to the classical simulation of ideal (noise-free) quantum systems. Consequently, the bulk of this application benchmarking work compares the performance of quantum annealing hardware to classical methods, like Simulated Annealing [56], Parallel Tempering [57,58] and Integer Programming [3,59].…”