A Shift Selection Strategy for Parallel Shift-invert Spectrum Slicing in Symmetric Self-consistent Eigenvalue Computation

Abstract

The central importance of large-scale eigenvalue problems in scientific computation necessitates the development of massively parallel algorithms for their solution. Recent advances in dense numerical linear algebra have enabled the routine treatment of eigenvalue problems with dimensions on the order of hundreds of thousands on the world's largest supercomputers. In cases where dense treatments are not feasible, Krylov subspace methods offer an attractive alternative due to the fact that they do not require storage of the problem matrices. However, demonstration of scalability of either of these classes of eigenvalue algorithms on computing architectures capable of expressing massive parallelism is non-trivial due to communication requirements and serial bottlenecks, respectively. In this work, we introduce the SISLICE method: a parallel shift-invert algorithm for the solution of the symmetric self-consistent field (SCF) eigenvalue problem. The SISLICE method drastically reduces the communication requirement of current parallel shift-invert eigenvalue algorithms through various shift selection and migration techniques based on density of states estimation and k-means clustering, respectively. This work demonstrates the robustness and parallel performance of the SISLICE method on a representative set of SCF eigenvalue problems and outlines research directions that will be explored in future work.

From NWChem to NWChemEx: Evolving with the Computational Chemistry Landscape

“…In NWChemEx , we adopt the spectrum slicing technique − to design an eigensolver that is more scalable. The basic idea is to divide the desired part of the spectrum into several spectrum slices, each containing roughly the same number of eigenvalues.…”

Scalable Quantum Computation of Highly Excited Eigenstates with Spectral Transforms

“…In practice, prior information on the spectrum may also be required to select a suitable shift σ and normalise H. Well-studied strategies in the context of chemistry such as efficient approximations of the LDOS near the target [61,62] and iterative approaches [63] can be applied for shift selection, while standard VQE can be used to obtain extremal eigenvalues to normalize H.…”