Reinventing High Performance Computing: Challenges and Opportunities

Abstract

The world of computing is in rapid transition, now dominated by a world of smartphones and cloud services, with profound implications for the future of advanced scientific computing. Simply put, highperformance computing (HPC) is at an important inflection point. For the last 60 years, the world's fastest supercomputers were almost exclusively produced in the United States on behalf of scientific research in the national laboratories. Change is now in the wind. While costs now stretch the limits of U.S. government funding for advanced computing, Japan and China are now leaders in the bespoke HPC systems funded by government mandates. Meanwhile, the global semiconductor shortage and political battles surrounding fabrication facilities affect everyone. However, another, perhaps even deeper, fundamental change has occurred. The major cloud vendors have invested in global networks of massive scale systems that dwarf today's HPC systems. Driven by the computing demands of AI, these cloud systems are increasingly built using custom semiconductors, reducing the financial leverage of traditional computing vendors. These cloud systems are now breaking barriers in game playing and computer vision, reshaping how we think about the nature of scientific computation. Building the next generation of leading edge HPC systems will require rethinking many fundamentals and historical approaches by embracing end-to-end co-design; custom hardware configurations and packaging; large-scale prototyping, as was common thirty years ago; and collaborative partnerships with the dominant computing ecosystem companies, smartphone and cloud computing vendors.

Editorial: Neuroscience, computing, performance, and benchmarks: Why it matters to neuroscience how fast we can compute

“…The unsure future of CMOS scaling will present the neural simulation community with an even broader set of architectures beyond CPUs and GPUs. There is an increasing trend toward more specialized components, particularly those that enable artificial intelligence applications such as artificial neural networks (Reed et al, 2022 ). We hope that such specialization may also enable simulations of biological neural networks without too many adaptations.…”

Lattice QCD and the Computational Frontier

“…A worrying trend is also identified in a recent preprint [50], which notes that innovation in the design of computing devices is now much more heavily influenced by the needs of mobile-phone companies and cloud data centers and their associated services than by Governments due to the enormous financial power wielded by the leading corporations compared to levels of investment which Governments can bring to bear. The paper also notes "Talent is following the money and the opportunities, which are increasingly in a small number of very large companies or creative startups".…”

Massively Parallel Fragment-Based Quantum Chemistry for Large Molecular Systems: The Serestipy Software

“…This type of calculations, however, is often limited by the capacity and availability of the chosen HPC center. As the internet has seen a drastic development in the last years [5][6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21] these limitations can be mitigated by deploying QC software into the available cloud infrastructure [22][23][24]. Cloud-based QC opens the possibility to dynamically scale the needed resources depending on the system of interest.…”