Adaptive techniques for clustered N-body cosmological simulations

Abstract

CHANGA is an N-body cosmology simulation application implemented using CHARM++. In this paper, we present the parallel design of CHANGA and address many challenges arising due to the high dynamic ranges of clustered datasets. We propose optimizations based on adaptive techniques. We evaluate the performance of CHANGA on highly clustered datasets: a z ∼ 0 snapshot of a 2 billion particle realization of a 25 Mpc volume, and a 52 million particle multi-resolution realization of a dwarf galaxy. For the 25 Mpc volume, we show strong scaling on up to 128K cores of Blue Waters. We also demonstrate scaling up to 128K cores of a multi-stepping run of the 2 billion particle simulation. While the scaling of the multi-stepping run is not as good as single stepping, the throughput at 128K cores is greater by a factor of 2. We also demonstrate strong scaling on up to 512K cores of Blue Waters for two large, uniform datasets with 12 and 24 billion particles.

Off the beaten path: a new approach to realistically model the orbital decay of supermassive black holes in galaxy formation simulations

“…We use the new N-body + SPH code ChaNGa (Menon et al 2015), which includes all of the physics modules previously implemented in Gasoline (Wadsley et al 2004) such as hydrodynamics, gas cooling, a cosmic UV background, star formation and SNe feedback. The 'zoomedin' approach preserves the large scale tidal field while allow- .…”

Gravitational Focusing and the Star Cluster Initial Mass Function

“…To test the scenario of purely gravitational accretion, we use the ChaNGa (Charm N-body GrAvity solver) code (Jetley et al 2008;Menon et al 2015). Since ChaNGa is a cosmological code, using the "dark matter" particle implementation ensures that all interactions are purely gravitational, with no gas physics included.…”

A New Signal Model for Axion Cavity Searches from N-body Simulations

“…ChaNGa is part of the AGORA (Kim et al 2014) code comparison collaboration. The code base has been thoroughly tested and has contributed to many astronomical topics including DM candidate testing (Purcell et al 2011;Menon et al 2015;Fry et al 2015;Kim et al 2016;Tomozeiu et al 2016;Pontzen et al 2017;Tremmel et al 2016;Anderson et al 2016) 3 . R25 is large enough that it has O(30) MW-mass halos at z=0.…”