Parallel Computational Steering and Analysis for HPC Applications using a ParaView Interface and the HDF5 DSM Virtual File Driver

The development of supercomputers and multi-scale computational fluid dynamics (CFD) models based on adaptive mesh refinement (AMR) enabled fast, large-scale, and high fidelity CFD simulations. Interactive in situ steering is an effective tool for debugging, searching for optimal solutions, and analyzing inverse problems in such CFD simulations. We propose an interactive in situ steering framework for large-scale CFD simulations on GPU supercomputers. This framework employs in situ particle-based volume rendering (PBVR), in situ data sampling, and a file-based control that enables interactive and asynchronous communication of steering parameters, compressed visualization particle data, and sampled monitoring data between supercomputers and user PCs. The parallelized PBVR is processed on the host CPU to avoid interference with CFD simulations on the GPU. We apply the proposed framework to a real-time plume dispersion analysis code CityLBM, which computes the lattice Boltzmann method on the block AMR grid using GPU supercomputers. In the numerical experiment, we address an inverse problem to find a pollutant source from the observation data at monitoring points and demonstrate the effectiveness of the human-in-the-loop approach via the in situ steering framework. Graphical abstract

show abstract

High end scientific codes with computational I/O pipelines

Zheng

Cao

Dayal

et al. 2011

Proceedings of the 2nd International Workshop on Petascal Data Analytics: Challenges and Opportunities

View full text Add to dashboard Cite

This paper uses computational I/O pipelines to integrate computations into the I/O path that perform data analytics on the data generated by scientific simulations. A novel attribute is the use of a pluggable execution environment in which analysis tools can be orchestrated into a multi-stage pipeline for processing simulation output data. Performance considerations are addressed through the use of a high performance data transport. The approach is evaluated with the end-to-end performance of a Magnetohydrodynamics application at large scale.

show abstract

Parallel Computational Steering and Analysis for HPC Applications using a ParaView Interface and the HDF5 DSM Virtual File Driver

Cited by 4 publications

References 0 publications

Decaf: Decoupled Dataflows for In Situ Workflows

Decaf: Decoupled Dataflows for In Situ Workflows

Interactive steering on in situ particle-based volume rendering framework

High end scientific codes with computational I/O pipelines

Contact Info

Product

Resources

About