IOPin: Runtime Profiling of Parallel I/O in HPC Systems

Kim, Seong Jo; Son, Seung Woo; Liao, Wei-keng; Kandemir, Mahmut; Thakur, Rajeev; Choudhary, Alok

doi:10.1109/sc.companion.2012.14

Cited by 15 publications

(2 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The authors report on Pin's applicability and effectiveness by demonstrating program analysis tools developed under Pin, including Opcodemix that determines the dynamic mix of opcodes for a particular execution of a program, and PinPoints that automates the process of finding program regions to simulate. Diverse applications and research work for program analysis have been developed following the Pin approach, which includes program state checkpointing and replay for profiling, analysis of parallel programs, and multicore simulation …”

Section: Dynamic Techniques: Case Studiesmentioning

confidence: 99%

Function call interception techniques

Kang¹

2017

Softw Pract Exp

View full text Add to dashboard Cite

Function call interception (FCI), or method call interception (MCI) in the object-oriented programming domain, is a technique of intercepting function calls at program runtime. Without directly modifying the original code, FCI enables to undertake certain operations before and/or after the called function or even to replace the intercepted call. Thanks to this capability, FCI has been typically used to profile programs, where functions of interest are dynamically intercepted by instrumentation code so that the execution control is transferred to an external module that performs execution time measurement or logging operations. In addition, FCI allows for manipulating the runtime behavior of program components at the fine-grained function level, which can be useful in changing an application's original behavior at runtime to meet certain execution requirements such as maintaining performance characteristics for different input problem sets. Due to this capability, however, some FCI techniques can be used as a basis of many security exploits for vulnerable systems. In this paper, we survey a variety of FCI techniques and tools along with their applications to diverse areas in the computing and software domains. We describe static and dynamic FCI techniques at large and discuss the strengths and weaknesses of different implementations in this category. In addition, we also discuss aspect-oriented programming implementation techniques for intercepting method calls.

show abstract

Section: Dynamic Techniques: Case Studiesmentioning

confidence: 99%

Function call interception techniques

Kang¹

2017

Softw Pract Exp

View full text Add to dashboard Cite

show abstract

“…The ScalaTrace family of MPI tracers focuses on compressed trace generation [32,36,50,54], using histogram generation and a combination of intranode and internode trace compression. Dynamic instrumentation methods include automatically instrumenting at compile time through source code analysis [24], as well as runtime binary instrumentation through IOPin [23], based on the Pin [27] framework.…”

Section: Capturing and Detecting I/o Access Patternsmentioning

confidence: 99%

RADAR: Runtime Asymmetric Data-Access Driven Scientific Data Replication

Jenkins

Zou

Tang

et al. 2014

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. Efficient I/O on large-scale spatiotemporal scientific data requires scrutiny of both the logical layout of the data (e.g., row-major vs. column-major) and the physical layout (e.g., distribution on parallel filesystems). For increasingly complex datasets, hand optimization is a difficult matter prone to error and not scalable to the increasing heterogeneity of analysis workloads. Given these factors, we present a partial data replication system called RADAR. We capture datatype-and collective-aware I/O access patterns (indicating logical access) via MPI-IO tracing and use a combination of coarse-grained and fine-grained performance modeling to evaluate and select optimized physical data distributions for the task at hand. Unlike conventional methods, we store all replica data and metadata, along with the original untouched data, under a single file container using the object abstraction in parallel filesystems. Our system results in manyfold improvements in some commonly used subvolume decomposition access patterns. Moreover, the modeling approach can determine whether such optimizations should be undertaken in the first place.

show abstract