Analysis of Checkpoint I/O Behavior

León, Betzabeth; Gomez-Sanchez, Pilar; Franco, Daniel; Rexachs, Dolores; Luque, Emilio

doi:10.1007/978-3-030-50371-0_14

Cited by 3 publications

(1 citation statement)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The number of checkpoints to be performed on an application is often related to the maximum overhead you want to introduce into the application. If we know the maximum overhead that the user can allow and the overhead that a checkpoint introduces, we can calculate the number of checkpoints to be performed [2]. This overhead is heavily dependent on I/O operations.…”

Section: Introductionmentioning

confidence: 99%

A model of checkpoint behavior for applications that have I/O

et al. 2022

Self Cite

View full text Add to dashboard Cite

Due to the increase and complexity of computer systems, reducing the overhead of fault tolerance techniques has become important in recent years. One technique in fault tolerance is checkpointing, which saves a snapshot with the information that has been computed up to a specific moment, suspending the execution of the application, consuming I/O resources and network bandwidth. Characterizing the files that are generated when performing the checkpoint of a parallel application is useful to determine the resources consumed and their impact on the I/O system. It is also important to characterize the application that performs checkpoints, and one of these characteristics is whether the application does I/O. In this paper, we present a model of checkpoint behavior for parallel applications that performs I/O; this depends on the application and on other factors such as the number of processes, the mapping of processes and the type of I/O used. These characteristics will also influence scalability, the resources consumed and their impact on the IO system. Our model describes the behavior of the checkpoint size based on the characteristics of the system and the type (or model) of I/O used, such as the number I/O aggregator processes, the buffering size utilized by the two-phase I/O optimization technique and components of collective file I/O operations. The BT benchmark and FLASH I/O are analyzed under different configurations of aggregator processes and buffer size to explain our approach. The model can be useful when selecting what type of checkpoint configuration is more appropriate according to the applications’ characteristics and resources available. Thus, the user will be able to know how much storage space the checkpoint consumes and how much the application consumes, in order to establish policies that help improve the distribution of resources.

show abstract

Section: Introductionmentioning

confidence: 99%