Synthesizing representative I/O workloads using iterative distillation

Kurmas, Zachary; Keeton, Kimberly; MacKenzie, Kenneth

doi:10.1109/mascot.2003.1240637

Cited by 19 publications

(19 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The formulaic approach is to require that a representative workload should lead to the same results as the workloads it is supposed to represent [258,704,203,419]. In other words, workload W is representative if using it leads to the same performance evaluation results as would be obtained using other workloads.…”

Section: Measuring Representativenessmentioning

confidence: 99%

“…If we are willing to restrict ourselves to one specific context, it is possible to distill a "representative" workload model [419]. This is done by systematically considering different workload attributes, and checking their effects on performance within the specified context.…”

Section: Measuring Representativenessmentioning

confidence: 99%

“…We therefore typically settle for a definition that a workload is representative if it "looks like" the other workloads it is sup- Idealized process of distilling a representative workload (after [419]). …”

Section: Measuring Representativenessmentioning

confidence: 99%

See 2 more Smart Citations

Workload Modeling for Computer Systems Performance Evaluation

Feitelson

2015

196

131

View full text Add to dashboard Cite

Reliable performance evaluations require the use of representative workloads. This is no easy task since modern computer systems and their workloads are complex, with many interrelated attributes and complicated structures. Experts often use sophisticated mathematics to analyze and describe workload models, making these models difficult for practitioners to grasp. This book aims to close this gap by emphasizing the intuition and the reasoning behind the definitions and derivations related to the workload models. It provides numerous examples from real production systems, with hundreds of graphs. Using this book, readers will be able to analyze collected workload data and clean it if necessary, derive statistical models that include skewed marginal distributions and correlations, and consider the need for generative models and feedback from the system. The descriptive statistics techniques covered are also useful for other domains.

show abstract

Section: Measuring Representativenessmentioning

confidence: 99%

Section: Measuring Representativenessmentioning

confidence: 99%

See 1 more Smart Citation

Workload Modeling for Computer Systems Performance Evaluation

Feitelson

2015

196

131

View full text Add to dashboard Cite

show abstract

“…Many techniques have been proposed to synthesize selfsimilar traffics [40], [41], [42], [28], [29], [38], [43], [44]. For example, two successful methods include Fractional AutoRegressive Integrated Moving Average (FARIMA) and Fractional Brownian Motion (FBM).…”

Section: A Why Use the Alpha-stable?mentioning

confidence: 99%

“…However, FARIMA is not intrinsically bursty. The FBM model used by several researchers [40], [41], [44] is easy to construct and can model the self-similarity under the Gaussian condition, but not the non-Gaussian condition. However, it is important to identify the Gaussian or non-Gaussian property for a given workload [45].…”

Section: A Why Use the Alpha-stable?mentioning

confidence: 99%

Temporal characterization of SPEC CPU2006 workloads: Analysis and synthesis

Zou

Yue

Segee

et al. 2012

2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC)

View full text Add to dashboard Cite

Abstract-SPEC CPU2006 benchmark suite has been extensively studied, with efforts focusing on the requirement understanding of memory workloads from the SPEC CPU2006 suite. However, characterizing SPEC CPU2006 workloads from a time dependence perspective has attracted little attention. This paper studies the auto-correlation functions of the arrival intervals of memory accesses in all SPEC CPU2006 traces, and concludes that correlations in memory inter-access times are inconsistent, either with evident correlations or with little and no correlation. Different with the studies focused on the prior suites, we present that self-similarity exists only in a small number of SPEC2006 workloads. In addition, we implement a memory access series generator in which the inputs are the measured properties of the available trace data. Experimental results show that this model can more accurately emulate the complex access arrival behaviors of real memory systems than the conventional self-similar and independent identically distributed methods, particularly the heavy-tail characteristics under both Gaussian and non-Gaussian workloads.

show abstract

A novel model for synthesizing parallel I/O workloads in scientific applications

Feng

Zou

Jiang

et al. 2008

2008 IEEE International Conference on Cluster Computing

View full text Add to dashboard Cite

Abstract-One of the challenging issues in performance evaluation of parallel storage systems through synthetic-trace-driven simulation is to accurately characterize the I/O demands of data-intensive scientific applications. This paper analyzes several I/O traces collected from different distributed systems and concludes that correlations in parallel I/O inter-arrival times are inconsistent, either with little correlation or with evident and abundant correlations. Thus conventional Poisson or Markov arrival processes are inappropriate to model I/O arrivals in some applications. Instead, a new and generic model based on the α-stable process is proposed and validated in this paper to accurately model parallel I/O burstiness in both workloads with little and strong correlations. This model can be used to generate reliable synthetic I/O sequences in simulation studies. Experimental results presented in this paper show that this model can capture the complex I/O behaviors of real storage systems more accurately and faithfully than conventional models, particularly for the burstiness characteristics in the parallel I/O workloads.

show abstract

Synthesizing representative I/O workloads using iterative distillation

Abstract: Abstract

Cited by 19 publications

References 18 publications

Workload Modeling for Computer Systems Performance Evaluation

Workload Modeling for Computer Systems Performance Evaluation

Temporal characterization of SPEC CPU2006 workloads: Analysis and synthesis

A novel model for synthesizing parallel I/O workloads in scientific applications

Contact Info

Product

Resources

About