BigSim: a parallel simulator for performance prediction of extremely large parallel machines

Zheng, Gengbin; Kakulapati, Gunavardhan; Kalé, Laxmikant V.

doi:10.1109/ipdps.2004.1303013

Cited by 72 publications

(12 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Many simulation frameworks have been developed for parallel and distributed computing research and development. They span domains such as HPC [18,19,20,21], Grid [22,23,24], Cloud [25,26,27], Peer-to-peer [28,29], or Volunteer Computing [30,31,32]. Some frameworks have striven to be applicable across some or all or the above domains [33,34].…”

Section: Related Workmentioning

confidence: 99%

“…Simulation is used in many computer science domains and can address the limitations of real-world experiments outlined above. Several simulation frameworks have been developed that target the parallel and distributed computing domain [18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34]. Some simulation frameworks have also been developed specifically for the scientific workflow domain [35,36,37,11,38,39,40].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Developing accurate and scalable simulators of production workflow management systems with WRENCH

Casanova

Silva

Tanaka

et al. 2020

Future Generation Computer Systems

View full text Add to dashboard Cite

Scientific workflows are used routinely in numerous scientific domains, and Workflow Management Systems (WMSs) have been developed to orchestrate and optimize workflow executions on distributed platforms. WMSs are complex software systems that interact with complex software infrastructures. Most WMS research and development activities rely on empirical experiments conducted with full-fledged software stacks on actual hardware platforms. These experiments, however, are limited to hardware and software infrastructures at hand and can be labor-and/or time-intensive. As a result, relying solely on real-world experiments impedes WMS research and development. An alternative is to conduct experiments in simulation. In this work we present WRENCH, a WMS simulation framework, whose objectives are (i) accurate and scalable simulations; and (ii) easy simulation software development. WRENCH achieves its first objective by building on the SimGrid framework. While SimGrid is recognized for the accuracy and scalability of its simulation models, it only provides low-level simulation abstractions and thus large software development efforts are required when implementing simulators of complex systems. WRENCH thus achieves its second objective by providing high-level and directly re-usable simulation abstractions on top of SimGrid. After describing and giving rationales for WRENCH's software architecture and APIs, we present two case studies in which we apply WRENCH to simulate the Pegasus production WMS and the WorkQueue application execution framework. We report on ease of implementation, simulation accuracy, and simulation scalability so as to determine to which extent WRENCH achieves its objectives. We also draw both qualitative and quantitative comparisons with a previously proposed workflow simulator.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Developing accurate and scalable simulators of production workflow management systems with WRENCH

Casanova

Silva

Tanaka

et al. 2020

Future Generation Computer Systems

View full text Add to dashboard Cite

show abstract

“…Concerning discrete event simulation software, there are many options available. For distributed systems, for instance, there are BigSim (Zheng et al, 2004), LAM-MPS (Plimpton, 1995), xSim (Böhm and Engelmann, 2011) and LogGOPSim (Hoefler et al, 2010), among others. In turn, ARENA has embedded components such as resource allocation, queue management, and failure modules, which simplify the modeling of both DaSP system topology and the CCRR strategy.…”

Section: Related Workmentioning

confidence: 99%

Evaluating the impact of a coordinated checkpointing in distributed data streams processing systems using discrete event simulation

Moraes¹,

Gradvohl²

2020

RBCA

View full text Add to dashboard Cite

Data Streams Processing systems process continuous flows of data under Quality of Service requirements. Data streams often contain critical information which requires real-time processing. To guarantee systems' dependability and avoid information loss, one must use a fault-tolerance strategy. However, there are several strategies available, and the proper evaluation of which mechanism is better for each system architecture is challenging, especially in large-scale distributed systems. In this paper, we propose a discrete simulation model for investigating the impacts of the Coordinated Checkpoint fault tolerance strategy imposes on Data Stream Processing Systems. Results show that this strategy critically affects stream processing in failure-prone situations due to an increase in latency up to 120% and information loss, reaching 95% of the processing window in the worst case.

show abstract

“…Design of large-scale parallel systems drives largescale simulation environments. Recent representative platforms are BigSim [24] and NSIM (OpenNSIM) [25], [26]. Literature [7] also reports MPI implementation of an ICN simulator.…”

Section: Acceleration Techniques For Icn Simulationmentioning

confidence: 99%

Accelerating Large-Scale Interconnection Network Simulation by Cellular Automata Concept

Yokota

Ootsu

Ohkawa

2019

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

State-of-the-art parallel systems employ a huge number of computing nodes that are connected by an interconnection network. An interconnection network (ICN) plays an important role in a parallel system, since it is responsible to communication capability. In general, an ICN shows non-linear phenomena in its communication performance, most of them are caused by congestion. Thus, designing a large-scale parallel system requires sufficient discussions through repetitive simulation runs. This causes another problem in simulating large-scale systems within a reasonable cost. This paper shows a promising solution by introducing the cellular automata concept, which is originated in our prior work. Assuming 2D-torus topologies for simplification of discussion, this paper discusses fundamental design of router functions in terms of cellular automata, data structure of packets, alternative modeling of a router function, and miscellaneous optimization. The proposed models have a good affinity to GPGPU technology and, as representative speed-up results, the GPU-based simulator accelerates simulation upto about 1264 times from sequential execution on a single CPU. Furthermore, since the proposed models are applicable in the shared memory model, multithread implementation of the proposed methods achieve about 162 times speed-ups at the maximum.

show abstract

BigSim: a parallel simulator for performance prediction of extremely large parallel machines

Abstract: We present a parallel simulator - BigSim -

Cited by 72 publications

References 12 publications

Developing accurate and scalable simulators of production workflow management systems with WRENCH

Developing accurate and scalable simulators of production workflow management systems with WRENCH

Evaluating the impact of a coordinated checkpointing in distributed data streams processing systems using discrete event simulation

Accelerating Large-Scale Interconnection Network Simulation by Cellular Automata Concept

Contact Info

Product

Resources

About