A survey was used to obtain information on the processes and methods used by simulation experts in real projects. The 102 survey respondents answered questions about their most recent simulation project. This paper presents some of the survey results, focussing mainly on conceptual modelling and the pattern of time allocation to different topics. There are a wide range of findings that include the modellers making changes to the initial conceptual model during subsequent tasks in most of the projects usually by adding complexity, model coding taking on average about twice the time of other topics, and the topics generally occurring in single blocks of time (at the resolution of the survey data collection) but with considerable overlaps. The resultsgive an insight into the way experts approach simulation projects and their problem solving strategies. A potential application is in training novice modellers, particularly in developing 'craft skills'. The results also provide an empirical basis for further research, especially in conceptual modelling.Keywords: simulation; practice of OR; OR education; conceptual modelling; modelling process
IntroductionIn an article in Operations Research, Willemain (1995) wrote: '… the important issues of how analysts proceed in practice have so far not been studied and understood in a systematic way.While the OR community presses on with its traditional business of developing and applying new methods, it must also attend to metamodeling issues and the larger subject of an epistemology of practice …', and he also quoted Gass (1987): 'We need to get away from the crutch that modeling is an art.' In order to start to address these issues, Willemain's (1995) study looked at the model formulation step in the first hour of tackling an Operational Research (OR) problem, and the approach taken was the use of think aloud protocols to capture and then analyse the thoughts of experts. This produced valuable data and novel insights into what actually happens in the first part of the modelling process. For example, one result was that there was a lot of switching between the different topics, particularly between developing the model (model structure) and evaluating it (model assessment). In other words, the experts often thought about some aspects of how the problem could be modelled, then critically evaluated the ideas, and then further revised or developed the model.
2We also believe that it is very important for research in OR to include the study of the process of OR and that a good way of doing this is to understand, analyse and learn from the ways of working of expert OR practitioners. However, in the many years since Willemain's paper very little further work has been done in this area and, in our view, his comments still apply.There is a need for empirical data of what happens in practice on OR projects in order to start to understand the procedures, approaches and strategies used.An important potential application is to use this information in the education and training of s...