Applying Cognitive Theories to Evaluate Conceptual Models in Systems Analysis

Abstract

Conceptual models have been evaluated along the dimensions of modeling complexity (how easy is it to create schemas given requirements?) and readability (how easy is it to understand the requirements by reading the model schema?). In this work, we update COGEVAL, a propositional framework based on cognitive theories to evaluate conceptual models. We synthesize work from cognitive literature to develop the framework, and show how it can be used to explain earlier empirical results as well as existing theoretical frameworks. We illustrate how COGEVAL can be used as a theoretical basis to design an empirical test of readability of a conceptual model. Unlike much of the earlier empirical work on readability, our approach isolates the effect of a model-independent variable (degree of fragmentation) on readability. From a practical perspective, our findings will have implications for both creators of new models and practitioners who use currently available models to create schemas.

The Structured Process Modeling Theory (SPMT) a cognitive view on why and how modelers benefit from structuring the process of process modeling

“…This is called cognitive overload (Sweller 1988). The Cognitive Load Theory states that when working memory is overloaded, there is no room for learning (i.e., schema building) and accuracy and speed of information processing decrease (Rockwell and Bajaj 2005;Sweller 1988). In other words, cognitive overload has a negative impact on the effectiveness and efficiency of the modeling performance.…”

“…The SPMT is novel because it combines several existing cognitive theories in a fundamental new way. The consideration of the first part of the SPMTdescribing how serialization of the modeling effort helps reducing intrinsic cognitive load -has been touched before (Rockwell and Bajaj 2005;Soffer et al 2012). Yet, the idea of structuring the construction process of the process model (i.e., the second part of the SPMT) seems more original, although structuredness of the outcome of such a construction process is well studied (Laue and Mendling 2010;Zugal et al 2013).…”

“…Serialization Rockwell and Bajaj (2005) propose the COGEVAL framework that consists of a collection of 8…”

“…Throughout this complex task the modeler is hindered by his cognitive limits, which results in cognitive ineffectiveness that can be manifested by a decrease of accuracy and speed (Rockwell and Bajaj 2005;Sweller, 1988). Therefore, the end goal of our research is to help the modeler to reduce these negative effects by developing a method for process modeling that should warrant the optimal use of a modeler's cognitive functions.…”

The Structured Process Modeling Method (SPMM) what is the best way for me to construct a process model?

“…Hence, researchers have built a large body of knowledge about the quality of conceptual (process) models [6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21]. Nevertheless, research about operational guidance on how to create high quality process models appears to be limited to the development of general guidelines about the ideal properties of produced models [22][23][24][25] and to the spontaneous description of best practices that emerged among process modeling experts [26,27].…”