SANLab-CM: A tool for incorporating stochastic operations into activity network modeling

Patton, Evan W.; Gray, Wayne D.

doi:10.3758/brm.42.3.877

Cited by 21 publications

(16 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another factor is normal variation in all human performance between and within individuals (e.g., slower performance when fatigued, faster after having drunk a cup of coffee, etc.). HCI research is just beginning to explore modeling tools that predict the latter (e.g., [22]), but our implementation of HPRT is the first we know of to make it easy to predict the former. Until validation research progresses in HCI, it is premature to proclaim that the results such as those in Table II and the histograms should be trusted to make important UI design decisions.…”

Section: Further Discussion and Future Workmentioning

confidence: 99%

Human performance regression testing

Swearngin¹,

Cohen²,

John³

et al. 2013

2013 35th International Conference on Software Engineering (ICSE)

View full text Add to dashboard Cite

Abstract-As software systems evolve, new interface features such as keyboard shortcuts and toolbars are introduced. While it is common to regression test the new features for functional correctness, there has been less focus on systematic regression testing for usability, due to the effort and time involved in human studies. Cognitive modeling tools such as CogTool provide some help by computing predictions of user performance, but they still require manual effort to describe the user interface and tasks, limiting regression testing efforts. In recent work, we developed CogTool-Helper to reduce the effort required to generate human performance models of existing systems. We build on this work by providing task specific test case generation and present our vision for human performance regression testing (HPRT) that generates large numbers of test cases and evaluates a range of human performance predictions for the same task. We examine the feasibility of HPRT on four tasks in LibreOffice, find several regressions, and then discuss how a project team could use this information. We also illustrate that we can increase efficiency with sampling by leveraging an inference algorithm. Samples that take approximately 50% of the runtime lose at most 10% of the performance predictions.

show abstract

Section: Further Discussion and Future Workmentioning

confidence: 99%

Human performance regression testing

Swearngin¹,

Cohen²,

John³

et al. 2013

2013 35th International Conference on Software Engineering (ICSE)

View full text Add to dashboard Cite

show abstract

“…Of the various approaches to task analysis (e.g., Crandall, Klein, & Hoffman, 2006), and in particular the GOMS family (John & Kieras, 1996), the CPM-GOMS approach (Vera, John, Remington, Matessa, & Freed, 2005) is chosen here, because it facilitates the exploration of how different control mechanisms affect the ordering and timing of operations in terms of different critical paths for participants. The variants of the GPoMS model were initially explored using SANLab (Patton & Gray, 2010), which is a convenient tool for constructing critical path models of cognitive processes.…”

Section: Task Analytic Modelsmentioning

confidence: 99%

Combinations of Simple Mechanisms Explain Diverse Strategies in the Freehand Writing of Memorized Sentences

Cheng

Genuchten

2018

Cognitive Science

View full text Add to dashboard Cite

Individual differences in the strategies that control sequential behavior were investigated in an experiment in which participants memorized sentences and then wrote them by hand, in a non-cursive style. Thirty-two participants each wrote eight sentences, which had hierarchical structures with five levels. The dataset included over 31,000 letters. Despite the deliberately constrained nature of the task and stimuli, 23 patterns of behavior were identified from the durations of pauses that occurred before the inscription of letters at four chunk levels, spanning letters, words, phrases, and sentences. A critical path task analytic model, Graphical Production of Memorized Sentences (GPoMS), shows that the control of writing relies on cues that continuously switch between motor actions and chunk retrievals in a just-in-time fashion at the level of letter information. GPoMS explains the individual differences in terms of variants of a motor production mechanism and variants of a chunk retrieval mechanism, which involve varying degrees of parallelism between cognitive actions and motor actions. A graphical technique for constructing GPoMS models was developed that enabled the estimation of ongoing working memory demands during production.

show abstract

“…The Stochastic Activity Network Laboratory for Cognitive Modeling (SANLab, Patton & Gray, 2010) is a tool that incorporates stochastic operations into activity network formalism (also open source and available from http://cogworks.cogsci.rpi.edu/node/1/release). A SANLab model is essentially a runnable network of cognitive, perceptual, and motor operations.…”

Section: Two Tools: Cogtool and Sanlabmentioning

confidence: 99%

Tools for Predicting the Duration and Variability of Skilled

John

Patton²,

Gray

et al. 2012

Proceedings of the Human Factors and Ergonomics Society Annual

Self Cite

View full text Add to dashboard Cite

Many devices are designed to allow skilled users to complete routine tasks quickly, often within a specified amount of time. Predictive human performance modeling has long been able to predict the mean time to accomplish a task, making it possible to compare device designs before building them. However, estimates of the variability of performance are also important, especially in real-time, safety-critical tasks. Until recently, the human factors community lacked tools to predict the variability of skilled performance. In this paper, we describe a combination of theory-based tools (CogTool and SANLab) that address this critical gap and that can easily be used by human factors practitioners or system designers. We describe these tools, their integration, and provide a concrete example of their use in the context of entering the landing speed into the Boeing 777 Flight Management Computer (FMC) using the Control and Display Unit (CDU).

show abstract

SANLab-CM: A tool for incorporating stochastic operations into activity network modeling

Cited by 21 publications

References 19 publications

Human performance regression testing

Human performance regression testing

Combinations of Simple Mechanisms Explain Diverse Strategies in the Freehand Writing of Memorized Sentences

Tools for Predicting the Duration and Variability of Skilled

Contact Info

Product

Resources

About