COMM notation for specifying collaborative and multimodal interactive systems

In complex systems such as cockpits or unmanned systems, operators manage a set of tasks with high temporal dynamics. Frequent changes of situation within the same mission can sometimes induce a loss of operators' Situation Awareness.In this paper, we introduce a methodology for design of Human-Computer Interfaces in dynamic systems taking into account the situation elements constituting operators' activity. We follow a user-centered approach; end-users and domain experts are included along the different steps of this model-based design process.The complete methodology is presented here, from initial task & situation modeling, through transition analysis, to the final recommendations on interface design, applied to an illustrative example.

show abstract

“…• Finally, in order to address collaborative and multimodal systems, we may study the use of CTT extensions such as COMM [14].…”

Section: Discussionmentioning

confidence: 99%

Modeling task transitions to help designing for better situation awareness

Villaren¹,

Coppin

Leal³

2012

Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems

View full text Add to dashboard Cite

show abstract

“…Cummings et al [9] describe the use of sketch for planning UAS missions but did not discuss any possible negative consequences or how multiple users would use sketch. Guo et al [10] allowed users to cooperatively plan missions using multi-touch on a table surface interface, while Jourde el al [11] focuses on a design notation for multi-touch control for generating plans; neither consider vehicle safety. Speechbased interfaces to allow a mission specialist to work with small UAVs have either considered speech for mission scenarios where manual or visual interaction is not possible [12], speech in terms of improving speech understanding, not enabling audio communication [13], or speech acts as the framework for reasoning and problem-solving [14].…”

Section: Related Workmentioning

confidence: 99%

Safety considerations for small Unmanned Aerial Systems with distributed users

Duncan

Murphy

2014

2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014)

View full text Add to dashboard Cite

Abstract-This paper identifies three categories of safety risks posed by allowing multiple users to engage with small Unmanned Aerial Systems (sUAS) and offers five recommendations on how to reduce or mitigate these vulnerabilities. Data from sUAS can benefit multiple experts at a disaster who may not be familiar with robots or colocated with the pilot. Two different styles of interfaces have been developed and tested with responders conducting exercises to facilitate team coordination with a quadrotor at Texas A&M Engineering Extension Service's Disaster City R over a four year period. The two interfaces illustrate three distinct categories of safety concerns: unsafe control regimes, loss of situation awareness, and increased stress. Five recommendations are proposed to mitigate or eliminate the safety concerns: separate the payload camera from the platform, giving the pilot a dedicated "pilot-cam" and the experts a fully gimbaled payload; use artificial intelligence to resolve conflicts between competing directives from multiple experts; allow the pilot, or a software agent, to turn off the expert's ability to control or communication; use multi-modal warnings rather than rely on visual cues; and add guarded motion to prevent collisions.

show abstract

“…The COMM task model notation [18] illustrates this by allowing specification of modalities or interaction devices in modal tasks, which are leaves in the task tree. They are mostly used as a first step in designing an application to identify the tasks and later actions that have to be performed to reach a certain goal.…”

Section: Formal Artifactsmentioning

confidence: 99%

Using Storyboards to Integrate Models and Informal Design Knowledge

Haesen

Bergh

Meskens

et al. 2011

Studies in Computational Intelligence

View full text Add to dashboard Cite

Model-driven development of user interfaces has become increasingly powerful in recent years. Unfortunately, model-driven approaches have the inherent limitation that they cannot handle the informal nature of some of the artifacts used in truly multidisciplinary user interface development such as storyboards, sketches, scenarios and personas. In this chapter, we present an approach and tool support for multidisciplinary user interface development bridging informal and formal artifacts in the design and development process. Key features of the approach are the usage of annotated storyboards, which can be connected to other models through an underlying meta-model, and cross-toolkit design support based on an abstract user interface model.

show abstract

COMM notation for specifying collaborative and multimodal interactive systems

Cited by 22 publications

References 30 publications

Modeling task transitions to help designing for better situation awareness

Modeling task transitions to help designing for better situation awareness

Safety considerations for small Unmanned Aerial Systems with distributed users

Using Storyboards to Integrate Models and Informal Design Knowledge

Contact Info

Product

Resources

About