A visual modality for the augmentation of paper

McGee, David; Pavel, Misha; Adami, André Gustavo; Wang, Guoping; Cohen, Philip R.

doi:10.1145/971478.971480

“…The Outpost allows users to construct an affinity diagram rapidly by labeling Post-its, connecting them with arcs by drawing lines between Post-its, and rearranging the nodes on the diagram by moving the notes themselves. Similarly, a visionenabled Rasa [10] can track the Post-its, allowing them to be moved about the map without needing a touch-sensitive surface. Rasa's ability to recognize the spoken and written language during task execution, thereby attributing new meaning in the computational system that reflects those established on paper distinguishes it from these systems.…”

Section: Related Workmentioning

confidence: 99%

Comparing paper and tangible, multimodal tools

McGee

¹

,

Cohen

²

,

Wesson

³

et al. 2002

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

In command posts, officers maintain situational awareness using paper maps. Post-it notes, and hand-written annotations. They do so because paper is robust to failure, it is portable, it offers a flexible means of capturing information, it has ultra-high resolution, and it readily supports face-to-face collaboration. We report herein on an evaluation comparing maps and Post-its with a tangible multimodal system called Rasa. Rasa augments these paper tools with sensors, enabling it to recognize the multimodal language (both written and spoken) that naturally occurs on them. In this study, we found that not only do users prefer Rasa to paper alone, they find it as easy or easier to use than paper tools. Moreover, Rasa introduces no discernible overhead in its operation other than error repair, yet grants the benefits inherent in digital systems. Finally, subjects confirmed that by combining physical and computational tools. Rasa is resistant to computational failure.

show abstract

“…Multimedia feedback is provided throughout Rasa's use; text-to-speech, video projections, and non-speech audio are used so that Rasa is capable of providing feedback even when one mode of communication (e.g., video projection) is unavailable or situationally infeasible. More complete descriptions of Rasa, its architecture, and components can be found in [8,10].…”

Section: How Rasa Workmentioning

confidence: 99%

Comparing paper and tangible, multimodal tools

McGee¹,

Cohen²,

Wesson³

et al. 2002

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Changing Our World, Changing Ourselves - CHI '02

Self Cite

View full text Add to dashboard Cite

In command posts, officers maintain situational awareness using paper maps. Post-it notes, and hand-written annotations. They do so because paper is robust to failure, it is portable, it offers a flexible means of capturing information, it has ultra-high resolution, and it readily supports face-to-face collaboration. We report herein on an evaluation comparing maps and Post-its with a tangible multimodal system called Rasa. Rasa augments these paper tools with sensors, enabling it to recognize the multimodal language (both written and spoken) that naturally occurs on them. In this study, we found that not only do users prefer Rasa to paper alone, they find it as easy or easier to use than paper tools. Moreover, Rasa introduces no discernible overhead in its operation other than error repair, yet grants the benefits inherent in digital systems. Finally, subjects confirmed that by combining physical and computational tools. Rasa is resistant to computational failure.

show abstract

“…Arbitrary physical props are commonly used to communicate information between two or more people [25,26]. Physical props can be used to help express situations or scenarios by acting as placeholders for the real objects that they represent.…”

mentioning

confidence: 99%

Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users

Stafford

¹

,

Piekarski

²

,

Thomas

³

2006

2006 IEEE/ACM International Symposium on Mixed and Augmented Reality

View full text Add to dashboard Cite

This paper presents a new interaction metaphor we have termed "god-like interaction". This is a metaphor for improved communication of situational and navigational information between 1INTRODUCTION When performing specialised operations such as search and rescue, there are people located at indoor control rooms who typically oversee and manage the situation with a high-level understanding of the situation. People working out in the field act as sensors and have a more local understanding of the situation but may not be aware of the bigger picture as it develops. Currently, communication between participants is typically achieved using basic verbal communication via radio. With a large number of people in the field, managing this communication is quite complex, and tools to make this more effective are always desired. With the availability of outdoor augmented reality (AR) systems and indoor tabletop projector display systems, how can we combine these technologies to improve collaboration between indoor and outdoor users? AR systems are mainly focussed on presenting information to a single user, and to be used as a tool for collaboration, appropriate interaction metaphors and user interfaces need to be developed.In this paper, we propose a new interaction metaphor god-like interaction that facilitates improved communication of situational and navigational information between indoor users equipped with tabletop displays, and outdoor users equipped with mobile AR systems. We have based our interactions on the capabilities of mythical god-like characters portrayed in popular culture such as the computer game Populous, where a god-like creature controls a miniature isometric view of the world, and the mini-series The Stand, in which the hand of god comes out of the sky to interact with the environment. With our new AR metaphor, indoor users work with a tabletop display that is a miniature virtual representation of the outdoor world with the same top-down perspective a god-like character would possess. Indoor users use their god-like powers to point to objects in the tabletop world, and place physical props on the table to create new life-sized objects to be experienced by AR users outdoors. Outdoor users see these changes in real-time and experience these interactions as though they are

show abstract

A visual modality for the augmentation of paper

Cited by 11 publications

References 21 publications

Comparing paper and tangible, multimodal tools

Comparing paper and tangible, multimodal tools

Comparing paper and tangible, multimodal tools

Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users

Contact Info

Product

Resources

About