Multimodal maps: An agent-based approach

Cheyer, Adam; Julia, Luc

doi:10.1007/bfb0052316

Cited by 43 publications

(25 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Subsequent sections provide detailed descriptions of the inner workings of OAA. Whereas the motivating concepts for an early version of OAA were presented in Cohen et al, 1994, and certain OAA-based systems have been described in Cheyer and Julia, 1995;Martin et al, 1996;Moore et al, 1996;Moran and Cheyer, 1995, this is the rst paper to present a detailed technical explanation of the system-building resources provided by OAA.…”

Section: Introductionsupporting

(Expert classified)

The open agent architecture: A framework for building distributed software systems

Martin

Cheyer

Moran

1999

Applied Artificial Intelligence

321

168

View full text Add to dashboard Cite

The Open Agent Architecture OAA, developed and used for several years at SRI International, makes it possible for software services to be provided through the cooperative e orts of distributed collections of autonomous agents. Communication and cooperation between agents are brokered by one or more facilitators, which are responsible for matching requests, from users and agents, with descriptions of the capabilities of other agents. Thus, it is not generally required that a user or agent know the identities, locations, or number of other agents involved in satisfying a request. OAA is structured so as to minimize the e ort involved in creating new agents and wrapping" legacy applications, written in various languages and operating on various platforms; to encourage the reuse of existing agents; and to allow for dynamism and exibility i n the makeup of agent communities. Distinguishing features of OAA as compared with related work include extreme exibility in using facilitator-based delegation of complex goals, triggers, and data management requests; agent-based provision of multimodal user interfaces; and built-in support for including the user as a privileged member of the agent community. This paper explains the structure and elements of agent-based systems constructed using OAA. The characteristics and use of each major component o f O AA infrastructure are described, including the agent library, the Interagent Communication Language, capabilities declarations, service requests, facilitation, management of data repositories, and autonomous monitoring using triggers. To provide technical context, we describe the motivations for OAA's design, and situate its features within the realm of alternative software paradigms. A summary is given of OAA-based systems built to date, and brief descriptions are given of several of these.2

show abstract

Section: Introductionsupporting

(Expert classified)

The open agent architecture: A framework for building distributed software systems

Martin

Cheyer

Moran

1999

Applied Artificial Intelligence

321

168

View full text Add to dashboard Cite

show abstract

“…Multimodal Maps is a map-based application for travel planning that combines handwriting, gesture, and speech input [4]. AT&T's MATCH provides a multimodal interface for mobile information access with spoken and graphical interaction [7].…”

Section: Current Multimodal Map Applicationsmentioning

confidence: 99%

An interface for mutual disambiguation of recognition errors in a multimodal navigational assistant

Lieberman

Chu

2006

Multimedia Systems

View full text Add to dashboard Cite

Users often have tasks that can be accomplished with the aid of multiple media -for example with text, sound and pictures. For example, communicating an urban navigation route can be expressed with pictures and text. Today's mobile devices have multimedia capabilities; cell phones have cameras, displays, sound output, and (soon) speech recognition. Potentially, these multimedia capabilities can be used for multimediaintensive tasks, but two things stand in the way. First, recognition of visual input and speech recognition still remain unreliable. Second, the mechanics of integrating multiple media and recognition systems remains daunting for users. We address both these issues in a system, MARCO, multimodal agent for route construction. MARCO collects route information by taking pictures of landmarks, accompanied by verbal directions. We combine results from off-the-shelf speech recognition and optical character recognition to achieve better recognition of route landmarks than either recognition system alone. MARCO automatically produces an illustrated, step-by-step guide to the route.

show abstract

“…One of the pioneering mobile systems to utilise agent technology was TravelMATE (Cheyer and Julia, 1995), a prototype system developed by SRI International as part of their research into multi-modal user interfaces. More recently, several agent-based location-aware services have emerged, for example, Impulse (Youll et al, 2000), Mia (Buester et al, 2000) and ComMotion (Marmasse and Schmadt, 2000).…”

Section: Intelligent Agentsmentioning

confidence: 99%

Mobile agents for mobile tourists: a user evaluation of Gulliver's Genie

O’Grady

O’Hare

Sas

2005

Interacting with Computers

View full text Add to dashboard Cite

How mobile computing applications and services may be best designed, implemented and deployed remains the subject of much research. One alternative approach to developing software for mobile users that is receiving increasing attention from the research community is that of one based on intelligent agents. Recent advances in mobile computing technology have made such an approach feasible. We present an overview of the design and implementation of an archetypical mobile computing application, namely that of an electronic tourist guide. This guide is unique in that it comprises a suite of intelligent agents that conform to the strong intentional stance. However, the focus of this paper is primarily concerned with the results of detailed user evaluations conducted on this system. Within the literature, comprehensive evaluations of mobile context-sensitive systems are sparse and therefore, this paper seeks, in part, to address this deficiency. q

show abstract

Multimodal maps: An agent-based approach

Cited by 43 publications

References 7 publications

The open agent architecture: A framework for building distributed software systems

The open agent architecture: A framework for building distributed software systems

An interface for mutual disambiguation of recognition errors in a multimodal navigational assistant

Mobile agents for mobile tourists: a user evaluation of Gulliver's Genie

Contact Info

Product

Resources

About