No abstract

A multimodal user interface allows users to communicate with computers using multiple modalities, such as a mouse, a keyboard or voice, in various combined ways. This paper discusses a multimodal drawing tool, whereby the user can use a mouse, a keyboard and voice effectively. Also, it describes an interpretation method, by which the system integrates voice inputs and pointing inputs using context.

No abstract

This paper describes the first reported grammatical framework for a nmltimodal interface. Although multimodal interfaces offer the promise of a flexible and user fl'iendly means of human-coml)uter interaction, no study has yet appeared on formal granunatical f'l'ameworks for theln. We have developed Multi-Modal Definite Clause Ch'ammar (MM-I)CG), an extension of Definite Clause Gramumr. The major features of MM-I)CG inch, de eal)ability to handle an arbitrary mlmber of modes and temporal information in grammar rules, l:urther, we have developed MM-DCG translator to transfer rules in MM-DCG into Prolog predicates.

Thispaper describes a High-speed Prolog Machine (HIM) architecture and its hardware structure, which are developed as a product of Fifth Generation Computer System (FGCS} project in Japan. HIM realizes high performance and provides a practical programming environment. A major HIM feature is a large memory capacity and specialized hardware for unification and stack operations.HIM has a compiler-oriented architecture with high-level stack-control instructions. Furthermore, the HIM architecture provides side-effect operations, nonlocal-exit control and multiprocess support primitives, which are effective to develop system programs. The performance is estimated at 280 KLIPS (Kilo Logical Inferences Per Second) in executing a deterministic "concatenate" Prolog program. The HIM processor is implemented with high-speed CCML {Current Mode Logic) chips and with I00 nanosecond machine cycle.