关键词: 用户界面, 多通道界面, 界面模型, 界面描述方法, 界面范式, 多通道整合, 用户界面, 多通道界面, 界面模型, 界面描述方法, 界面范式, 多通道整合

Abstract: Multimodal Interfaces employ many kinds of interactive devices, such as speech input/output, pointing, gazetracking, and tactile and force feedback devices, make them cooperate with each other and take the advantage of their complementarily so as to facilitate the communication between user and computer, increase the efficiency of interaction, enhance its naturalness and ultimately make it possible for computer-naive people to interact with computers using their everyday skills. This paper summarizes part of the work completed in the key project Multimodal User Interface Research supported by National Natural Science Foundations of China. First, we described its concepts, advantages and some terminologies, then proposed an Architecture and integration for Task Oriented Multimodality (ATOM) model, a Hierarchical Multimodal Interface Specification (HMIS) method, and a new interface paradigm (VIR-Virtual Information Room). Finally, two case studies developed under way and conclusion are given.

Key words: user interface, multimodal interface, user interface model, user interface specification method, user interface paradigm, multimodal intergration, user interface, multimodal interface, user interface model, user interface specification method, user interface paradigm, multimodal intergration