You are here

UCF Digital Collections ยป ETD Collection

THE INTEGRATION OF AUDIO INTO MULTIMODAL INTERFACES: GUIDELINES AND APPLICATIONS OF INTEGRATING SPEECH, EARCONS, AUDITORY ICONS, AND SPATIAL AUDIO (SEAS)

Download pdf | Full Screen View

Date Issued:
2005
Abstract/Description:
The current research is directed at providing validated guidelines to direct the integration of audio into human-system interfaces. This work first discusses the utility of integrating audio to support multimodal human-information processing. Next, an auditory interactive computing paradigm utilizing Speech, Earcons, Auditory icons, and Spatial audio (SEAS) cues is proposed and guidelines for the integration of SEAS cues into multimodal systems are presented. Finally, the results of two studies are presented that evaluate the utility of using SEAS cues, developed following the proposed guidelines, in relieving perceptual and attention processing bottlenecks when conducting Unmanned Air Vehicle (UAV) control tasks. The results demonstrate that SEAS cues significantly enhance human performance on UAV control tasks, particularly response accuracy and reaction time on a secondary monitoring task. The results suggest that SEAS cues may be effective in overcoming perceptual and attentional bottlenecks, with the advantages being most revealing during high workload conditions. The theories and principles provided in this paper should be of interest to audio system designers and anyone involved in the design of multimodal human-computer systems.
Title: THE INTEGRATION OF AUDIO INTO MULTIMODAL INTERFACES: GUIDELINES AND APPLICATIONS OF INTEGRATING SPEECH, EARCONS, AUDITORY ICONS, AND SPATIAL AUDIO (SEAS).
24 views
10 downloads
Name(s): Jones, David, Author
Stanney, Kay, Committee Chair
University of Central Florida, Degree Grantor
Type of Resource: text
Date Issued: 2005
Publisher: University of Central Florida
Language(s): English
Abstract/Description: The current research is directed at providing validated guidelines to direct the integration of audio into human-system interfaces. This work first discusses the utility of integrating audio to support multimodal human-information processing. Next, an auditory interactive computing paradigm utilizing Speech, Earcons, Auditory icons, and Spatial audio (SEAS) cues is proposed and guidelines for the integration of SEAS cues into multimodal systems are presented. Finally, the results of two studies are presented that evaluate the utility of using SEAS cues, developed following the proposed guidelines, in relieving perceptual and attention processing bottlenecks when conducting Unmanned Air Vehicle (UAV) control tasks. The results demonstrate that SEAS cues significantly enhance human performance on UAV control tasks, particularly response accuracy and reaction time on a secondary monitoring task. The results suggest that SEAS cues may be effective in overcoming perceptual and attentional bottlenecks, with the advantages being most revealing during high workload conditions. The theories and principles provided in this paper should be of interest to audio system designers and anyone involved in the design of multimodal human-computer systems.
Identifier: CFE0000810 (IID), ucf:46689 (fedora)
Note(s): 2005-12-01
M.S.
Engineering and Computer Science, Department of Industrial Engineering and Management Systems
Masters
This record was generated from author submitted information.
Subject(s): human system interaction audio design speech earcon auditory icon spatial guideline
Persistent Link to This Record: http://purl.flvc.org/ucf/fd/CFE0000810
Restrictions on Access: public
Host Institution: UCF

In Collections