Augmenting comprehension of speech in noise with a computer-generated facial avatar and its effect on performance
Swann, William R.
Shattuck, Lawrence G.
McCauley, Michael E.
MetadataShow full item record
Military operations often occur in noisy environments, which can interfere with effective verbal communication. Previous studies have established the effectiveness of allowing a listener to see the speaker's mouth. This study examined the efficacy of incorporating a computer-animated facial avatar into a visual display in order to improve the comprehension of speech in noisy environments, while performing concurrent tasks. It also examined the effect of the avatar on the performance of concurrent auditory and visual tasks. Twenty volunteers participated in an experiment measuring verbal comprehension, concurrent task performance and gaze dwell times while auditory, verbal and visual tasks were being performed under noisy conditions. The results indicated that the simple presence of the facial avatar did not significantly improve verbal comprehension while performing concurrent tasks. However, the facial avatar significantly improved verbal comprehension when the tasks being completed concurrently were more difficult and/or auditory-type tasks. The participants' performance for the concurrent tasks was not significantly affected by the presence of the facial avatar. The incorporation of computer--animated facial avatars into visual displays has the potential to improve verbal comprehension in noisy environments, depending on the nature of the concurrent task.
Human Systems Integration Report
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Showing items related by title, author, creator and subject.
Networked humanoid animation driven by human voice using extensible 3D (X3D), H-Anim and JAVA speech open standards Apaydin, Ozan (Monterey, California. Naval Postgraduate School, 2002-03);Speech-recognition technology is beginning to be used in automobiles, telephones, personal digital assistants (PDAs), medical records, e-commerce, text dictation and editing. Speech recognition can also be integrated into ...
Christensen, Jon L.; Pierson, Brian E. (Monterey, California. Naval Postgraduate School, 1994-03);Visualization is key in helping a student understand the fundamentals of Calculus. The new generation of computer literate students, raised in a video-based environment, will expect more than the traditional chalkboard ...
Schumann, Michael A.; Drusinsky, Doron; Michael, James B.; Wijesekera, Duminda (IEEE, 2014-02);This paper presents a novel application of computer-assisted formal methods for systematically specifying, documenting, statically and dynamically checking, and maintaining human-centered workflow processes. This approach ...