Auditory-visual cross-modal perception phenomena
Download
Author
Storms, Russell L.
Date
1998-09-01Advisor
Zyda, Michael J.
Metadata
Show full item recordAbstract
The quality of realism in virtual environments is typically considered to be a function of visual and audio fidelity mutually exclusive of each other. However, the virtual environment participant, being human, is multi- modal by nature. Therefore, in order to more accurately validate the levels of auditory and visual fidelity required in a virtual environment, a better understanding is needed of the intersensory or cross modal effects between the auditory and visual sense modalities. To identify whether any pertinent auditory visual cross modal perception phenomena exist, 108 subjects participated in three main experiments which were completely automated using HTML, Java, and JavaScript computer programming languages. Visual and auditory display quality perception were measured intramodally and intermodally by manipulating visual display pixel resolution and Gaussian white noise level and by manipulating auditory display sampling frequency and Gaussian white noise level. Statistically significant results indicate that: (1) medium or high quality auditory displays coupled with high quality visual displays increase the quality perception of the visual displays relative to the evaluation of the visual display alone, and (2) low quality auditory displays coupled with high quality visual displays decrease the quality perception of the auditory displays relative to the evaluation of the auditory display alone. These findings strongly suggest that the quality of realism in virtual environments must be a function of both auditory and visual display fidelities inclusive of each other.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Collections
Related items
Showing items related by title, author, creator and subject.
-
Facilitating rich acoustical environments in virtual worlds
Hoag, Kenneth J. (Monterey, California. Naval Postgraduate School, 1998-09-01);The visual aspect of virtual environments has advanced at a rapid pace. The audio aspect, however, has not kept pace. Current methods of building virtual models do not address the graphical and audio aspects in an integrated ... -
Augmenting comprehension of speech in noise with a computer-generated facial avatar and its effect on performance
Swann, William R. (Monterey, California. Naval Postgraduate School, 2010-12);Military operations often occur in noisy environments, which can interfere with effective verbal communication. Previous studies have established the effectiveness of allowing a listener to see the speaker's mouth. This ... -
Entertainment Industry Sound Design Techniques to Improve Presence and Training Performance in VE
Shilling, Russell (Monterey, California: Naval Postgraduate School., 2002);The design and development of auditory interfaces in virtual environments has lagged behind visual interfaces. However, the auditory interface should be considered an essential component to VE that adds ambience, emotion, ...