Implementing voice recognition and natural language processing in the NPSNET networked virtual environment

Download
Author
DeVilliers, Edward Michael.
Date
1996-09Advisor
Ludlow, Nelson D.
Falby, John S.
Metadata
Show full item recordAbstract
Interfaces to military Virtual Reality (VR) systems, such as NPSNET IV.9, have been limited mainly to keyboard, mouse, and joystick devices. This presents two major problems; remembering how to access all the functionality of the system, and using the interface when the user is otherwise physically constrained. This can occur during the use of body-position tracking devices and Heads-Up-Displays (HUD). Voice recognition and Natural Language Processing (NLP) were used as a solution to both problems. The approach taken was to develop a networked Spoken Language System (SLS) using a Commercial-Off-The-Shelf (COTS) voice recognition and NLP system. The Nuance Speech Recognition System from Nuance Communications was chosen after analyzing the special requirements of NPSNET. Implementing the SLS occurred in four phases. First, vocabularies and grammars were developed to simulate the 108 keyboard commands, focusing on flexibility and decreased response latency. Second, new C++ classes were written to ease reuse of the Nuance API's. Third, a control panel was written to manage the voice processing, and fourth, the code was integrated into NPSNET. As a result of this effort, a new voice-enabled interface exists for NPSNET. In addition, C++ classes exist to ease future use of the Nuance API in other software systems. All of the 108 keyboard commands are executable through voice control with a 83.8% sentence understanding rate in a noisy background environment. :
Collections
Related items
Showing items related by title, author, creator and subject.
-
Proof of concept Iraqi enrollment via voice authentication project
Lee, Samuel K. (Monterey California. Naval Postgraduate School, 2005-09);This thesis documents the findings of the Naval Postgraduate School (NPS) research team's efforts on the initial phase of the Iraqi Enrollment via Voice Authentication Project (IEVAP). The IEVAP is an Office of the Secretary ... -
Leaning in to Address Sleep Disturbances and Sleep Disorders in Department of Defense and Defense Health Agency
Mysliwiec, Vincent; Brock, Matthew S.; Creamer, Jennifer L.; Espejo, Emmanuel P.; Markwald, Rachel R.; Matwiyoff, Gregory N.; Peachey, John T.; O’Reilly, Brian M.; Shattuck, Nita L.; Taylor, Daniel J.; Troxel, Wendy M.; Germain, Anne (Oxford University Press, 2021-05);In their article entitled, “Engaging Stakeholders to Optimize Sleep Disorders Management in the U.S. Military: A Qualitative Analysis,” Abdelwadoud and colleagues conducted focus groups of service members, primary care ... -
Testing and demonstrating speaker verification technology in Iraqi-Arabic as part of the Iraqi Enrollment via Voice Authentication Project (IEVAP) in support of the Global War on Terrorism (GWOT)
Pena, Edwin D. (Monterey, California. Naval Postgraduate School, 2007-09);This thesis documents the findings of an Iraqi-Arabic language test and concept of operations for speaker this verification technology as part of the Iraqi Banking System in support of the Iraqi Enrollment via Voice ...