EVALUATING ARTIFICIAL INTELLIGENCE FOR OPERATIONS IN THE INFORMATION ENVIRONMENT

Download
Author
Jhong, Kelley Y.
Date
2022-12Advisor
Warren, Timothy C.
Second Reader
Dew, Nicholas
Metadata
Show full item recordAbstract
Recent advances in artificial intelligence (AI) portend a future of accelerated information cycles and intensified technology diffusion. As AI applications become increasingly prevalent and complex, Special Operations Forces (SOF) face the challenge of discerning which tools most effectively address operational needs and generate an advantage in the information environment. Yet, SOF currently lack an end user–focused evaluation framework that could assist information practitioners in determining the operational value of an AI tool. This thesis proposes a practitioner’s evaluation framework (PEF) to address the question of how SOF should evaluate AI technologies to conduct operations in the information environment (OIE).
The PEF evaluates AI technologies through the perspective of the information practitioner who is familiar with the mission, the operational requirements, and OIE processes but has limited to no technical knowledge of AI. The PEF consists of a four-phased approach—prepare, design, conduct, recommend—that assesses nine evaluation domains: mission/task alignment; data; system/model performance; user experience; sustainability; scalability; affordability; ethical, legal, and policy considerations; and vendor assessment. By evaluating AI through a more structured, methodical approach, the PEF enables SOF to identify, assess, and prioritize AI-enabled tools for OIE.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Related items
Showing items related by title, author, creator and subject.
-
Case Studies on UN Information Operations Ethiopia, Liberia, and Kosovo
Browne, Cheree M.; Mentes, Osman (Monterey, California. Naval Postgraduate School, 2009-09);Over the past ten years, the demand for UN Information Operations (IO) has grown, with the UN initiating or strengthening seventeen peacekeeping operations and increasing the number of deployed UN personnel. Given the ... -
Joint task force requirements determination: a review of the organization and structure of joint task forces
Estrada, Armando X. (Monterey, California. Naval Postgraduate School, 2005-03);This report reviews military operations that employed a Joint Task Force (JTF) organizational model to organize subordinate forces. It provides background information; analyzes major characteristics to include mission, ... -
Lateral coordination of interdependent U.S. Army information tasks
Workman, Bren K. (Monterey, California. Naval Postgraduate School, 2008-12);The purpose of this thesis is to determine whether the U.S. Army is adequately prepared or organizationally structured at the operational and tactical levels of warfare and command to execute synchronous information ...