Decision-Based Metrics for Test and Evaluation Experiments
Abstract
We develop a new decision-based metric for determining sample sizes in Test and Evaluation experiments. Traditional confidence intervals for the mean can be used, and we present sequential confidence interval procedures as a way to derive efficient intervals. We discuss decision rules for analyzing the observed output and how to choose confidence interval methods for calibrating these decision rules. The metric presented can help determine if a fast decision on the quality of the system can be made or if many more tests are needed to ensure an accurate estimate of performance relative to a desired standard.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.NPS Report Number
SYM-AM-17-082Related items
Showing items related by title, author, creator and subject.
-
Principles For Aiding Complex Military Decision Making
Hutchins, Susan G.; Morrison, Jeffrey G.; Kelly, Richard T. (1996);The Tactical Decision Making Under Stress (TADMUS) program is being conducted to apply recent developments in decision theory and human-system interaction technology to the design of a decision support system for ... -
Information dominance: information's role in influencing decision making
Gaines, Geoffrey C. (Monterey, California: Naval Postgraduate School, 2014-03);Information is the single most important part of the decision-making process. There are many theories and models of decision-making processes that apply to general decisions and others that are for very specific purposes. ... -
Human factors influencing decision making
Jacobs, Patricia A. (Monterey, California. Naval Postgraduate School, 1998-07-01); NPS-OR-98-003This report supplies references and comments on literature that identifies human factors influencing decision making, particularly military decision making. The literature has been classified as follows (the ...