Decision-Based Metrics for Test and Evaluation Experiments
MetadataShow full item record
We develop a new decision-based metric for determining sample sizes in Test and Evaluation experiments. Traditional confidence intervals for the mean can be used, and we present sequential confidence interval procedures as a way to derive efficient intervals. We discuss decision rules for analyzing the observed output and how to choose confidence interval methods for calibrating these decision rules. The metric presented can help determine if a fast decision on the quality of the system can be made or if many more tests are needed to ensure an accurate estimate of performance relative to a desired standard.
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
NPS Report NumberSYM-AM-17-082
Showing items related by title, author, creator and subject.
Hutchins, Susan G.; Morrison, Jeffrey G.; Kelly, Richard T. (1996);The Tactical Decision Making Under Stress (TADMUS) program is being conducted to apply recent developments in decision theory and human-system interaction technology to the design of a decision support system for ...
Gaines, Geoffrey C. (Monterey, California: Naval Postgraduate School, 2014-03);Information is the single most important part of the decision-making process. There are many theories and models of decision-making processes that apply to general decisions and others that are for very specific purposes. ...
Carlson, Travis D. (Monterey, California: Naval Postgraduate School, 2016-06);Effective decision-making is a hallmark of military leadership, and development of decision makers is critical to military strategy. The Cognitive Alignment with Performance-Targeted Training Intervention Model (CAPTTIM) ...