Decision-Based Metrics for Test and Evaluation Experiments
MetadataShow full item record
We develop a new decision-based metric for determining sample sizes in Test and Evaluation experiments. Traditional confidence intervals for the mean can be used, and we present sequential confidence interval procedures as a way to derive efficient intervals. We discuss decision rules for analyzing the observed output and how to choose confidence interval methods for calibrating these decision rules. The metric presented can help determine if a fast decision on the quality of the system can be made or if many more tests are needed to ensure an accurate estimate of performance relative to a desired standard.
NPS Report NumberSYM-AM-17-145
Showing items related by title, author, creator and subject.
Hutchins, Susan G.; Morrison, Jeffrey G.; Kelly, Richard T. (1996);The Tactical Decision Making Under Stress (TADMUS) program is being conducted to apply recent developments in decision theory and human-system interaction technology to the design of a decision support system for ...
Gaines, Geoffrey C. (Monterey, California: Naval Postgraduate School, 2014-03);Information is the single most important part of the decision-making process. There are many theories and models of decision-making processes that apply to general decisions and others that are for very specific purposes. ...
Carlson, Travis D. (Monterey, California: Naval Postgraduate School, 2016-06);Effective decision-making is a hallmark of military leadership, and development of decision makers is critical to military strategy. The Cognitive Alignment with Performance-Targeted Training Intervention Model (CAPTTIM) ...