Utilizing Statistical Inference to Guide Expectations and Test Structuring During Operational Testing and Evaluation

Simple item page
dc.contributor.authorBrathwaite, Joy
dc.contributor.authorWallace, Alton
dc.contributor.authorHolcomb, Robert
dc.contributor.corporateAcquisition Management (AM)
dc.contributor.corporateAcquisition Research Program (ARP)
dc.contributor.departmentAcquisition Management
dc.contributor.departmentOther Research Faculty
dc.date30-Apr-11
dc.date.accessioned2013-05-08T21:23:09Z
dc.date.available2013-05-08T21:23:09Z
dc.date.issued2011-04-30
dc.descriptionProceedings Paper (for Acquisition Research Program)en_US
dc.description.abstractComparative tests are commonly used during the operational testing phase to baseline the system under test (SUT) against the current status quo. Depending on the type of SUT, the comparative test may be costly and resource intensive. Thus, any insights which may be gleaned about the potential results of the test beforehand may provide guidance on (1) the potential benefits of conducting the test and (2) the structuring of the test. This paper offers a statistical approach to understanding the type of results which may emerge during comparative testing of the SUT. Specifically, we utilize the concept of statistical inference to determine the needed performance difference between the SUT and the baseline system. If performance differences are statistically different, there may be useful information to be gained from conducting the test as is. Performance differences, which are not statistically different, may indicate that the test should be restructured or postponed. In either case, the relevant decision-maker is provided with information about the potential results of the test beforehand in order to make an informed decision. We illustrate the method of statistical inference on a system which improves situational awareness on the battlefield.en_US
dc.description.distributionstatementApproved for public release; distribution is unlimited.
dc.description.sponsorshipNaval Postgraduate School Acquisition Research Programen_US
dc.identifier.npsreportNPS-AM-11-C8P10R03-044
dc.identifier.urihttps://hdl.handle.net/10945/33650
dc.publisherMonterey, California. Naval Postgraduate Schoolen_US
dc.relation.ispartofseriesAcquisition Research Symposium
dc.rightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.en_US
dc.subject.authorTest and Evaluation (T&E)en_US
dc.subject.authorSystem Under Test, SUT, Comparative Testing, Statistical Inference, Situational Awarenessen_US
dc.titleUtilizing Statistical Inference to Guide Expectations and Test Structuring During Operational Testing and Evaluationen_US
dc.typeTechnical Reporten_US
dspace.entity.typePublication
relation.isOrgUnitOfPublication394ae3f1-b0b4-47ac-ba4b-b6ea3bc4dab9
relation.isOrgUnitOfPublicationbc7988c8-57ff-485c-9348-877f4ef91f4e
relation.isOrgUnitOfPublication.latestForDiscoverybc7988c8-57ff-485c-9348-877f4ef91f4e
relation.isSeriesOfPublicatione652aa3b-f22b-4814-8e9d-6391f82531e0
relation.isSeriesOfPublication.latestForDiscoverye652aa3b-f22b-4814-8e9d-6391f82531e0
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
NPS-AM-11-C8P10R03-044.pdf
Size:
278.16 KB
Format:
Adobe Portable Document Format
Download
Collections
Publications
Conferences
Reports