Multiple comparisons with a standard using false discovery rates
Singham, Dashi I.
MetadataShow full item record
We introduce a new framework for performing multiple comparisons with a standard when simulation models are available to estimate the performance of many different systems. In this setting, a large proportion of the systems have mean performance from some known null distribution, and the goal is to select alternative systems whose means are different from that of the null distribution. We employ empirical Bayes ideas to achieve a bound on the false discovery rate (proportion of selected systems from the null distribution) and a desired probability an alternate type system is selected.
Refereed Conference Paper
Showing items related by title, author, creator and subject.
Redmond, Patrick J. (Monterey, California. Naval Postgraduate School, 2007-03);The next generation of military capabilities will hinge on systems of systems technologies, entailing the integration of numerous large scale systems into a complex system of systems whose capability exceeds the capabilities ...
Big Data and Deep Learning for Defense Acquisition Visibility Environment (DAVE)—Developing NPS Student Thesis Research Zhao, Ying (2017-12-21); NPS-AM-18-012The U.S. Department of Defense (DoD) acquisition process is extremely complex. There are three key processes that must work in concert to deliver capabilities: determining warfighters’ requirements and needs, planning the ...
Achieving Better Buying Power for Mobile Open Architecture Software Systems through Diverse Acquisition Scenarios Scacchi, Walt; Alspaugh, Thomas A. (Monterey, California. Naval Postgraduate School, 2017-05); UCI-AM-17-041This research seeks to identify, track, and analyze software component costs and cost reduction opportunities within diverse acquisition life cycle scenarios for open architecture systems accommodating Web-based and mobile ...