Reducing the cost of risk-based testing: management of testing options to manage risk in test and evaluation

Download
Author
Pfeiffer, Karl D.
Kanevsky, Valery A.
Housel, Thomas J.
Date
2009Metadata
Show full item recordAbstract
In the acquisition or management of complex systems, testing is the means by which we trade budget or schedule for information about the likelihood our system will work correctly under operational load. Branch paths in hardware and software increase as a function of the number of components and interconnections, leading to exponential growth in the number of test cases required for exhaustive examination, or perfect knowledge, of a complex system. In practice, the typical cost for testing in schedule or in budget means that only a small fraction of these paths are investigated. In this work, we develop an abstract model to describe system testing and the information return (or reduction in risk) for the attendant cost in time and mondey. This model is supported by a mathematical analysis suitable for Monte Carlo simulation. The long-term goal of this modeling work is to construct a decision-support tool for the Navy Program Executive Office Integrated Warfare Systems (PEO IWS) offering quantitative information about cost versus diagnostic certainty in system testing.
NPS Report Number
NPS-GSBPP-09-027Related items
Showing items related by title, author, creator and subject.
-
Reducing the Cost of Risk-based Testing: Management of Testing Options to Manage Risk in Test and Evaluation
Pfeiffer, Karl D.; Kanevsky, Valery A.; Housel, Thomas J. (2009-07-01); NPS-AM-09-114In the acquisition or management of complex systems, testing is the means by which we trade budget or schedule for information about the likelihood our system will work correctly under operational load. Branch paths in ... -
Mathematical modeling for risk-based system testing
Pfeiffer, Karl D.; Kanevsky, Valery A.; Housel, Thomas J. (Monterey, California. Naval Postgraduate School, 2009); NPS-GSBPP-09-028Testing of complex systems is a fundamentally difficult task whether locating faults (diagnostic testing) or implementing upgrades (regression testing). Branch paths through the system increase as a function of the number ... -
Mathematical Modeling for Optimal System Testing under Fixed-cost Constraint
Pfeiffer, Karl D.; Kanevsky, Valery A.; Housel, Thomas J. (2009-04-01); NPS-AM-09-023Testing of complex systems is a fundamentally difficult task, whether locating faults (diagnostic testing) or implementing upgrades (regression testing). Branch paths through the system increase as a function of the number ...