Certifying Tools for Test Reduction in Open Architecture
MetadataShow full item record
In this paper, we describe a method for evaluating tools that can be used to guide decisions about how much retesting is needed and to check conditions under which testing of unmodified components can be reduced or avoided. The approach uses a combination of dependency analysis applied to source code and automated testing applied to executable component implementations. Dependability of such tools is a key concern in this context, which our ongoing research addresses. We also discuss other applications of software dependency analysis, such as risk-based testing, and discuss applications of dependency analysis to improve acquisition processes in the context of open architectures (OA). The Navy''s OA framework is intended to promote reuse, improve system flexibility, and reduce costs. In this paper, we apply open architecture principles to reduce testing effort and costs in cases where the requirements and code for a subsystem have not been changed, but the component will be used together with new or modified components that may include a new version of the operating system. This situation is common in the Navy due to technology advancement upgrades and accounts for a substantial fraction of the testing cost. Applying traditional U.S. Navy weapon and combat system test and evaluation (T&E) practices, which currently include manual retesting after each system modification, to future OA systems will nullify many of the benefits that OA brings to the table, such as system scalability, rapid configuration changes, and effective component reuse. Combining (1) Naval Postgraduate School (NPS) research on dependency analysis focused on determining when it is safe not to retest a component with (2) automated software testing should enable these benefits and keep resource requirements at feasible levels.
Proceedings Paper (for Acquisition Research Program)
NPS Report NumberNPS-AM-12-C9P06R03-055
Showing items related by title, author, creator and subject.
O'Connor, John Charles (Monterey, California. Naval Postgraduate School, 1994-09);The H-46 helicopter has experienced early in-service failures in its tie bar. The tie bar is a multi-component system that is a critical part of the linkage, which attaches the rotor blade to the rotating hub of the ...
Truesdell, David M. (Monterey, California. Naval Postgraduate School, 2012-06);China's demographic transition will create great difficulty in continuing the scale of the economic development seen over the last thirty years. This difficulty will be experienced through the costs of the demographic ...
Mathematical modeling to reduce the cost of complex system testing: Characterizing test coverage to assess and improve information return Pfeiffer, Karl D.; Kanevsky, Valery A.; Housel, Thomas J. (2011-09-21); NPS-TE-11-181Effective, cost-efficient testing is critical to the long-term success of Open Architecture within the Navy''s Integrated Warfare System. In previous research we have developed a simple, effective framework to examine the ...