Improved Software Testing for Open Architecture
Abstract
Applying traditional manual US Navy testing practices to OA systems will limit many benefits of OA, such as system scalability, rapid configuration changes, and effective component reuse. Pairing profile-driven automated software testing with test reduction techniques should enable these benefits and keep resource requirements at feasible levels. Test cases generated by operational profiles have been shown to be more effective than those developed by other methods, such as random or selective testing, and more resource-efficient than exhaustive approaches. This research effort increases the fidelity of the operational profile, creating an environment model referred to as a High-Fidelity Profile Model (HFPM) that can statistically describe individual software inputs. Samples from the HFPM''s probability distributions can generate operationally realistic or overly-stressful test cases for software modules under test. This process can be automated and paired with output checking functions, enabling automated effective software testing, and potentially improving reliability. Such models would be ideal for US Navy Open Architecture (OA) software because of the defined interface standards. HFPMs can enable effective testing in software reuse applications and are ideal for testing multiple releases of maturing software. This research defines the HFPM, presents a methodology to develop, validate, and apply it.
Description
Proceedings Paper (for Acquisition Research Program)
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.NPS Report Number
NPS-AM-10-027Related items
Showing items related by title, author, creator and subject.
-
Software testing for evolutionary iterative rapid prototyping
Davis, Edward V., Jr. (Monterey, California: Naval Postgraduate School, 1990-12);Rapid prototyping is emerging as a promising software development paradigm. It provides a systematic and automatable means of developing a software system under circumstances where initial requirements are not well known ... -
Testing automation tools for secure software development
Eatinger, Christopher J. (Monterey, California. Naval Postgraduate School, 2007-06);Software testing is a crucial step in the development of any software system, large or small. Testing can reveal the presence of logic errors and other flaws in the code that could cripple the system's effectiveness. Many ... -
Fitting and prediction uncertainty for a software reliability model
Dennison, Thomas E. (Monterey, California. Naval Postgraduate School, 1992-03);The cost of system operational testing is steadily increasing. It is desirable for the software manager to know if the software is sufficiently well developed or reliable to support such testing. Current software reliability ...