Active Learning and Effort Estimation: Finding the Essential Content of Software Effort Estimation Data
MetadataShow full item record
Background: Do we always need complex methods for software effort estimation (SEE)? Aim: To characterize the essential content of SEE data, i.e., the least number of features and instances required to capture the information within SEE data. If the essential content is very small, then 1) the contained information must be very brief and 2) the value added of complex learning schemes must be minimal. Method: Our QUICK method computes the euclidean distance between rows (instances) and columns (features) of SEE data, then prunes synonyms (similar features) and outliers (distant instances), then assesses the reduced data by comparing predictions from 1) a simple learner using the reduced data and 2) a state-of-the-art learner (CART) using all data. Performance is measured using hold-out experiments and expressed in terms of mean and median MRE, MAR, PRED(25), MBRE, MIBRE, or MMER. Results: For 18 datasets, QUICK pruned 69 to 96 percent of the training data (median = 89 percent). K ¼ 1 nearest neighbor predictions (in the reduced data) performed as well as CART’s predictions (using all data). Conclusion: The essential content of some SEE datasets is very small. Complex estimation methods may be overelaborate for such datasets and can be simplified. We offer QUICK as an example of such a simpler SEE method.
The article of record as published may be found at http://dx.doi.org/10.1109/TSE.2012.88.
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Showing items related by title, author, creator and subject.
Daniels, Charles L. (Monterey, California. Naval Postgraduate School, 1994);This research compares the fixed wing altitude algorithms utilized in the United States and the Australian versions of the combat modeling tool, JANUS(A). The Australian Army Battle Simulatian ...
Intensity changes in Typhoon Sinlaku and Typhoon Jangmi in response to varying ocean and atmospheric conditions DePalma, Charles A. (Monterey, California. Naval Postgraduate School, 2011-03);Impacts of ocean heat content (OHC) and vertical wind shear on intensity changes of Typhoon Sinlaku and Typhoon Jangmi during the Tropical Cyclone Structure-2008 and THORPEX Pacific Asian Regional Campaign are investigated. ...
Guertin, Nicholas; Clements, Paul (Monterey, California. Naval Postgraduate School, 2010-04-30); NPS-AM-10-033An open architecture is a development methodology that employs published, widely accepted standards for defining key interfaces within a system. Systems that are ''open'' have components that can be provided by different ...