Demand forecasting: an evaluation of DOD's accuracy metric and Navy's procedures
Rigoni, Michael P.
Correia de Souza, Wagner
MetadataShow full item record
In 2013, the Department of Defense (DOD) implemented an accuracy metric to monitor how well the services and Defense Logistics Agency were forecasting demand for inventory items. After three years, results were still poor. DOD uses a metric derived from the Mean of Absolute Percentage Error, yet it differs in significant ways, such as including unit cost to enable the aggregation of data pertaining to all items. In this study, we analyze how unit cost and other parameters affect the validity of DOD metric results. Our research included a review of academic literature on forecast accuracy measurement that uncovered an alternative metric, Mean of Absolute Scaled Errors (MASE), which we tested against the DOD metric. We found the DOD metric produced non-intuitive results and was adversely affected by unit cost and demand volume, while MASE avoided these errors. We utilized MASE to compare six forecasting methods and found that flexibility in choice of forecasting method produced better results than the na•ve method when coefficient of variation (CV) is below 2.0. We recommend that the DOD and Navy adopt MASE for aggregation and item-level forecast accuracy evaluation. We recommend that Navy utilize flexibility in choice of forecast method for individual items with CV below 2.0.
MBA Professional Report
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Copyright is reserved by the copyright owner.
Showing items related by title, author, creator and subject.
The use of shrinkage techniques in the estimation of attrition rates for large scale manpower models Read, Robert R. (Monterey, California. Naval Postgraduate School, 1988-07); NPS55-88-006This report summarizes the research to date performed by the author and his students on the use of modern multiparameter estimation techniques in the building of an attrition rate generator in support of the USMC Officer ...
Mehalic, Charles J. (Monterey, California. Naval Postgraduate School, 1990);This thesis expands upon previous work in applying aggregation and shrinkage techniques to Marine Corps officer attrition rate estimators. Attrition includes those leaving the service through retirement, resignation, ...
Guthrie, Katherine H. (Monterey, California: Naval Postgraduate School, 2017-06);A cascade heuristic appeals when we are faced with a monolithic optimization model exhibiting more decision variables and/or constraints than can be accommodated by computers and/or optimization software available. This ...