Demand forecasting: an evaluation of DOD's accuracy metric and Navy's procedures
Rigoni, Michael P.
Correia de Souza, Wagner
MetadataShow full item record
In 2013, the Department of Defense (DOD) implemented an accuracy metric to monitor how well the services and Defense Logistics Agency were forecasting demand for inventory items. After three years, results were still poor. DOD uses a metric derived from the Mean of Absolute Percentage Error, yet it differs in significant ways, such as including unit cost to enable the aggregation of data pertaining to all items. In this study, we analyze how unit cost and other parameters affect the validity of DOD metric results. Our research included a review of academic literature on forecast accuracy measurement that uncovered an alternative metric, Mean of Absolute Scaled Errors (MASE), which we tested against the DOD metric. We found the DOD metric produced non-intuitive results and was adversely affected by unit cost and demand volume, while MASE avoided these errors. We utilized MASE to compare six forecasting methods and found that flexibility in choice of forecasting method produced better results than the na•ve method when coefficient of variation (CV) is below 2.0. We recommend that the DOD and Navy adopt MASE for aggregation and item-level forecast accuracy evaluation. We recommend that Navy utilize flexibility in choice of forecast method for individual items with CV below 2.0.
MBA Professional ReportApproved for public release; distribution is unlimited
Showing items related by title, author, creator and subject.
Jackson, Kenneth J. (Monterey, California. Naval Postgraduate School, 2011-03);This research establishes metrics for determining overall Navy secondary inventory forecasting accuracy when compared to actual demands at the Naval Inventory Control Point (NAVICP). Specifically, two performance metrics ...
Hall, Jeremy T. (Monterey, California. Naval Postgraduate School, 2009-03);The Marine Corps, as with any organization with a large workforce, must accurately monitor and more importantly predict the transition rates among personnel entering and exiting the enlisted and officer ranks. This ...
Long-range atmosphere-ocean forecasting in support of undersea warfare operations in the western north Pacific Heidt, Sarah L. (Monterey, California. Naval Postgraduate School, 2009-09);Skillful long-range forecasts of acoustic variables have the potential to be very useful in planning Navy undersea warfare operations. Our study assessed the potential to predict sonic layer depth (SLD) in the western ...