An inter-rater comparison of DoD Human Factors Analysis and Classification System (HFACS) and Human Factors Analysis and Classification System Maritime (HFACS-M)

Download
Author
Bilbro, Jason
Date
2013-09Advisor
Shattuck, Lawrence G.
Second Reader
Buttrey, Samuel E.
Metadata
Show full item recordAbstract
Human error has been identified as a factor in virtually every major maritime mishap over the past decade. The Department of Defense (DoD) currently employs the Human Factors Analysis and Classification System (HFACS) taxonomy to identify and quantify human error in major mishaps. HFACS divides errors into categories, sub-codes, and nano-codes. The generic nature of DoD HFACS raises the question of whether or not a domain-specific version for the surface Navy could be applied more consistently. Twenty-eight subjects (14 Surface Warfare Officers (SWOs) and 14 non-SWOs) employed either DoD HFACS or a developmental maritime domain specific version, HFACS-M, to classify findings in a National Transportation Safety Board (NTSB) maritime accident investigation. Fleiss Kappa was used to determine inter-rater reliability among subjects. The results of this study revealed that SWOs using HFACS-M had a higher inter-rater reliability (10.9%, 7.3%, and 6.5%) at every classification level than non-SWOs. HFACS-M itself was also shown to have a slightly higher overall inter-rater reliability (5.7%, 7.4%, and 3.6%) than DoD HFACS. The research concluded that although HFACS-M performed well, further testing is necessary to validate it.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Collections
Related items
Showing items related by title, author, creator and subject.
-
Optimizing classification in intelligence processing
Costica, Yinon (Monterey, California. Naval Postgraduate School, 2010-12);The intelligence making process, often described as the intelligence cycle, consists of phases. Congestion may be experienced in phases that require time consuming tasks such as translation, processing and analysis. To ... -
Spectral dependence of texture features integrated with hyperspectral data for area target classification improvement
Bangs, Corey F.; Kruse, Fred A.; Olsen, Chris R. (SPIE, 2013);Hyperspectral data were assessed to determine the effect of integrating spectral data and extracted texture feature data on classification accuracy. Four separate spectral ranges (hundreds of spectral bands total) were ... -
Improving Identification of Area Targets by Integrated Analysis of Hyperspectral Data and Extracted Texture Features
Bangs, Corey F. (Monterey, California. Naval Postgraduate School, 2012-09);Hyperspectral data were assessed to determine the effect of integrating spectral data and extracted texture features on classification accuracy. Four separate spectral ranges (hundreds of spectral bands total) were used ...