DEVELOPING A SCALED PERFORMANCE EVALUATION MEASUREMENT SYSTEM TO EVALUATE MARINE PERFORMANCE
Author
Loeffelman, Garrett A.
Date
2019-06Advisor
Hodges, Glenn A.
Kennedy, Meghan Q.
Metadata
Show full item recordAbstract
Training developers lack methods for determining the benefits of integrating live, virtual, and constructive training. This study defined and tested a scaled performance evaluation measurement system (SPEMS) to be used across tasks. We used the buddy rush task to test SPEMS and compare it to the current “Go/No Go” performance evaluation checklist (PECL). We developed SPEMS in three steps: we convened focus groups to establish 5-level behaviorally anchored rating scales (BARS); confirmed SPEMS reliability using subject-matter expert (SME) virtual video analysis; and empirically tested SPEMS’ predictive capability in an operational environment. Suitable inter-rater reliability was found for BARS (87% agreement) and SPEMS (Cronbach’s Alpha 0.93 to 0.98). Percent exposure was selected by SMEs as the objective measure of buddy rush performance. Fifty-two trainees (26 pairs) were evaluated using a PECL and SPEMS at three time points. The results showed that SPEMS has a moderate, negative, linear relationship with percent exposure at an R2 = 0.41/0.40. Conversely, PECL has a weak, slightly negative linear relationship with percent exposure at an R2 = 0.03/0.2. We reject the null hypotheses and conclude that SPEMS scores are significantly related to percent exposure and have more predictive strength than PECL scores. These findings demonstrate a verifiable, repeatable, and reliable potential solution to the problem of measuring military task performance across training solutions.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Related items
Showing items related by title, author, creator and subject.
-
The effects of the use of a visual simulator in training T-2C student naval aviators for carrier qualification
Thomas, Elizabeth A. (Monterey, California. Naval Postgraduate School, 1995-12);Two training squadrons of student naval aviators flying the T-2C Buckeye aircraft during their Intermediate Stage of Strike (Jet) Training were compared to identify any effects attributed to exposure to the T-45 Operational ... -
A Field Study of Performance among Embarked Infantry Personnel Exposed to Waterborne Motion
Lee, Byron M. (Monterey, California. Naval Postgraduate School, 2012-09);With the cancellation of the Expeditionary Fighting Vehicle program by the Secretary of Defense in January 2011, the Marine Corps Combat Development and Integration Command started a revision of the core capabilities for ... -
Analysis and mitigation of mechanical shock effects on high speed planing boats
Kearns, Sean D. (Monterey California. Naval Postgraduate School, 2001-09);United States Special Forces use high-speed planing boats in the performance of their missions. Operation of these boats, particularly in rough seas, exposes the occupants to severe mechanical shock exposure that has been ...