DEVELOPING A SCALED PERFORMANCE EVALUATION MEASUREMENT SYSTEM TO EVALUATE MARINE PERFORMANCE
Loeffelman, Garrett A.
Hodges, Glenn A.
Kennedy, Meghan Q.
MetadataShow full item record
Training developers lack methods for determining the benefits of integrating live, virtual, and constructive training. This study defined and tested a scaled performance evaluation measurement system (SPEMS) to be used across tasks. We used the buddy rush task to test SPEMS and compare it to the current “Go/No Go” performance evaluation checklist (PECL). We developed SPEMS in three steps: we convened focus groups to establish 5-level behaviorally anchored rating scales (BARS); confirmed SPEMS reliability using subject-matter expert (SME) virtual video analysis; and empirically tested SPEMS’ predictive capability in an operational environment. Suitable inter-rater reliability was found for BARS (87% agreement) and SPEMS (Cronbach’s Alpha 0.93 to 0.98). Percent exposure was selected by SMEs as the objective measure of buddy rush performance. Fifty-two trainees (26 pairs) were evaluated using a PECL and SPEMS at three time points. The results showed that SPEMS has a moderate, negative, linear relationship with percent exposure at an R2 = 0.41/0.40. Conversely, PECL has a weak, slightly negative linear relationship with percent exposure at an R2 = 0.03/0.2. We reject the null hypotheses and conclude that SPEMS scores are significantly related to percent exposure and have more predictive strength than PECL scores. These findings demonstrate a verifiable, repeatable, and reliable potential solution to the problem of measuring military task performance across training solutions.
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Showing items related by title, author, creator and subject.
The effects of the use of a visual simulator in training T-2C student naval aviators for carrier qualification Thomas, Elizabeth A. (Monterey, California. Naval Postgraduate School, 1995-12);Two training squadrons of student naval aviators flying the T-2C Buckeye aircraft during their Intermediate Stage of Strike (Jet) Training were compared to identify any effects attributed to exposure to the T-45 Operational ...
A Field Study of Performance among Embarked Infantry Personnel Exposed to Waterborne Motion Lee, Byron M. (Monterey, California. Naval Postgraduate School, 2012-09);With the cancellation of the Expeditionary Fighting Vehicle program by the Secretary of Defense in January 2011, the Marine Corps Combat Development and Integration Command started a revision of the core capabilities for ...
Analysis and mitigation of mechanical shock effects on high speed planing boats Kearns, Sean D. (Monterey California. Naval Postgraduate School, 2001-09);United States Special Forces use high-speed planing boats in the performance of their missions. Operation of these boats, particularly in rough seas, exposes the occupants to severe mechanical shock exposure that has been ...