FITREP CONTENT RELIABILITY: AN INTER-RATER PERSPECTIVE
Loading...
Authors
Banks, Fatima N.
Subjects
USMC
Marine Corps
performance evaluation
fitness report
FitRep
reliability
PES
Performance Evaluation System
Marine Corps
performance evaluation
fitness report
FitRep
reliability
PES
Performance Evaluation System
Advisors
Seagren, Chad W.
Date of Issue
2024-06
Date
Publisher
Monterey, CA; Naval Postgraduate School
Language
Abstract
The reliability of the Performance Evaluation System within the Marine Corps has come under scrutiny, particularly regarding the consistency and fairness of fitness report evaluations. This study aimed to investigate inter-rater reliability among Reporting Seniors (RSs) in assessing the performance of Marine Officers using the Performance-Anchored Rating Scale (PARS). Data collected from 51 respondents were analyzed, revealing notable findings. Quantitatively, the study found low inter-rater reliability, with Fleiss' Kappa yielding a value of 0.0214 (p = 0.00116), indicating inconsistent application of assessment criteria across diverse backgrounds. These results raise concerns regarding the validity and fairness of fitness report evaluations and their ability to accurately identify talent and quality Marines for promotion within the Marine Corps. Despite efforts to standardize evaluation criteria and promote objectivity, the analysis suggests substantial variability in ratings and evaluations among RSs. Recommendations stemming from these quantitative findings include reassessing evaluation criteria and considering modifications to the PARS and evaluated attributes to enhance accuracy and fairness. Addressing these issues is imperative for ensuring fairness, transparency, and equity in personnel management practices within the Marine Corps.
Type
Thesis
Description
Series/Report No
Department
Organization
Identifiers
NPS Report Number
Sponsors
Funding
Format
Citation
Distribution Statement
Distribution Statement A. Approved for public release: Distribution is unlimited.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.