Development of a man-to-man rating scale for evaluating performance
Githens, William H.
Elster, Richard S.
MetadataShow full item record
Over the years of continuous problem with performance rating systems has been the leniency and the non-comparability of marks assigned by different evaluators. By utilizing a computer, a method has been developed which overcomes this problem. In this new method the evaluators must compare their ratees to other specific ratees (anchors) who are under other evaluators. All ratees receive their scale value based on their relative position to the anchoring points that were used by the evaluator. A trial of the method was made on ten groups, each composed of 12 graduate students. Each group has two evaluators. The characteristics rate were Industry, Academic, Ability, Judgment, and Cooperation. These were considered as relevant characteristics to the "job" of being a student. The groups had been relatively intact for approximately one year prior to the evaluations. A comparison of the results of using the standard fitness report rating method (RAW) and the man-to-man method (MM &MMQ) revealed that the man-to-man method was superior based on certain statistical qualities. The man-to-man method resulted in a greater spread of scores and, more importantly, resulted in higher inter-rater agreement than the standard rating method. An outside criterion of Quality Point Average was available for the "Academic Ability" scale. Both the standard methodology and the man-to-man methodology produced rating values which were highly related to this outside criterion, .68 and .71 respectively
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
NPS Report NumberNPS55Gh73021A
Showing items related by title, author, creator and subject.
Watson, Kathleen (Monterey, California: Naval Postgraduate School, 2015-06);Early in the procurement planning process, the acquisition team determines the method of proposal evaluations that will be used during source selections. The most frequently used methods are lowest price technically ...
A study of the processes, methjods and techniques used in negotiated or Best Value procurements of construction services Schilling, Leonard C. (Monterey, California. Naval Postgraduate School, 2000-09);An important part of the construction process is awarding the contract to perform the construction in a timely manner to a qualified contractor. The owner must choose a delivery method and a selection method. The four basic ...
Marine Corps Combat Readiness Evaluation System (MCCRES): three case studies for use in providing for a more effective evaluator Conatser, Larkin E. (Monterey, California. Naval Postgraduate School, 1983-12);The Marine Corps Combat Readiness Evaluation System (MCCRES) was designed to provide timely and accurate information concerning the ability of active and reserve forces to perform assigned combat missions. To provide this ...