Test-Retest Reliability of a Formula-Scored Multiple-Choice Test
MetadataShow full item record
In an ideal multiple-choice test, defined as a multiple-choice test containing only items with options that are all equally guessworthy, the probability of guessing the correct answer to an item is equal to the reciprocal of the number of the item's options. This article presents an asymptotically exact estimator of the test-retest reliability of an ideal multiple-choice test. When all test items have the same number of options, computation of the estimator requires, in addition to the number of options per item, the same information as computation of the Kuder-Richardson Formula 21: the total number of items answered correctly on a single testing occasion by each person tested. Both for ideal multiple-choice tests and for nonideal multiple-choice tests for which the average probability of guessing the correct answer to an item is equal to the reciprocal of the number of options per item, Monte Carlo data show that the estimator is considerably more accurate than the Kuder-Richardson Formula 21 and, in fact, is very nearly exact in populations of the order of 1000 persons.
The article of record as published may be found at http://dx.doi.org/10.2466/pr0.19188.8.131.529
Showing items related by title, author, creator and subject.
Briggs, Jaime C. (Monterey, California. Naval Postgraduate School, 2001-09);This thesis presents a distance-learning tool, which provides a self-sufficient application that allows one to implement online courses for electrical engineering. A major emphasis is placed on replacing simplistic ...
Bellinoff, Alan Eliot (Monterey, California. Naval Postgraduate School, 1974-03);In an attempt to improve upon the traditional "lecture and textbook" mode of teaching, an Audio-Visual Response Teaching Machine was utilized for certain topics in gasdynamics. This teaching system was based on three ...
An evaluation of the effectiveness of U.S. Naval Aviation Crew Resource Management training programs a reassessment for the twenty-first century operating environment Jones, Douglas W. (Monterey, California. Naval Postgraduate School, 2009-06);This thesis describes a multi-faceted evaluation of the U.S. Naval Aviation Crew Resource Management (CRM) program. CRM training is used to instruct naval aviators in safety critical, non-technical behaviors. Reactions ...