Test-Retest Reliability of a Formula-Scored Multiple-Choice Test
MetadataShow full item record
In an ideal multiple-choice test, defined as a multiple-choice test containing only items with options that are all equally guessworthy, the probability of guessing the correct answer to an item is equal to the reciprocal of the number of the item's options. This article presents an asymptotically exact estimator of the test-retest reliability of an ideal multiple-choice test. When all test items have the same number of options, computation of the estimator requires, in addition to the number of options per item, the same information as computation of the Kuder-Richardson Formula 21: the total number of items answered correctly on a single testing occasion by each person tested. Both for ideal multiple-choice tests and for nonideal multiple-choice tests for which the average probability of guessing the correct answer to an item is equal to the reciprocal of the number of options per item, Monte Carlo data show that the estimator is considerably more accurate than the Kuder-Richardson Formula 21 and, in fact, is very nearly exact in populations of the order of 1000 persons.
The article of record as published may be found at http://dx.doi.org/10.2466/pr0.19188.8.131.529
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Showing items related by title, author, creator and subject.
Garland, Malcolm W. (Monterey, California. Naval Postgraduate School, 1991-09);This thesis presents a high resolution, discrete event driven combat simulation. This model was developed to facilitate the analysis of tactical options available to a small unit (companyplatoon) commander using artillery ...
Gonen, Ofer (Monterey California. Naval Postgraduate School, 2004-12);Computer simulations which forecast the performance of complicated systems are used as decision aids in many applications. For example, a ship's defensive system may use simulation to support an automated real-time response ...
Kerkhoff, Hans G.; Butler, Jon T. (1987-07);As in binary, a multiple-valued programmable logic array (PLA) realises a sum-of-products, expression specified by the user. However, in multiple-valued logic, there are many more operations than in binary, and an important ...