Optimal Allocation of Proposals to Reviewers to Facilitate Effective Ranking

Download
Author
Cook, Wade D.
Golany, Boaz
Kress, Moshe
Penn, Michael
Raviv, Tal
Date
2005Metadata
Show full item recordAbstract
Peer review of research proposals and articles is an essential element in research and development processes worldwide. Here we consider a problem that, to the best of our knowledge, has not been addressed until now: how to assign subsets of proposals to reviewers where the reviewers supply their evaluations through ordinal ranking. The solution approach we propose for this assignment problem maximizes the number of proposal pairs that will be evaluated by one or more reviewers. This new approach should facilitate meaningful aggregatin of partial rankings of subsets of proposals by multiple reviewers into a consensus ranking. We offer two ways to implement the approach: an integer programming set-covering model and a heuristic procedure. The effectiveness and efficiency of the two models are tested through an extensive simulation experiment.
Description
Rights
defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Collections
Related items
Showing items related by title, author, creator and subject.
-
An evaluation of the Navy's Selected Acquisition Report System
McClung, Lonny Kay (Monterey, California. Naval Postgraduate School, 1975-06);This thesis investigates the Selected Acquisition Reporting (SAR) System in order to evaluate its effectiveness. Significant problem areas associated with the SAR and the reporting criteria of DOD Instruction 7000.3 ... -
The Systems Engineering Body of Knowledge and Graduate Reference Curriculum - BKCASE
Olwell, David; Pyster, Arthur; Squires, Alice; Gelosh, Don; Enck, Stephanie; Anthony, James (Stevens Institute of Technology, 2010);BKCASE is the acronym for the Body of Knowledge and Curriculum to Advance Systems Engineering. The BKCASE project is led by the Stevens Institute of Technology and the Naval Postgraduate School. The project scope is to ... -
PROCURING BULK PETROLEUM FOR THE FEDERAL GOVERNMENT: WHY VENDORS’ OFFERS ARE RATED TECHNICALLY UNACCEPTABLE
Warburton, Ayodele G. (Monterey, CA; Naval Postgraduate School, 2022-09);Every fiscal year, DLA Energy procures global military jet fuel and marine diesel fuel requirements through four major purchase programs: Inland East Gulf Coast; Rocky Mountain West; Atlantic, Europe and Mediterranean; and ...