Table of Contents
ISRN Education
Volume 2013 (2013), Article ID 585420, 7 pages
http://dx.doi.org/10.1155/2013/585420
Research Article

The Effects of Reusing Written Test Items: A Study Using the Rasch Model

1Department for Medical Education, Medical University of Vienna, Spitalgasse 23, A-1090 Vienna, Austria
2Institute of Medical Education, Curriculum Coordination & Students' Office, University of Bern, Murtenstrasse 11, CH-3010 Bern, Switzerland

Received 25 February 2013; Accepted 5 April 2013

Academic Editors: K. Capps and T. Hovardas

Copyright © 2013 Michaela Wagner-Menghin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background. Relevant literature reports no increase in individual scores when test items are reused, but information on change in item difficulty is lacking. Purpose. To test an approach for quantifying the effects of reusing items on item difficulty. Methods. A total of 671 students sat a newly introduced exam in four testing shifts. The test forms experimentally combined published, unused, and reused items. Figures quantifying reuse effects were obtained using the Rasch model to compare item difficulties from different person samples. Results. The observed decrease in mean item difficulty for reused items was insignificant. Students who self-scheduled to the last test performed worse than other students did. Conclusion. Availability of leaked material did not translate into higher individual scores, as mastering leaked material does not guarantee transfer of knowledge to new exam items. Exam quality will not automatically deteriorate when a low ratio of randomly selected items is reused.