Objective: This article provides resources for educators performing online assessments to curb cheating. We will focus on a method to prevent cheating known as “peer-to-peer sharing” (P2PS), where students take the test together without supervision. Using probability theory, we develop the framework for rigorously analyzing P2PS for given parameters of question pool size, assessment size, and class size.
Methods: The development was as follows: (1) We define “integrity” and “reliability” of online assessments in the context of P2PS; (2) we derive formulas for both reliability and integrity; (3) we address the question of how large a question bank should be to attain a specified level of reliability and integrity, paying special attention of efficiency: (4) we provide a table with sample results for common classroom scenarios to help educators devise efficient question banks; and (5) we include summary charts of cheating methods and strategies. Theoretical models are used to characterize the probabilistic scenario we explore. We use the cumulative distribution function of the hypergeometric function to model this relationship. This model was verified using computer simulations.
Results: Probability theory was used to both define and derive formulas for “reliability” and “integrity” of an online assessment. Charts were created that include question pool size, question number, integrity and reliability for a given student class size.
Conclusion: Educators can use the Tables in this article to determine a reasonable question pool size and amount of questions for an assessment to obtain the integrity and reliability they desire given class size. Summary charts of cheating methods and strategies are included from the literature to provide resources for further exploration of management of cheating and promoting test integrity and reliability. It is difficult to achieve both reliability and integrity if a large portion of the class cheats unless the question pool is very large.
Author keywords: Classroom Assessment, Cheating, Testing Procedures
Author affiliations: MM: Palmer Chiropractic College, Port Orange, Florida, United States; MB: Embry-Riddle Aeronautical University, Daytona [Beach], Florida, United States
This abstract is reproduced with the permission of the publisher. Click on the above link for free full text. Online access only.
|
