Home Print this page Email this page
Users Online: 694
Home About us Editorial board Search Ahead of print Current issue Archives Submit article Instructions Subscribe Contacts Login 
ORIGINAL ARTICLE
Year : 2016  |  Volume : 4  |  Issue : 4  |  Page : 270-275

Flawed multiple-choice questions put on the scale: What is their impact on students' achievement in a final undergraduate surgical examination?


Department of Surgery, Faculty of Medicine, University of Tabuk, Tabuk, Saudi Arabia

Correspondence Address:
Ahmad Abdul Azeem Abdullah Omer
Assistant Professor of General Surgery, Department of Surgery, Faculty of Medicine, University of Tabuk, P.O. Box: 3718, Tabuk 71481
Saudi Arabia
Login to access the Email id


DOI: 10.4103/2468-6360.191908

Rights and Permissions

Background : Violation of item-writing guidelines is still frequently encountered in assessments in medical colleges. Flawed multiple-choice (MC) items affect students' performance and distort examinations' results. Aims: The aim was to assess the frequency and impact of flawed MC items on students' achievement in our setting. Settings and Design: This is a quantitative descriptive study conducted at the Faculty of Medicine in the University of Tabuk, Saudi Arabia. Methods: We evaluated a 100 single-correct answer MC questions summative surgical examination administered to 44 6 th year final medical students in November 2014. MC items, which contain one or more violation of item-writing guidelines, were classified as flawed, those with no violation, were classified as standard. The passing rates and median scores of high- and low-achieving students were calculated on both standard and flawed test scales. Item performance parameters (difficulty index, discrimination power and internal consistency reliability (Kuder-Richardson formula 20) were calculated for standard and flawed items. Descriptive and comparative statistics with the relevant tests of significance were performed using the  SPSS (IBM SPSS Inc. Chicago, Illinois) computer software version 16. Results: Thirty-nine flawed items were identified (39%) which contain 49 violations of the item-writing guidelines. The passing rate was 93.2% and 91.8% on the total and standard scales, respectively. Flawed items benefited low-achieving students and disadvantaged the high-achieving students. Overall, flawed items were less difficult, less discriminating and less reliable than standard items. Conclusions: The frequency of flawed items in our examination was high and reflects the need for more training and faculty development programmes.


[FULL TEXT] [PDF]*
Print this article     Email this article
 Next article
 Previous article
 Table of Contents

 Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
 Citation Manager
 Access Statistics
 Reader Comments
 Email Alert *
 Add to My List *
 * Requires registration (Free)
 

 Article Access Statistics
    Viewed1497    
    Printed15    
    Emailed0    
    PDF Downloaded144    
    Comments [Add]    
    Cited by others 1    

Recommend this journal