Correlation of selection scores with in-training performance scores and success in exit-level examination in anaesthesiology residents at Aga Khan University
Date of Award
Master of Health Professions Education (MPHE)
The aim of residency programmes is to select residents who perform well and develop into future experts. To attain this, selection criteria should be capable of predicting future performance. Several authors from United States of America have attempted to correlate selection criteria with subsequent performance and have obtained varying results. No data is available from other parts of the world. The author's objectives are to determine the correlation of selection scores with intraining performance and success in exit-level examination in anaesthesiology residents at Aga Khan University. Methods: Exemption was granted by institutional Ethics Review Committee. Data was collected on 24 residents inducted from 2004 to 2007. Residency selection criteria (RSS) included entrance test scores, final MBBS scores, year of graduation and interview scores. Assessment process included written papers, clinical assessment and viva voce. Success in exit-level examination was noted. Nonparametric spearman rank correlation coefficient (r,) was computed to assess the direction and strength of relationship between the scores. Chi-square test was applied to compare relationships between success in exit level examination and RSS. Results: No correlation was found between overall RSS and assessment scores and between pre-interview selection criteria or interview scores and resident performance. Positive correlation was observed between cognitive components of selection scores and five year average scores for cognitive assessment [r, = 0.41, p = 0.05]. Similarly a moderately positive correlation was observed between interview scores and average scores for clinical assessment [r8 = 0.427, p = 0.037]. Candidates scoring below average marks in RSS obtained similar scores throughout residency, whereas above average scorers were not able to maintain their scores during residency. Success in exit level examination showed no correlation with RSS. Conclusion: The results of this study should be interpreted with caution because the validity and reliability of the scores used in the study could not be ascertained. There is a need for developing standardized objective tools for selection process. Anaesthesiology training programmes must identify personality attributes and traits required to attain excellence in the specialty and incorporate them in the selection process.
Ahmed, A. (2014). Correlation of selection scores with in-training performance scores and success in exit-level examination in anaesthesiology residents at Aga Khan University (Unpublished doctoral thesis). Aga Khan University, Karachi, Pakistan.