Date of Award

10-9-2024

Degree Type

Thesis

Degree Name

Master of Health Professions Education

First Advisor

Dr Azam S. Afzal

Second Advisor

Dr Bushra Moiz

Third Advisor

Dr Zubair Amin

Department

Community Health Sciences

Abstract

Introduction: A reliable and valid method of technical skill assessment is mandatory for a competency[1]based curriculum. Direct ophthalmoscopy is essential for ophthalmologists, optometrists, family medicine practitioners, and various other specialities. This study aims to develop a valid and reliable assessment tool to assess the skill of direct ophthalmoscopy of undergraduate medical students of a private medical college.
Methodology: This cross-sectional, analytic, prospective study was conducted on the fourth-year medical students of a private medical college from December 2023 to July 2024 after ethical approval from parent institutions. An objective structured assessment of direct ophthalmoscopy skills (OSADOS) tool was developed for the formative evaluation of direct ophthalmoscopy skills by devising items through selection from scholarly internet sources and the standard textbook of ophthalmology. Five validity evidence described by Messick were investigated. The tool was applied to assess the Direct ophthalmoscopy skill of students on a simulated patient. An expert provided constructive feedback after the performance of ophthalmoscopy. The scores obtained were computed for. Cronbach’s Alpha, McDonald's Omega, and interrater reliability for validation of internal structure, convergent validity, and divergent validity were calculated to confirm the relation with other variables, and the effect size was estimated to ascertain consequential validation.
Results: There were sixty-six males and twenty-six females. The age ranged from twenty-one to twenty-five years. The content validation ratio ranged from 0.8 to 1.0, showing good content validity. The Cronbach’s alpha was 0.905, McDonald’s omega was 0.899, and interrater reliability was 0.920, confirming excellent internal structure validity. Convergent validity was 0.526, and divergent validity was 0.202, establishing a good relationship with other variables. The value of Cohen’s was 1.87, showing a very large effect size.
Conclusion: The newly developed twenty-nine-item OSADOS tool is a valid and reliable scale for assessing direct ophthalmoscopy skills of undergraduate medical students during the clerkship in ophthalmology.

First Page

1

Last Page

72

Download

Share

COinS