Date of Award

12-19-2024

Degree Type

Thesis

Degree Name

Master of Health Professions Education

First Advisor

Dr Syeda Kausar Ali

Second Advisor

Dr Amber Sultan

Third Advisor

Dr Bushra Moiz

Department

Community Health Sciences

Abstract

Introduction: Teaching and assessment of dermatology procedures under direct and indirect supervision is part of the fellowship and membership training programs of the College of Physicians & Surgeons, Pakistan. The goal of dermatology training is to ensure the achievement of defined competency in postgraduate dermatology residents, ultimately improving patient care and ensuring optimum outcomes in dermatology procedures. The aim of this study is to determine the validity and reliability of the platelet rich plasma injectable competency assessment tool (PICAT) for formative assessment of dermatology residents at PNS Shifa military hospital, Karachi
Methods: The PICAT validation study for platelet rich plasma procedure (PRP) was conducted at the Department of Dermatology at PNS Shifa Hospital from April 2024 to September 2024. PICAT was developed after an extensive literature search on the PRP procedure. The draft tool was sent to 10 experts for their review based on relevance and clarity of the items. Items with content validity index I-CVI of 0.9 or more were retained. A seven[1]point (0-6) scale was used for rating the items. and to assess overall competence at general level, global rating scale was used. Thirty MCPS and FCPS residents from PGY-I to PGY-III were enrolled in this study, and data was collected on the 19-item PICAT for the PRP procedure performed on mannequins and normal saline in the procedure room. Faculty (assessor) training was done, and two different assessors assessed each resident at the same time. Interclass coefficients (ICC) were used to calculate inter-rater reliability. Cronbach’s alpha was used to calculate the internal consistency of the tool with item-total and inter-item correlation.
Results: All items of PICAT received an I-CVI score of 0.9 and more. The overall reliability of PICAT calculated by Cronbach’s Alpha was 0.94. Interrater reliability calculated with an interclass coefficient (ICC) for each item showed a value above 0.78 with a confidence interval (CI) of 95% (ranging from 0.476 to 0.955) with the p-values of < 0.001. The average Scale Content Validity Index (S-CVI/Average) was found to be 0.92. Proportion Relevance is the sum of score by each expert divided by number of items which ranged from 0.87 to 0.93. Average Proportion relevance of PICAT was found to be 0.91.
Conclusion: The study found that PICAT for the PRP procedure provided adequate validity evidence for content, internal consistency of scores, and inter-rater reliability.

First Page

1

Last Page

60

Download

Share

COinS