Development and validation of objective structured assessment of technical skills tool for labor epidural block (OSATS-LEB)

Date of Award

10-2025

Degree Type

Thesis

Degree Name

Master of Health Professions Education

First Advisor

Dr Aliya Ahmed

Second Advisor

Dr Amber Sultan

Third Advisor

Dr Shaista Afzal

Department

Educational Development

Abstract

Background: The anaesthesiology training program at The Aga Khan University lacks an objective mechanism for workplace-based assessment of labor epidural block. To the best of our knowledge. no validated OSATS tool is available in the literature to assess this crucial clinical skill. Therefore, this study was designed to construct a valid and reliable OSATS tool to assess residents' clinical skills in performing the labor epidural block with the eventual aim of implementing the tool in the residency curriculum for formative assessment. It is expected that b1' adopting this new OSATS tool, we will be able to overcome the training gap by providing residents an opportunity to have au objective assessment of their labor epidural block performance skill with structured and relevant feedback in real time.
Objectives: To develop a valid and reliable OSATS tool for the Labor Epidural Block for formative assessment of anaesthesiology residents.
Methodology: This was a tool validation study conducted at Aga Khan University, Karachi. Non- probability purposive sampling was done" and seventeen year two residents were included as study participants. Two full-day workshops were conducted to teach and assess the labor epidural block. The residents performed a labor epidural block on a manikin after hands-on training, and their -'rocedural steps were scored by three assessors on the study tool. The statistical analysis was informed using SPSS 20. Cronbach's alpha was calculated to determine internal consistency, while interclass correlation was determined to assess interrater reliability.
Result: The tool showed good internal consistency for the Procedure section (α = 0.861), indicatintg that the items within this section reliably measured the same underlying construct, and an excellent internal consistency for the global rating scale (α = 0.929), reflecting the high degree of coherence among items. It demonstrated a borderline moderate inter-rater reliability (ICC = 0.471) for the Procedure section and moderately good reliability for GRS (ICC = 0.603).
Conclusion: The OSATS-LEB is a reliable and validated tool for formative assessment of the technical skills of anaesthesiology residents in labor epidural block placement.

First Page

1

Last Page

37

This document is available in the relevant AKU library.

Share

COinS