TY - JOUR
T1 - A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE)
T2 - Vaginal laceration repair
AU - Winkel, Abigail Ford
AU - Lerner, Veronica
AU - Zabar, Sondra R.
AU - Szyld, Demian
PY - 2013/1/1
Y1 - 2013/1/1
N2 - Objectives: Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Methods: Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Results: Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Conclusions: Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers.
AB - Objectives: Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Methods: Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Results: Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Conclusions: Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers.
KW - assessment
KW - episiotomy
KW - observed structured clinical examination
KW - residency
KW - technical skills
KW - vaginal laceration repair
UR - http://www.scopus.com/inward/record.url?scp=84872807738&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84872807738&partnerID=8YFLogxK
U2 - 10.1016/j.jsurg.2012.08.005
DO - 10.1016/j.jsurg.2012.08.005
M3 - Article
C2 - 23337664
AN - SCOPUS:84872807738
SN - 1931-7204
VL - 70
SP - 10
EP - 14
JO - Journal of Surgical Education
JF - Journal of Surgical Education
IS - 1
ER -