Clinical observed performance evaluation: a prospective study in final year students of surgery.
Affiliation
Department of Surgery, RCSI/Beaumont Hospital, Dublin 9, Ireland, gcmarkey@stjames.ie.Issue Date
2010-06-24
Metadata
Show full item recordCitation
Clinical observed performance evaluation: a prospective study in final year students of surgery. 2010: Adv Health Sci Educ Theory PractJournal
Advances in health sciences education : theory and practiceDOI
10.1007/s10459-010-9240-9PubMed ID
20571858Abstract
We report a prospective study of clinical observed performance evaluation (COPE) for 197 medical students in the pre-qualification year of clinical education. Psychometric quality was the main endpoint. Students were assessed in groups of 5 in 40-min patient encounters, with each student the focus of evaluation for 8 min. Each student had a series of assessments in a 25-week teaching programme. Over time, several clinicians from a pool of 16 surgical consultants and registrars evaluated each student by direct observation. A structured rating form was used for assessment data. Variance component analysis (VCA), internal consistency and inter-rater agreement were used to estimate reliability. The predictive and convergent validity of COPE in relation to summative OSCE, long case, and overall final examination was estimated. Median number of COPE assessments per student was 7. Generalisability of a mean score over 7 COPE assessments was 0.66, equal to that of an 8 x 7.5 min station final OSCE. Internal consistency was 0.88-0.97 and inter-rater agreement 0.82. Significant correlations were observed with OSCE performance (R = 0.55 disattenuated) and long case (R = 0.47 disattenuated). Convergent validity was 0.81 by VCA. Overall final examination performance was linearly related to mean COPE score with standard error 3.7%. COPE permitted efficient serial assessment of a large cohort of final year students in a real world setting. Its psychometric quality compared well with conventional assessments and with other direct observation instruments as reported in the literature. Effect on learning, and translation to clinical care, are directions for future research.Item Type
Article In PressISSN
1573-1677ae974a485f413a2113503eed53cd6c53
10.1007/s10459-010-9240-9
Scopus Count
Collections
Related articles
- Analysis of quality and feasibility of an objective structured clinical examination (OSCE) in preclinical dental education.
- Authors: Eberhard L, Hassel A, Bäumer A, Becker F, Beck-Mubotter J, Bömicke W, Corcodel N, Cosgarea R, Eiffler C, Giannakopoulos NN, Kraus T, Mahabadi J, Rues S, Schmitter M, Wolff D, Wege KC
- Issue date: 2011 Aug
- Predictive validity of measurements of clinical competence using the team objective structured bedside assessment (TOSBA): assessing the clinical competence of final year medical students.
- Authors: Meagher FM, Butler MW, Miller SD, Costello RW, Conroy RM, McElvaney NG
- Issue date: 2009 Nov
- Development and pilot testing of an OSCE for difficult conversations in surgical intensive care.
- Authors: Chipman JG, Beilman GJ, Schmitz CC, Seatter SC
- Issue date: 2007 Mar-Apr
- Can student tutors act as examiners in an objective structured clinical examination?
- Authors: Chenot JF, Simmenroth-Nayda A, Koch A, Fischer T, Scherer M, Emmert B, Stanske B, Kochen MM, Himmel W
- Issue date: 2007 Nov
- How do students with dyslexia perform in extended matching questions, short answer questions and observed structured clinical examinations?
- Authors: Gibson S, Leinster S
- Issue date: 2011 Aug