Clinical observed performance evaluation: a prospective study in final year students of surgery.

Hdl Handle:
http://hdl.handle.net/10147/126486
Title:
Clinical observed performance evaluation: a prospective study in final year students of surgery.
Authors:
Markey, G C; Browne, K; Hunter, K; Hill, A D
Affiliation:
Department of Surgery, RCSI/Beaumont Hospital, Dublin 9, Ireland, gcmarkey@stjames.ie.
Citation:
Clinical observed performance evaluation: a prospective study in final year students of surgery. 2010: Adv Health Sci Educ Theory Pract
Journal:
Advances in health sciences education : theory and practice
Issue Date:
24-Jun-2010
URI:
http://hdl.handle.net/10147/126486
DOI:
10.1007/s10459-010-9240-9
PubMed ID:
20571858
Abstract:
We report a prospective study of clinical observed performance evaluation (COPE) for 197 medical students in the pre-qualification year of clinical education. Psychometric quality was the main endpoint. Students were assessed in groups of 5 in 40-min patient encounters, with each student the focus of evaluation for 8 min. Each student had a series of assessments in a 25-week teaching programme. Over time, several clinicians from a pool of 16 surgical consultants and registrars evaluated each student by direct observation. A structured rating form was used for assessment data. Variance component analysis (VCA), internal consistency and inter-rater agreement were used to estimate reliability. The predictive and convergent validity of COPE in relation to summative OSCE, long case, and overall final examination was estimated. Median number of COPE assessments per student was 7. Generalisability of a mean score over 7 COPE assessments was 0.66, equal to that of an 8 x 7.5 min station final OSCE. Internal consistency was 0.88-0.97 and inter-rater agreement 0.82. Significant correlations were observed with OSCE performance (R = 0.55 disattenuated) and long case (R = 0.47 disattenuated). Convergent validity was 0.81 by VCA. Overall final examination performance was linearly related to mean COPE score with standard error 3.7%. COPE permitted efficient serial assessment of a large cohort of final year students in a real world setting. Its psychometric quality compared well with conventional assessments and with other direct observation instruments as reported in the literature. Effect on learning, and translation to clinical care, are directions for future research.
Item Type:
Article In Press
ISSN:
1573-1677

Full metadata record

DC FieldValue Language
dc.contributor.authorMarkey, G Cen
dc.contributor.authorBrowne, Ken
dc.contributor.authorHunter, Ken
dc.contributor.authorHill, A Den
dc.date.accessioned2011-03-31T09:06:50Z-
dc.date.available2011-03-31T09:06:50Z-
dc.date.issued2010-06-24-
dc.identifier.citationClinical observed performance evaluation: a prospective study in final year students of surgery. 2010: Adv Health Sci Educ Theory Practen
dc.identifier.issn1573-1677-
dc.identifier.pmid20571858-
dc.identifier.doi10.1007/s10459-010-9240-9-
dc.identifier.urihttp://hdl.handle.net/10147/126486-
dc.description.abstractWe report a prospective study of clinical observed performance evaluation (COPE) for 197 medical students in the pre-qualification year of clinical education. Psychometric quality was the main endpoint. Students were assessed in groups of 5 in 40-min patient encounters, with each student the focus of evaluation for 8 min. Each student had a series of assessments in a 25-week teaching programme. Over time, several clinicians from a pool of 16 surgical consultants and registrars evaluated each student by direct observation. A structured rating form was used for assessment data. Variance component analysis (VCA), internal consistency and inter-rater agreement were used to estimate reliability. The predictive and convergent validity of COPE in relation to summative OSCE, long case, and overall final examination was estimated. Median number of COPE assessments per student was 7. Generalisability of a mean score over 7 COPE assessments was 0.66, equal to that of an 8 x 7.5 min station final OSCE. Internal consistency was 0.88-0.97 and inter-rater agreement 0.82. Significant correlations were observed with OSCE performance (R = 0.55 disattenuated) and long case (R = 0.47 disattenuated). Convergent validity was 0.81 by VCA. Overall final examination performance was linearly related to mean COPE score with standard error 3.7%. COPE permitted efficient serial assessment of a large cohort of final year students in a real world setting. Its psychometric quality compared well with conventional assessments and with other direct observation instruments as reported in the literature. Effect on learning, and translation to clinical care, are directions for future research.-
dc.languageENG-
dc.titleClinical observed performance evaluation: a prospective study in final year students of surgery.en
dc.typeArticle In Pressen
dc.contributor.departmentDepartment of Surgery, RCSI/Beaumont Hospital, Dublin 9, Ireland, gcmarkey@stjames.ie.en
dc.identifier.journalAdvances in health sciences education : theory and practiceen
dc.description.provinceLeinster-

Related articles on PubMed

All Items in Lenus, The Irish Health Repository are protected by copyright, with all rights reserved, unless otherwise indicated.