Exploration of a possible relationship between examiner stringency and personality factors in clinical assessments: a pilot study

Hdl Handle:
http://hdl.handle.net/10147/560382
Title:
Exploration of a possible relationship between examiner stringency and personality factors in clinical assessments: a pilot study
Authors:
Finn, Yvonne; Cantillon, Peter; Flaherty, Gerard
Citation:
BMC Medical Education. 2014 Dec 31;14(1):1052
Issue Date:
31-Dec-2014
URI:
http://dx.doi.org/10.1186/s12909-014-0280-3; http://hdl.handle.net/10147/560382
Abstract:
Abstract Background The reliability of clinical examinations is known to vary considerably. Inter-examiner variability is a key source of this variability. Some examiners consistently give lower scores to some candidates compared to other examiners and vice versa – the ‘hawk- dove’ effect. Stable examiner characteristics, such as personality factors, may influence examiner stringency. We investigated whether examiner stringency is related to personality factors. Methods We recruited 12 examiners to view and score a video-recorded five station OSCE of six Year 1 undergraduate medical students at our institution. In addition examiners completed a validated personality questionnaire. Examiners’ markings were tested for statistically significant differences using non-parametric one way analysis of variance. The relationship between examiners’ markings and examiner personality factors was investigated using Spearman correlation coefficient. Results At each station there was a statistically significant difference between examiners markings, confirming the presence of inter-examiner variability. Correlation analysis showed no association between stringency and any of the five major personality factors. When we omitted an outlier examiner we found a statistically significant negative correlation between examiner stringency and openness to experience with a correlation coefficients (rho) of – 0.66 (p = 0.03). Conversely there was a moderate positive correlation between examiner stringency and neuroticism with a correlation coefficient (rho) of 0.73 (p = 0.01). Conclusions In this study we did not find any relationship between examiner stringency and examiner personality factors. However, following the elimination of an outlier examiner from the analysis, we found a significant relationship between examiner stringency and two of the big five personality factors (neuroticism and openness to experience). The significance of this outlier is not known. As this was a small pilot study we recommend further studies in this field to investigate if there is a relationship between examiner stringency in clinical assessments and personality factors.
Language:
en
Keywords:
MEDICAL EDUCATION; CLINICAL ASSESSMENT; PERSONALITY

Full metadata record

DC FieldValue Language
dc.contributor.authorFinn, Yvonneen
dc.contributor.authorCantillon, Peteren
dc.contributor.authorFlaherty, Gerarden
dc.date.accessioned2015-07-14T12:11:47Zen
dc.date.available2015-07-14T12:11:47Zen
dc.date.issued2014-12-31en
dc.identifier.citationBMC Medical Education. 2014 Dec 31;14(1):1052en
dc.identifier.urihttp://dx.doi.org/10.1186/s12909-014-0280-3en
dc.identifier.urihttp://hdl.handle.net/10147/560382en
dc.description.abstractAbstract Background The reliability of clinical examinations is known to vary considerably. Inter-examiner variability is a key source of this variability. Some examiners consistently give lower scores to some candidates compared to other examiners and vice versa – the ‘hawk- dove’ effect. Stable examiner characteristics, such as personality factors, may influence examiner stringency. We investigated whether examiner stringency is related to personality factors. Methods We recruited 12 examiners to view and score a video-recorded five station OSCE of six Year 1 undergraduate medical students at our institution. In addition examiners completed a validated personality questionnaire. Examiners’ markings were tested for statistically significant differences using non-parametric one way analysis of variance. The relationship between examiners’ markings and examiner personality factors was investigated using Spearman correlation coefficient. Results At each station there was a statistically significant difference between examiners markings, confirming the presence of inter-examiner variability. Correlation analysis showed no association between stringency and any of the five major personality factors. When we omitted an outlier examiner we found a statistically significant negative correlation between examiner stringency and openness to experience with a correlation coefficients (rho) of – 0.66 (p = 0.03). Conversely there was a moderate positive correlation between examiner stringency and neuroticism with a correlation coefficient (rho) of 0.73 (p = 0.01). Conclusions In this study we did not find any relationship between examiner stringency and examiner personality factors. However, following the elimination of an outlier examiner from the analysis, we found a significant relationship between examiner stringency and two of the big five personality factors (neuroticism and openness to experience). The significance of this outlier is not known. As this was a small pilot study we recommend further studies in this field to investigate if there is a relationship between examiner stringency in clinical assessments and personality factors.-
dc.language.isoenen
dc.subjectMEDICAL EDUCATIONen
dc.subjectCLINICAL ASSESSMENTen
dc.subjectPERSONALITYen
dc.titleExploration of a possible relationship between examiner stringency and personality factors in clinical assessments: a pilot studyen
dc.language.rfc3066en-
dc.rights.holderYvonne Finn et al.; licensee BioMed Central Ltd.-
dc.description.statusPeer Reviewed-
dc.date.updated2015-01-14T20:04:49Z-
All Items in Lenus, The Irish Health Repository are protected by copyright, with all rights reserved, unless otherwise indicated.