Credible and Defensible Assessments of Entry-Level Clinical Competence: Insights from a Modified Delphi Study

Rachel BACON, Lauren Williams, Laurie Grealish, Maggie JAMIESON

Research output: Contribution to journalArticle

Abstract

Background: During clinical placements, supervisors repeatedly assess health and medical students for competence. Quality assessment is dependent upon the supervisors having a rich understanding of entry-level standards and an assessment approach that is sufficiently dynamic to accommodate the changing healthcare system. This study aimed to assess whether consensus could be gained by supervisors when assessing the performance of student dietitians during clinical placements and to establish a shared interpretation of entry-level clinical competence. Methods: A modified 3-round Delphi study with a focus group discussion was conducted with eight supervisors. Participants were required to assess the performance of student dietitians from audiovisual recordings of authentic student‒client consultations in aged-care and outpatient settings. Results: Consensus was achieved for 2/11 assessments after one Delphi round, 6/11 assessments after two rounds and 10/11 assessments after the third and final round. During the focus group discussion, the expert panel expressed a shared understanding of entry-level performance, however this was not transferred into a shared assessment of entry-level performance in the Delphi task. Conclusions: Dialogue amongst supervisors leads to a more reliable interpretation of the competency standards. A shared responsibility for assessment, with continuous and open negotiation of meaning, is required to ensure quality assessments of entry-level practice.
Original languageEnglish
Pages (from-to)57-72
Number of pages12
JournalFocus on Health Professional Education
Volume16
Issue number3
DOIs
Publication statusPublished - 2015

Fingerprint

Delphi Technique
Clinical Competence
Nutritionists
Focus Groups
Consensus
Students
Negotiating
Ambulatory Care
Medical Students
Mental Competency
Referral and Consultation
Delivery of Health Care
Health

Cite this

@article{df0e6da86df34b5a840e92964ffb3d00,
title = "Credible and Defensible Assessments of Entry-Level Clinical Competence: Insights from a Modified Delphi Study",
abstract = "Background: During clinical placements, supervisors repeatedly assess health and medical students for competence. Quality assessment is dependent upon the supervisors having a rich understanding of entry-level standards and an assessment approach that is sufficiently dynamic to accommodate the changing healthcare system. This study aimed to assess whether consensus could be gained by supervisors when assessing the performance of student dietitians during clinical placements and to establish a shared interpretation of entry-level clinical competence. Methods: A modified 3-round Delphi study with a focus group discussion was conducted with eight supervisors. Participants were required to assess the performance of student dietitians from audiovisual recordings of authentic student‒client consultations in aged-care and outpatient settings. Results: Consensus was achieved for 2/11 assessments after one Delphi round, 6/11 assessments after two rounds and 10/11 assessments after the third and final round. During the focus group discussion, the expert panel expressed a shared understanding of entry-level performance, however this was not transferred into a shared assessment of entry-level performance in the Delphi task. Conclusions: Dialogue amongst supervisors leads to a more reliable interpretation of the competency standards. A shared responsibility for assessment, with continuous and open negotiation of meaning, is required to ensure quality assessments of entry-level practice.",
keywords = "Dialogue amongst supervisors leads to a more reliable interpretation of the competency standards. A shared responsibility for assessment, with continuous and open negotiation of meaning, is required to ensure quality assessments of entry- level practice., Credible and defensible assessment of entry-level clinical competence: Insights from a modified Delphi study, assessment, competence, clinical placements, Delphi study",
author = "Rachel BACON and Lauren Williams and Laurie Grealish and Maggie JAMIESON",
year = "2015",
doi = "10.11157/fohpe.v16i3.86",
language = "English",
volume = "16",
pages = "57--72",
journal = "Focus on Health Professional Education",
issn = "1442-1100",
number = "3",

}

Credible and Defensible Assessments of Entry-Level Clinical Competence: Insights from a Modified Delphi Study. / BACON, Rachel; Williams, Lauren; Grealish, Laurie; JAMIESON, Maggie.

In: Focus on Health Professional Education, Vol. 16, No. 3, 2015, p. 57-72.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Credible and Defensible Assessments of Entry-Level Clinical Competence: Insights from a Modified Delphi Study

AU - BACON, Rachel

AU - Williams, Lauren

AU - Grealish, Laurie

AU - JAMIESON, Maggie

PY - 2015

Y1 - 2015

N2 - Background: During clinical placements, supervisors repeatedly assess health and medical students for competence. Quality assessment is dependent upon the supervisors having a rich understanding of entry-level standards and an assessment approach that is sufficiently dynamic to accommodate the changing healthcare system. This study aimed to assess whether consensus could be gained by supervisors when assessing the performance of student dietitians during clinical placements and to establish a shared interpretation of entry-level clinical competence. Methods: A modified 3-round Delphi study with a focus group discussion was conducted with eight supervisors. Participants were required to assess the performance of student dietitians from audiovisual recordings of authentic student‒client consultations in aged-care and outpatient settings. Results: Consensus was achieved for 2/11 assessments after one Delphi round, 6/11 assessments after two rounds and 10/11 assessments after the third and final round. During the focus group discussion, the expert panel expressed a shared understanding of entry-level performance, however this was not transferred into a shared assessment of entry-level performance in the Delphi task. Conclusions: Dialogue amongst supervisors leads to a more reliable interpretation of the competency standards. A shared responsibility for assessment, with continuous and open negotiation of meaning, is required to ensure quality assessments of entry-level practice.

AB - Background: During clinical placements, supervisors repeatedly assess health and medical students for competence. Quality assessment is dependent upon the supervisors having a rich understanding of entry-level standards and an assessment approach that is sufficiently dynamic to accommodate the changing healthcare system. This study aimed to assess whether consensus could be gained by supervisors when assessing the performance of student dietitians during clinical placements and to establish a shared interpretation of entry-level clinical competence. Methods: A modified 3-round Delphi study with a focus group discussion was conducted with eight supervisors. Participants were required to assess the performance of student dietitians from audiovisual recordings of authentic student‒client consultations in aged-care and outpatient settings. Results: Consensus was achieved for 2/11 assessments after one Delphi round, 6/11 assessments after two rounds and 10/11 assessments after the third and final round. During the focus group discussion, the expert panel expressed a shared understanding of entry-level performance, however this was not transferred into a shared assessment of entry-level performance in the Delphi task. Conclusions: Dialogue amongst supervisors leads to a more reliable interpretation of the competency standards. A shared responsibility for assessment, with continuous and open negotiation of meaning, is required to ensure quality assessments of entry-level practice.

KW - Dialogue amongst supervisors leads to a more reliable interpretation of the competency standards. A shared responsibility for assessment

KW - with continuous and open negotiation of meaning

KW - is required to ensure quality assessments of entry- level practice.

KW - Credible and defensible assessment of entry-level clinical competence: Insights from a modified Delphi study

KW - assessment

KW - competence

KW - clinical placements

KW - Delphi study

UR - http://www.mendeley.com/research/credible-defensible-assessment-entrylevel-clinical-competence-insights-modified-delphi-study

U2 - 10.11157/fohpe.v16i3.86

DO - 10.11157/fohpe.v16i3.86

M3 - Article

VL - 16

SP - 57

EP - 72

JO - Focus on Health Professional Education

JF - Focus on Health Professional Education

SN - 1442-1100

IS - 3

ER -