An instrument for evaluating clinical teaching in Japan: Content validity and cultural sensitivity

Makoto Kikukawa, Renee E. Stalmeijer, Sei Emura, Sue Roff, Albert J.J.A. Scherpbier

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Background: Many instruments for evaluating clinical teaching have been developed but almost all in Western countries. None of these instruments have been validated for the Asian culture, and a literature search yielded no instruments that were developed specifically for that culture. A key element that influences content validity in developing instruments for evaluating the quality of teaching is culture. The aim of this study was to develop a culture-specific instrument with strong content validity for evaluating clinical teaching in initial medical postgraduate training in Japan.

Methods: Based on data from a literature search and an earlier study we prepared a draft evaluation instrument. To ensure a good cultural fit of the instrument with the Asian context we conducted a modified Delphi procedure among three groups of stakeholders (five education experts, twelve clinical teachers and ten residents) to establish content validity, as this factor is particularly susceptible to cultural factors.

Results: Two rounds of Delphi were conducted. Through the procedure, 52 prospective items were reworded, combined or eliminated, resulting in a 25-item instrument validated for the Japanese setting.

Conclusions: This is the first study describing the development and content validation of an instrument for evaluating clinical teaching specifically tailored to an East Asian setting. The instrument has similarities and differences compared with instruments of Western origin. Our findings suggest that designers of evaluation instruments should consider the probability that the content validity of instruments for evaluating clinical teachers can be influenced by cultural aspects.

Original languageEnglish
Article number179
JournalBMC Medical Education
Volume14
Issue number1
DOIs
Publication statusPublished - Aug 28 2014

Fingerprint

Japan
Teaching
teacher
cultural factors
evaluation
stakeholder
expert
resident

All Science Journal Classification (ASJC) codes

  • Education

Cite this

An instrument for evaluating clinical teaching in Japan : Content validity and cultural sensitivity. / Kikukawa, Makoto; Stalmeijer, Renee E.; Emura, Sei; Roff, Sue; Scherpbier, Albert J.J.A.

In: BMC Medical Education, Vol. 14, No. 1, 179, 28.08.2014.

Research output: Contribution to journalArticle

Kikukawa, Makoto ; Stalmeijer, Renee E. ; Emura, Sei ; Roff, Sue ; Scherpbier, Albert J.J.A. / An instrument for evaluating clinical teaching in Japan : Content validity and cultural sensitivity. In: BMC Medical Education. 2014 ; Vol. 14, No. 1.
@article{2e2c40a51690499bad768cdff32bb338,
title = "An instrument for evaluating clinical teaching in Japan: Content validity and cultural sensitivity",
abstract = "Background: Many instruments for evaluating clinical teaching have been developed but almost all in Western countries. None of these instruments have been validated for the Asian culture, and a literature search yielded no instruments that were developed specifically for that culture. A key element that influences content validity in developing instruments for evaluating the quality of teaching is culture. The aim of this study was to develop a culture-specific instrument with strong content validity for evaluating clinical teaching in initial medical postgraduate training in Japan.Methods: Based on data from a literature search and an earlier study we prepared a draft evaluation instrument. To ensure a good cultural fit of the instrument with the Asian context we conducted a modified Delphi procedure among three groups of stakeholders (five education experts, twelve clinical teachers and ten residents) to establish content validity, as this factor is particularly susceptible to cultural factors.Results: Two rounds of Delphi were conducted. Through the procedure, 52 prospective items were reworded, combined or eliminated, resulting in a 25-item instrument validated for the Japanese setting.Conclusions: This is the first study describing the development and content validation of an instrument for evaluating clinical teaching specifically tailored to an East Asian setting. The instrument has similarities and differences compared with instruments of Western origin. Our findings suggest that designers of evaluation instruments should consider the probability that the content validity of instruments for evaluating clinical teachers can be influenced by cultural aspects.",
author = "Makoto Kikukawa and Stalmeijer, {Renee E.} and Sei Emura and Sue Roff and Scherpbier, {Albert J.J.A.}",
year = "2014",
month = "8",
day = "28",
doi = "10.1186/1472-6920-14-179",
language = "English",
volume = "14",
journal = "BMC Medical Education",
issn = "1472-6920",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - An instrument for evaluating clinical teaching in Japan

T2 - Content validity and cultural sensitivity

AU - Kikukawa, Makoto

AU - Stalmeijer, Renee E.

AU - Emura, Sei

AU - Roff, Sue

AU - Scherpbier, Albert J.J.A.

PY - 2014/8/28

Y1 - 2014/8/28

N2 - Background: Many instruments for evaluating clinical teaching have been developed but almost all in Western countries. None of these instruments have been validated for the Asian culture, and a literature search yielded no instruments that were developed specifically for that culture. A key element that influences content validity in developing instruments for evaluating the quality of teaching is culture. The aim of this study was to develop a culture-specific instrument with strong content validity for evaluating clinical teaching in initial medical postgraduate training in Japan.Methods: Based on data from a literature search and an earlier study we prepared a draft evaluation instrument. To ensure a good cultural fit of the instrument with the Asian context we conducted a modified Delphi procedure among three groups of stakeholders (five education experts, twelve clinical teachers and ten residents) to establish content validity, as this factor is particularly susceptible to cultural factors.Results: Two rounds of Delphi were conducted. Through the procedure, 52 prospective items were reworded, combined or eliminated, resulting in a 25-item instrument validated for the Japanese setting.Conclusions: This is the first study describing the development and content validation of an instrument for evaluating clinical teaching specifically tailored to an East Asian setting. The instrument has similarities and differences compared with instruments of Western origin. Our findings suggest that designers of evaluation instruments should consider the probability that the content validity of instruments for evaluating clinical teachers can be influenced by cultural aspects.

AB - Background: Many instruments for evaluating clinical teaching have been developed but almost all in Western countries. None of these instruments have been validated for the Asian culture, and a literature search yielded no instruments that were developed specifically for that culture. A key element that influences content validity in developing instruments for evaluating the quality of teaching is culture. The aim of this study was to develop a culture-specific instrument with strong content validity for evaluating clinical teaching in initial medical postgraduate training in Japan.Methods: Based on data from a literature search and an earlier study we prepared a draft evaluation instrument. To ensure a good cultural fit of the instrument with the Asian context we conducted a modified Delphi procedure among three groups of stakeholders (five education experts, twelve clinical teachers and ten residents) to establish content validity, as this factor is particularly susceptible to cultural factors.Results: Two rounds of Delphi were conducted. Through the procedure, 52 prospective items were reworded, combined or eliminated, resulting in a 25-item instrument validated for the Japanese setting.Conclusions: This is the first study describing the development and content validation of an instrument for evaluating clinical teaching specifically tailored to an East Asian setting. The instrument has similarities and differences compared with instruments of Western origin. Our findings suggest that designers of evaluation instruments should consider the probability that the content validity of instruments for evaluating clinical teachers can be influenced by cultural aspects.

UR - http://www.scopus.com/inward/record.url?scp=84907063451&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84907063451&partnerID=8YFLogxK

U2 - 10.1186/1472-6920-14-179

DO - 10.1186/1472-6920-14-179

M3 - Article

C2 - 25164309

AN - SCOPUS:84907063451

VL - 14

JO - BMC Medical Education

JF - BMC Medical Education

SN - 1472-6920

IS - 1

M1 - 179

ER -