Development of culture-sensitive clinical teacher evaluation sheet in the Japanese context

Makoto Kikukawa, Renee E. Stalmeijer, Tomoya Okubo, Kikuko Taketomi, Sei Emura, Yasushi Miyata, Motofumi Yoshida, Lambert Schuwirth, Albert J.J.A. Scherpbier

Research output: Contribution to journalArticle

Abstract

Aim: Many instruments for evaluating clinical teaching have been developed, albeit most in Western countries. This study aims to develop a validated cultural and local context sensitive instrument for clinical teachers in an East Asian setting (Japan), Japanese Clinical Teacher Evaluation Sheet (JaCTES). Methods: A multicenter, cross-sectional evaluation study was conducted. We collected a total of 1368 questionnaires on 304 clinical teachers, completed by residents in 16 teaching hospitals. The construct validity was examined by conducting a factor analysis and using structural equation modeling (SEM). We also assessed the reliability using generalizability analysis and decision study. Results: Exploratory factor analysis resulted in three-factor (role model, teaching activities, and accessibility) model including 18 items. Confirmatory factor analysis was performed, using SEM. The comparative fit index was 0.931 and the root mean square error of approximation was 0.087, meaning an acceptable goodness of fit for this model. To obtain a reliable dependability-coefficient of at least 0.70 or higher, 5–8 resident responses are necessary. Discussion and conclusion: JaCTES is the first reported instrument with validity evidence of content and internal structure and high feasibility in Japan, an East Asian setting. Medical educators should be aware of the local context and cultural aspects in evaluating clinical teachers.

Original languageEnglish
Pages (from-to)844-850
Number of pages7
JournalMedical Teacher
Volume39
Issue number8
DOIs
Publication statusPublished - Aug 3 2017

Fingerprint

teacher
factor analysis
evaluation
Teaching
Japan
resident
role model
construct validity
educator
questionnaire
evidence

All Science Journal Classification (ASJC) codes

  • Education

Cite this

Kikukawa, M., Stalmeijer, R. E., Okubo, T., Taketomi, K., Emura, S., Miyata, Y., ... Scherpbier, A. J. J. A. (2017). Development of culture-sensitive clinical teacher evaluation sheet in the Japanese context. Medical Teacher, 39(8), 844-850. https://doi.org/10.1080/0142159X.2017.1324138

Development of culture-sensitive clinical teacher evaluation sheet in the Japanese context. / Kikukawa, Makoto; Stalmeijer, Renee E.; Okubo, Tomoya; Taketomi, Kikuko; Emura, Sei; Miyata, Yasushi; Yoshida, Motofumi; Schuwirth, Lambert; Scherpbier, Albert J.J.A.

In: Medical Teacher, Vol. 39, No. 8, 03.08.2017, p. 844-850.

Research output: Contribution to journalArticle

Kikukawa, M, Stalmeijer, RE, Okubo, T, Taketomi, K, Emura, S, Miyata, Y, Yoshida, M, Schuwirth, L & Scherpbier, AJJA 2017, 'Development of culture-sensitive clinical teacher evaluation sheet in the Japanese context', Medical Teacher, vol. 39, no. 8, pp. 844-850. https://doi.org/10.1080/0142159X.2017.1324138
Kikukawa, Makoto ; Stalmeijer, Renee E. ; Okubo, Tomoya ; Taketomi, Kikuko ; Emura, Sei ; Miyata, Yasushi ; Yoshida, Motofumi ; Schuwirth, Lambert ; Scherpbier, Albert J.J.A. / Development of culture-sensitive clinical teacher evaluation sheet in the Japanese context. In: Medical Teacher. 2017 ; Vol. 39, No. 8. pp. 844-850.
@article{1080f66d8f2048688f9fe8ba0a91370d,
title = "Development of culture-sensitive clinical teacher evaluation sheet in the Japanese context",
abstract = "Aim: Many instruments for evaluating clinical teaching have been developed, albeit most in Western countries. This study aims to develop a validated cultural and local context sensitive instrument for clinical teachers in an East Asian setting (Japan), Japanese Clinical Teacher Evaluation Sheet (JaCTES). Methods: A multicenter, cross-sectional evaluation study was conducted. We collected a total of 1368 questionnaires on 304 clinical teachers, completed by residents in 16 teaching hospitals. The construct validity was examined by conducting a factor analysis and using structural equation modeling (SEM). We also assessed the reliability using generalizability analysis and decision study. Results: Exploratory factor analysis resulted in three-factor (role model, teaching activities, and accessibility) model including 18 items. Confirmatory factor analysis was performed, using SEM. The comparative fit index was 0.931 and the root mean square error of approximation was 0.087, meaning an acceptable goodness of fit for this model. To obtain a reliable dependability-coefficient of at least 0.70 or higher, 5–8 resident responses are necessary. Discussion and conclusion: JaCTES is the first reported instrument with validity evidence of content and internal structure and high feasibility in Japan, an East Asian setting. Medical educators should be aware of the local context and cultural aspects in evaluating clinical teachers.",
author = "Makoto Kikukawa and Stalmeijer, {Renee E.} and Tomoya Okubo and Kikuko Taketomi and Sei Emura and Yasushi Miyata and Motofumi Yoshida and Lambert Schuwirth and Scherpbier, {Albert J.J.A.}",
year = "2017",
month = "8",
day = "3",
doi = "10.1080/0142159X.2017.1324138",
language = "English",
volume = "39",
pages = "844--850",
journal = "Medical Teacher",
issn = "0142-159X",
publisher = "Informa Healthcare",
number = "8",

}

TY - JOUR

T1 - Development of culture-sensitive clinical teacher evaluation sheet in the Japanese context

AU - Kikukawa, Makoto

AU - Stalmeijer, Renee E.

AU - Okubo, Tomoya

AU - Taketomi, Kikuko

AU - Emura, Sei

AU - Miyata, Yasushi

AU - Yoshida, Motofumi

AU - Schuwirth, Lambert

AU - Scherpbier, Albert J.J.A.

PY - 2017/8/3

Y1 - 2017/8/3

N2 - Aim: Many instruments for evaluating clinical teaching have been developed, albeit most in Western countries. This study aims to develop a validated cultural and local context sensitive instrument for clinical teachers in an East Asian setting (Japan), Japanese Clinical Teacher Evaluation Sheet (JaCTES). Methods: A multicenter, cross-sectional evaluation study was conducted. We collected a total of 1368 questionnaires on 304 clinical teachers, completed by residents in 16 teaching hospitals. The construct validity was examined by conducting a factor analysis and using structural equation modeling (SEM). We also assessed the reliability using generalizability analysis and decision study. Results: Exploratory factor analysis resulted in three-factor (role model, teaching activities, and accessibility) model including 18 items. Confirmatory factor analysis was performed, using SEM. The comparative fit index was 0.931 and the root mean square error of approximation was 0.087, meaning an acceptable goodness of fit for this model. To obtain a reliable dependability-coefficient of at least 0.70 or higher, 5–8 resident responses are necessary. Discussion and conclusion: JaCTES is the first reported instrument with validity evidence of content and internal structure and high feasibility in Japan, an East Asian setting. Medical educators should be aware of the local context and cultural aspects in evaluating clinical teachers.

AB - Aim: Many instruments for evaluating clinical teaching have been developed, albeit most in Western countries. This study aims to develop a validated cultural and local context sensitive instrument for clinical teachers in an East Asian setting (Japan), Japanese Clinical Teacher Evaluation Sheet (JaCTES). Methods: A multicenter, cross-sectional evaluation study was conducted. We collected a total of 1368 questionnaires on 304 clinical teachers, completed by residents in 16 teaching hospitals. The construct validity was examined by conducting a factor analysis and using structural equation modeling (SEM). We also assessed the reliability using generalizability analysis and decision study. Results: Exploratory factor analysis resulted in three-factor (role model, teaching activities, and accessibility) model including 18 items. Confirmatory factor analysis was performed, using SEM. The comparative fit index was 0.931 and the root mean square error of approximation was 0.087, meaning an acceptable goodness of fit for this model. To obtain a reliable dependability-coefficient of at least 0.70 or higher, 5–8 resident responses are necessary. Discussion and conclusion: JaCTES is the first reported instrument with validity evidence of content and internal structure and high feasibility in Japan, an East Asian setting. Medical educators should be aware of the local context and cultural aspects in evaluating clinical teachers.

UR - http://www.scopus.com/inward/record.url?scp=85019257872&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85019257872&partnerID=8YFLogxK

U2 - 10.1080/0142159X.2017.1324138

DO - 10.1080/0142159X.2017.1324138

M3 - Article

VL - 39

SP - 844

EP - 850

JO - Medical Teacher

JF - Medical Teacher

SN - 0142-159X

IS - 8

ER -