Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy

Heather A. Jacene, Sophie Leboulleux, Shingo Baba, Daniel Chatzifotiadis, Behnaz Goudarzi, Oleg Teytelbaum, Karen M. Horton, Ihab Kamel, Katarzyna J. Macura, Hua Ling Tsai, Jeanne Kowalski, Richard L. Wahl

Research output: Contribution to journalArticle

57 Citations (Scopus)

Abstract

Our goal was to estimate and compare across different readers the reproducibility of the 18F-FDG PET standardized uptake value (SUV) and CT size measurements, and changes in those measurements, in malignant tumors before and after therapy. Methods: Fifty-two tumors in 25 patients were evaluated on 18F-FDG PET/CT scans. Maximum SUVs (SUVbw max) and CT size measurements were determined for each tumor independently on pre- and posttreatment scans by 8 different readers (4 PET, 4 CT) using routine nonautomated clinical methods. Percentage changes in SUVbw max and CT size between pre- and posttreatment scans were calculated. Interobserver reproducibility of SUVbw max, CT size, and changes in these values were described by intraclass correlation coefficients (ICCs) and estimates of variance. Results: The ICC was higher for the pretreatment, posttreatment, and percentage change in SUVbw max than the ICC for the longest CT size and the 2-dimensional CT size (before treatment, 0.93, 0.72, and 0.61, respectively; after treatment, 0.91, 0.85, and 0.45, respectively; and percentage change, 0.94, 0.70, and 0.33, respectively). The variability of SUVbw max was significantly lower than the variability of the longest CT size and the 2-dimensional CT size (mean ± SD before treatment, 6.3% ± 14.2%, 16.2% ± 17.8%, and 27.5% ± 26.7%, respectively, P ≤ 0.001; and after treatment, 18.4% ± 26.8%, 35.1% ± 47.5%, and 50.9% ± 51.4%, respectively, P ≤ 0.02). The variability of percentage change in SUVbw max (16.7% ± 36.2%) was significantly lower than that for percentage change in the longest CT size (156.3% ± 157.3%, P ≤ 0.0001) and the 2-dimensional CT size (178.4% ± 546.5%, P < 0.0001). Conclusion: The interobserver reproducibility of SUVbw max for both untreated and treated tumors and percentage change in SUVbw max are substantially higher than measurements of CT size and percentage change in CT size. Measurements of tumor metabolism by PET should be included in trials to assess response to therapy. Although PET reproducibility was high, the variability observed in analyses of identical image sets by 4 readers indicates that automated analytic tools to assess response might be helpful to further enhance reproducibility.

Original languageEnglish
Pages (from-to)1760-1769
Number of pages10
JournalJournal of Nuclear Medicine
Volume50
Issue number11
DOIs
Publication statusPublished - Nov 1 2009

Fingerprint

Fluorodeoxyglucose F18
Neoplasms
Therapeutics

All Science Journal Classification (ASJC) codes

  • Radiology Nuclear Medicine and imaging

Cite this

Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy. / Jacene, Heather A.; Leboulleux, Sophie; Baba, Shingo; Chatzifotiadis, Daniel; Goudarzi, Behnaz; Teytelbaum, Oleg; Horton, Karen M.; Kamel, Ihab; Macura, Katarzyna J.; Tsai, Hua Ling; Kowalski, Jeanne; Wahl, Richard L.

In: Journal of Nuclear Medicine, Vol. 50, No. 11, 01.11.2009, p. 1760-1769.

Research output: Contribution to journalArticle

Jacene, HA, Leboulleux, S, Baba, S, Chatzifotiadis, D, Goudarzi, B, Teytelbaum, O, Horton, KM, Kamel, I, Macura, KJ, Tsai, HL, Kowalski, J & Wahl, RL 2009, 'Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy', Journal of Nuclear Medicine, vol. 50, no. 11, pp. 1760-1769. https://doi.org/10.2967/jnumed.109.063321
Jacene, Heather A. ; Leboulleux, Sophie ; Baba, Shingo ; Chatzifotiadis, Daniel ; Goudarzi, Behnaz ; Teytelbaum, Oleg ; Horton, Karen M. ; Kamel, Ihab ; Macura, Katarzyna J. ; Tsai, Hua Ling ; Kowalski, Jeanne ; Wahl, Richard L. / Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy. In: Journal of Nuclear Medicine. 2009 ; Vol. 50, No. 11. pp. 1760-1769.
@article{744cc7f5bd7441d78c76c8b547578949,
title = "Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy",
abstract = "Our goal was to estimate and compare across different readers the reproducibility of the 18F-FDG PET standardized uptake value (SUV) and CT size measurements, and changes in those measurements, in malignant tumors before and after therapy. Methods: Fifty-two tumors in 25 patients were evaluated on 18F-FDG PET/CT scans. Maximum SUVs (SUVbw max) and CT size measurements were determined for each tumor independently on pre- and posttreatment scans by 8 different readers (4 PET, 4 CT) using routine nonautomated clinical methods. Percentage changes in SUVbw max and CT size between pre- and posttreatment scans were calculated. Interobserver reproducibility of SUVbw max, CT size, and changes in these values were described by intraclass correlation coefficients (ICCs) and estimates of variance. Results: The ICC was higher for the pretreatment, posttreatment, and percentage change in SUVbw max than the ICC for the longest CT size and the 2-dimensional CT size (before treatment, 0.93, 0.72, and 0.61, respectively; after treatment, 0.91, 0.85, and 0.45, respectively; and percentage change, 0.94, 0.70, and 0.33, respectively). The variability of SUVbw max was significantly lower than the variability of the longest CT size and the 2-dimensional CT size (mean ± SD before treatment, 6.3{\%} ± 14.2{\%}, 16.2{\%} ± 17.8{\%}, and 27.5{\%} ± 26.7{\%}, respectively, P ≤ 0.001; and after treatment, 18.4{\%} ± 26.8{\%}, 35.1{\%} ± 47.5{\%}, and 50.9{\%} ± 51.4{\%}, respectively, P ≤ 0.02). The variability of percentage change in SUVbw max (16.7{\%} ± 36.2{\%}) was significantly lower than that for percentage change in the longest CT size (156.3{\%} ± 157.3{\%}, P ≤ 0.0001) and the 2-dimensional CT size (178.4{\%} ± 546.5{\%}, P < 0.0001). Conclusion: The interobserver reproducibility of SUVbw max for both untreated and treated tumors and percentage change in SUVbw max are substantially higher than measurements of CT size and percentage change in CT size. Measurements of tumor metabolism by PET should be included in trials to assess response to therapy. Although PET reproducibility was high, the variability observed in analyses of identical image sets by 4 readers indicates that automated analytic tools to assess response might be helpful to further enhance reproducibility.",
author = "Jacene, {Heather A.} and Sophie Leboulleux and Shingo Baba and Daniel Chatzifotiadis and Behnaz Goudarzi and Oleg Teytelbaum and Horton, {Karen M.} and Ihab Kamel and Macura, {Katarzyna J.} and Tsai, {Hua Ling} and Jeanne Kowalski and Wahl, {Richard L.}",
year = "2009",
month = "11",
day = "1",
doi = "10.2967/jnumed.109.063321",
language = "English",
volume = "50",
pages = "1760--1769",
journal = "Journal of Nuclear Medicine",
issn = "0161-5505",
publisher = "Society of Nuclear Medicine Inc.",
number = "11",

}

TY - JOUR

T1 - Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy

AU - Jacene, Heather A.

AU - Leboulleux, Sophie

AU - Baba, Shingo

AU - Chatzifotiadis, Daniel

AU - Goudarzi, Behnaz

AU - Teytelbaum, Oleg

AU - Horton, Karen M.

AU - Kamel, Ihab

AU - Macura, Katarzyna J.

AU - Tsai, Hua Ling

AU - Kowalski, Jeanne

AU - Wahl, Richard L.

PY - 2009/11/1

Y1 - 2009/11/1

N2 - Our goal was to estimate and compare across different readers the reproducibility of the 18F-FDG PET standardized uptake value (SUV) and CT size measurements, and changes in those measurements, in malignant tumors before and after therapy. Methods: Fifty-two tumors in 25 patients were evaluated on 18F-FDG PET/CT scans. Maximum SUVs (SUVbw max) and CT size measurements were determined for each tumor independently on pre- and posttreatment scans by 8 different readers (4 PET, 4 CT) using routine nonautomated clinical methods. Percentage changes in SUVbw max and CT size between pre- and posttreatment scans were calculated. Interobserver reproducibility of SUVbw max, CT size, and changes in these values were described by intraclass correlation coefficients (ICCs) and estimates of variance. Results: The ICC was higher for the pretreatment, posttreatment, and percentage change in SUVbw max than the ICC for the longest CT size and the 2-dimensional CT size (before treatment, 0.93, 0.72, and 0.61, respectively; after treatment, 0.91, 0.85, and 0.45, respectively; and percentage change, 0.94, 0.70, and 0.33, respectively). The variability of SUVbw max was significantly lower than the variability of the longest CT size and the 2-dimensional CT size (mean ± SD before treatment, 6.3% ± 14.2%, 16.2% ± 17.8%, and 27.5% ± 26.7%, respectively, P ≤ 0.001; and after treatment, 18.4% ± 26.8%, 35.1% ± 47.5%, and 50.9% ± 51.4%, respectively, P ≤ 0.02). The variability of percentage change in SUVbw max (16.7% ± 36.2%) was significantly lower than that for percentage change in the longest CT size (156.3% ± 157.3%, P ≤ 0.0001) and the 2-dimensional CT size (178.4% ± 546.5%, P < 0.0001). Conclusion: The interobserver reproducibility of SUVbw max for both untreated and treated tumors and percentage change in SUVbw max are substantially higher than measurements of CT size and percentage change in CT size. Measurements of tumor metabolism by PET should be included in trials to assess response to therapy. Although PET reproducibility was high, the variability observed in analyses of identical image sets by 4 readers indicates that automated analytic tools to assess response might be helpful to further enhance reproducibility.

AB - Our goal was to estimate and compare across different readers the reproducibility of the 18F-FDG PET standardized uptake value (SUV) and CT size measurements, and changes in those measurements, in malignant tumors before and after therapy. Methods: Fifty-two tumors in 25 patients were evaluated on 18F-FDG PET/CT scans. Maximum SUVs (SUVbw max) and CT size measurements were determined for each tumor independently on pre- and posttreatment scans by 8 different readers (4 PET, 4 CT) using routine nonautomated clinical methods. Percentage changes in SUVbw max and CT size between pre- and posttreatment scans were calculated. Interobserver reproducibility of SUVbw max, CT size, and changes in these values were described by intraclass correlation coefficients (ICCs) and estimates of variance. Results: The ICC was higher for the pretreatment, posttreatment, and percentage change in SUVbw max than the ICC for the longest CT size and the 2-dimensional CT size (before treatment, 0.93, 0.72, and 0.61, respectively; after treatment, 0.91, 0.85, and 0.45, respectively; and percentage change, 0.94, 0.70, and 0.33, respectively). The variability of SUVbw max was significantly lower than the variability of the longest CT size and the 2-dimensional CT size (mean ± SD before treatment, 6.3% ± 14.2%, 16.2% ± 17.8%, and 27.5% ± 26.7%, respectively, P ≤ 0.001; and after treatment, 18.4% ± 26.8%, 35.1% ± 47.5%, and 50.9% ± 51.4%, respectively, P ≤ 0.02). The variability of percentage change in SUVbw max (16.7% ± 36.2%) was significantly lower than that for percentage change in the longest CT size (156.3% ± 157.3%, P ≤ 0.0001) and the 2-dimensional CT size (178.4% ± 546.5%, P < 0.0001). Conclusion: The interobserver reproducibility of SUVbw max for both untreated and treated tumors and percentage change in SUVbw max are substantially higher than measurements of CT size and percentage change in CT size. Measurements of tumor metabolism by PET should be included in trials to assess response to therapy. Although PET reproducibility was high, the variability observed in analyses of identical image sets by 4 readers indicates that automated analytic tools to assess response might be helpful to further enhance reproducibility.

UR - http://www.scopus.com/inward/record.url?scp=70350707776&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350707776&partnerID=8YFLogxK

U2 - 10.2967/jnumed.109.063321

DO - 10.2967/jnumed.109.063321

M3 - Article

C2 - 19837757

AN - SCOPUS:70350707776

VL - 50

SP - 1760

EP - 1769

JO - Journal of Nuclear Medicine

JF - Journal of Nuclear Medicine

SN - 0161-5505

IS - 11

ER -