Skip to main content
Erschienen in: European Journal of Nuclear Medicine and Molecular Imaging 5/2017

13.12.2016 | Original Article

Inter-rater variability of visual interpretation and comparison with quantitative evaluation of 11C-PiB PET amyloid images of the Japanese Alzheimer’s Disease Neuroimaging Initiative (J-ADNI) multicenter study

verfasst von: Tomohiko Yamane, Kenji Ishii, Muneyuki Sakata, Yasuhiko Ikari, Tomoyuki Nishio, Kazunari Ishii, Takashi Kato, Kengo Ito, Michio Senda, J-ADNI Study Group

Erschienen in: European Journal of Nuclear Medicine and Molecular Imaging | Ausgabe 5/2017

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The aim of this study was to assess the inter-rater variability of the visual interpretation of 11C-PiB PET images regarding the positivity/negativity of amyloid deposition that were obtained in a multicenter clinical research project, Japanese Alzheimer’s Disease Neuroimaging Initiative (J-ADNI). The results of visual interpretation were also compared with a semi-automatic quantitative analysis using mean cortical standardized uptake value ratio to the cerebellar cortex (mcSUVR).

Methods

A total of 162 11C-PiB PET scans, including 45 mild Alzheimer’s disease, 60 mild cognitive impairment, and 57 normal cognitive control cases that had been acquired as J-ADNI baseline scans were analyzed. Based on visual interpretation by three independent raters followed by consensus read, each case was classified into positive, equivocal, and negative deposition (ternary criteria) and further dichotomized by merging the former two (binary criteria).

Results

Complete agreement of visual interpretation by the three raters was observed for 91.3% of the cases (Cohen κ = 0.88 on average) in ternary criteria and for 92.3% (κ = 0.89) in binary criteria. Cases that were interpreted as visually positive in the consensus read showed significantly higher mcSUVR than those visually negative (2.21 ± 0.37 vs. 1.27 ± 0.09, p < 0.001), and positive or negative decision by visual interpretation was dichotomized by a cut-off value of mcSUVR = 1.5. Significant positive/negative associations were observed between mcSUVR and the number of raters who evaluated as positive (ρ = 0.87, p < 0.0001) and negative (ρ = −0.85, p < 0.0001) interpretation. Cases of disagreement among raters showed generally low mcSUVR.

Conclusions

Inter-rater agreement was almost perfect in 11C-PiB PET scans. Positive or negative decision by visual interpretation was dichotomized by a cut-off value of mcSUVR = 1.5. As some cases of disagreement among raters tended to show low mcSUVR, referring to quantitative method may facilitate correct diagnosis when evaluating images of low amyloid deposition.
Literatur
1.
Zurück zum Zitat McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack Jr CR, Kawas CH, et al. The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 2011;7:263–9.CrossRefPubMedPubMedCentral McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack Jr CR, Kawas CH, et al. The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 2011;7:263–9.CrossRefPubMedPubMedCentral
2.
Zurück zum Zitat Karran E, Mercken M, De Strooper B. The amyloid cascade hypothesis for Alzheimer’s disease: an appraisal for the development of therapeutics. Nat Rev Drug Discov. 2011;10:698–712.CrossRefPubMed Karran E, Mercken M, De Strooper B. The amyloid cascade hypothesis for Alzheimer’s disease: an appraisal for the development of therapeutics. Nat Rev Drug Discov. 2011;10:698–712.CrossRefPubMed
4.
Zurück zum Zitat Klunk W, Engler H, Nordberg A, Wang Y, Blomqvist G, Holt D, et al. Imaging brain amyloid in Alzheimer’s disease with Pittsburgh Compound-B. Ann Neurol. 2004;55:306–19.CrossRefPubMed Klunk W, Engler H, Nordberg A, Wang Y, Blomqvist G, Holt D, et al. Imaging brain amyloid in Alzheimer’s disease with Pittsburgh Compound-B. Ann Neurol. 2004;55:306–19.CrossRefPubMed
5.
Zurück zum Zitat Klunk WE, Koeppe RA, Price JC, Benzinger TL, Devous Sr MD, Jagust WJ, et al. The Centiloid Project: standardizing quantitative amyloid plaque estimation by PET. Alzheimers Dement. 2015;11:1–15.CrossRefPubMed Klunk WE, Koeppe RA, Price JC, Benzinger TL, Devous Sr MD, Jagust WJ, et al. The Centiloid Project: standardizing quantitative amyloid plaque estimation by PET. Alzheimers Dement. 2015;11:1–15.CrossRefPubMed
7.
Zurück zum Zitat Curtis C, Gamez JE, Singh U, Sadowsky CH, Villena T, Sabbagh MN, et al. Phase 3 trial of flutemetamol labeled with radioactive fluorine 18 imaging and neuritic plaque density. JAMA Neurol. 2015;72:287–94.CrossRefPubMed Curtis C, Gamez JE, Singh U, Sadowsky CH, Villena T, Sabbagh MN, et al. Phase 3 trial of flutemetamol labeled with radioactive fluorine 18 imaging and neuritic plaque density. JAMA Neurol. 2015;72:287–94.CrossRefPubMed
9.
Zurück zum Zitat Hatashita S, Yamasaki H, Suzuki Y, Tanaka K, Wakebe D, Hayakawa H. [18F]Flutemetamol amyloid-beta PET imaging compared with [11C]PIB across the spectrum of Alzheimer’s disease. Eur J Nucl Med Mol Imaging. 2014;41:290–300.CrossRefPubMed Hatashita S, Yamasaki H, Suzuki Y, Tanaka K, Wakebe D, Hayakawa H. [18F]Flutemetamol amyloid-beta PET imaging compared with [11C]PIB across the spectrum of Alzheimer’s disease. Eur J Nucl Med Mol Imaging. 2014;41:290–300.CrossRefPubMed
10.
Zurück zum Zitat Rabinovici G, Rosen H, Alkalay A, Kornak J, Furst A, Agarwal N, et al. Amyloid vs. FDG-PET in the differential diagnosis of AD and FTLD. Neurology. 2011;77:2034–42.CrossRefPubMedPubMedCentral Rabinovici G, Rosen H, Alkalay A, Kornak J, Furst A, Agarwal N, et al. Amyloid vs. FDG-PET in the differential diagnosis of AD and FTLD. Neurology. 2011;77:2034–42.CrossRefPubMedPubMedCentral
11.
Zurück zum Zitat Ng S, Villemagne VL, Berlangieri S, Lee ST, Cherk M, Gong SJ, et al. Visual assessment versus quantitative assessment of 11C-PIB PET and 18F-FDG PET for detection of Alzheimer’s disease. J Nucl Med. 2007;48:547–52.CrossRefPubMed Ng S, Villemagne VL, Berlangieri S, Lee ST, Cherk M, Gong SJ, et al. Visual assessment versus quantitative assessment of 11C-PIB PET and 18F-FDG PET for detection of Alzheimer’s disease. J Nucl Med. 2007;48:547–52.CrossRefPubMed
12.
Zurück zum Zitat Rosario BL, Weissfeld LA, Laymon CM, Mathis CA, Klunk WE, Berginc MD, et al. Inter-rater reliability of manual and automated region-of-interest delineation for PiB PET. Neuroimage. 2011;55:933–41.CrossRefPubMed Rosario BL, Weissfeld LA, Laymon CM, Mathis CA, Klunk WE, Berginc MD, et al. Inter-rater reliability of manual and automated region-of-interest delineation for PiB PET. Neuroimage. 2011;55:933–41.CrossRefPubMed
13.
Zurück zum Zitat Akamatsu G, Ikari Y, Ohnishi A, Nishida H, Aita K, Sasaki M, et al. Automated PET-only quantification of amyloid deposition with adaptive template and empirically pre-defined ROI. Phys Med Biol. 2016;61:5768–80.CrossRefPubMed Akamatsu G, Ikari Y, Ohnishi A, Nishida H, Aita K, Sasaki M, et al. Automated PET-only quantification of amyloid deposition with adaptive template and empirically pre-defined ROI. Phys Med Biol. 2016;61:5768–80.CrossRefPubMed
14.
Zurück zum Zitat Suotunen T, Hirvonen J, Immonen-Raiha P, Aalto S, Lisinen I, Arponen E, et al. Visual assessment of [(11)C]PIB PET in patients with cognitive impairment. Eur J Nucl Med Mol Imaging. 2010;37:1141–7.CrossRefPubMed Suotunen T, Hirvonen J, Immonen-Raiha P, Aalto S, Lisinen I, Arponen E, et al. Visual assessment of [(11)C]PIB PET in patients with cognitive impairment. Eur J Nucl Med Mol Imaging. 2010;37:1141–7.CrossRefPubMed
15.
Zurück zum Zitat Tolboom N, van der Flier WM, Boverhoff J, Yaqub M, Wattjes MP, Raijmakers PG, et al. Molecular imaging in the diagnosis of Alzheimer’s disease: visual assessment of [11C]PIB and [18F]FDDNP PET images. J Neurol Neurosurg Psychiatry. 2010;81:882–4.CrossRefPubMed Tolboom N, van der Flier WM, Boverhoff J, Yaqub M, Wattjes MP, Raijmakers PG, et al. Molecular imaging in the diagnosis of Alzheimer’s disease: visual assessment of [11C]PIB and [18F]FDDNP PET images. J Neurol Neurosurg Psychiatry. 2010;81:882–4.CrossRefPubMed
16.
Zurück zum Zitat Seibyl J, Catafau AM, Barthel H, Ishii K, Rowe CC, Leverenz JB, et al. Impact of training method on the robustness of the visual assessment of 18F-Florbetaben PET scans: results from a phase-3 study. J Nucl Med. 2016;57:900–6.CrossRefPubMed Seibyl J, Catafau AM, Barthel H, Ishii K, Rowe CC, Leverenz JB, et al. Impact of training method on the robustness of the visual assessment of 18F-Florbetaben PET scans: results from a phase-3 study. J Nucl Med. 2016;57:900–6.CrossRefPubMed
17.
Zurück zum Zitat Nayate AP, Dubroff JG, Schmitt JE, Nasrallah I, Kishore R, Mankoff D, et al. Use of standardized uptake value ratios decreases interreader variability of [18F] Florbetapir PET brain scan interpretation. AJNR Am J Neuroradiol. 2015;36:1237–44.CrossRefPubMed Nayate AP, Dubroff JG, Schmitt JE, Nasrallah I, Kishore R, Mankoff D, et al. Use of standardized uptake value ratios decreases interreader variability of [18F] Florbetapir PET brain scan interpretation. AJNR Am J Neuroradiol. 2015;36:1237–44.CrossRefPubMed
18.
Zurück zum Zitat Yamane T, Ikari Y, Nishio T, Ishii K, Ishii K, Kato T, et al. Visual-statistical interpretation of (18)F-FDG-PET images for characteristic Alzheimer patterns in a multicenter study: inter-rater concordance and relationship to automated quantitative evaluation. AJNR Am J Neuroradiol. 2014;35:244–9.CrossRefPubMed Yamane T, Ikari Y, Nishio T, Ishii K, Ishii K, Kato T, et al. Visual-statistical interpretation of (18)F-FDG-PET images for characteristic Alzheimer patterns in a multicenter study: inter-rater concordance and relationship to automated quantitative evaluation. AJNR Am J Neuroradiol. 2014;35:244–9.CrossRefPubMed
19.
Zurück zum Zitat Clark CM, Pontecorvo MJ, Beach TG, Bedell BJ, Coleman RE, Doraiswamy PM, et al. Cerebral PET with florbetapir compared with neuropathology at autopsy for detection of neuritic amyloid-β plaques: a prospective cohort study. Lancet Neurol. 2012;11:669–78.CrossRefPubMed Clark CM, Pontecorvo MJ, Beach TG, Bedell BJ, Coleman RE, Doraiswamy PM, et al. Cerebral PET with florbetapir compared with neuropathology at autopsy for detection of neuritic amyloid-β plaques: a prospective cohort study. Lancet Neurol. 2012;11:669–78.CrossRefPubMed
20.
Zurück zum Zitat Tolboom N, van der Flier WM, Yaqub M, Koene T, Boellaard R, Windhorst AD, et al. Differential association of [11C]PIB and [18F]FDDNP binding with cognitive impairment. Neurology. 2009;73:2079–85.CrossRefPubMed Tolboom N, van der Flier WM, Yaqub M, Koene T, Boellaard R, Windhorst AD, et al. Differential association of [11C]PIB and [18F]FDDNP binding with cognitive impairment. Neurology. 2009;73:2079–85.CrossRefPubMed
21.
Zurück zum Zitat Grimmer T, Wutz C, Alexopoulos P, Drzezga A, Forster S, Forstl H, et al. Visual versus fully automated analyses of 18F-FDG and Amyloid PET for prediction of dementia due to Alzheimer disease in mild cognitive impairment. J Nucl Med. 2016;57:204–7.CrossRefPubMed Grimmer T, Wutz C, Alexopoulos P, Drzezga A, Forster S, Forstl H, et al. Visual versus fully automated analyses of 18F-FDG and Amyloid PET for prediction of dementia due to Alzheimer disease in mild cognitive impairment. J Nucl Med. 2016;57:204–7.CrossRefPubMed
22.
Zurück zum Zitat Iwatsubo T. Japanese Alzheimer’s disease neuroimaging initiative: present status and future. Alzheimers Dement. 2010;6:297–9.CrossRefPubMed Iwatsubo T. Japanese Alzheimer’s disease neuroimaging initiative: present status and future. Alzheimers Dement. 2010;6:297–9.CrossRefPubMed
23.
Zurück zum Zitat Ikari Y, Nishio T, Makishi Y, Miya Y, Ito K, Koeppe RA, et al. Head motion evaluation and correction for PET scans with 18F-FDG in the Japanese Alzheimer’s disease neuroimaging initiative (J-ADNI) multi-center study. Ann Nucl Med. 2012;26:535–44.CrossRefPubMed Ikari Y, Nishio T, Makishi Y, Miya Y, Ito K, Koeppe RA, et al. Head motion evaluation and correction for PET scans with 18F-FDG in the Japanese Alzheimer’s disease neuroimaging initiative (J-ADNI) multi-center study. Ann Nucl Med. 2012;26:535–44.CrossRefPubMed
25.
Zurück zum Zitat McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan E. Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology. 1984;34:939–44.CrossRefPubMed McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan E. Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology. 1984;34:939–44.CrossRefPubMed
26.
Zurück zum Zitat Braak H, Braak E. Frequency of stages of Alzheimer-related lesions in different age categories. Neurobiol Aging. 1997;18:351–7.CrossRefPubMed Braak H, Braak E. Frequency of stages of Alzheimer-related lesions in different age categories. Neurobiol Aging. 1997;18:351–7.CrossRefPubMed
27.
Zurück zum Zitat Delacourte A, David JP, Sergeant N, Buee L, Wattez A, Vermersch P, et al. The biochemical pathway of neurofibrillary degeneration in aging and Alzheimer’s disease. Neurology. 1999;52:1158–65.CrossRefPubMed Delacourte A, David JP, Sergeant N, Buee L, Wattez A, Vermersch P, et al. The biochemical pathway of neurofibrillary degeneration in aging and Alzheimer’s disease. Neurology. 1999;52:1158–65.CrossRefPubMed
28.
Zurück zum Zitat Thurfjell L, Lilja J, Lundqvist R, Buckley C, Smith A, Vandenberghe R, et al. Automated quantification of 18F-flutemetamol PET activity for categorizing scans as negative or positive for brain amyloid: concordance with visual image reads. J Nucl Med. 2014;55:1623–8.CrossRefPubMed Thurfjell L, Lilja J, Lundqvist R, Buckley C, Smith A, Vandenberghe R, et al. Automated quantification of 18F-flutemetamol PET activity for categorizing scans as negative or positive for brain amyloid: concordance with visual image reads. J Nucl Med. 2014;55:1623–8.CrossRefPubMed
29.
Zurück zum Zitat Schreiber S, Landau SM, Fero A, Schreiber F, Jagust WJ. Alzheimer’s disease neuroimaging I. Comparison of visual and quantitative Florbetapir F 18 positron emission tomography analysis in predicting mild cognitive impairment outcomes. JAMA Neurol. 2015;72:1183–90.CrossRefPubMed Schreiber S, Landau SM, Fero A, Schreiber F, Jagust WJ. Alzheimer’s disease neuroimaging I. Comparison of visual and quantitative Florbetapir F 18 positron emission tomography analysis in predicting mild cognitive impairment outcomes. JAMA Neurol. 2015;72:1183–90.CrossRefPubMed
30.
Zurück zum Zitat Chen ML. Ethnic or racial differences revisited: impact of dosage regimen and dosage form on pharmacokinetics and pharmacodynamics. Clin Pharmacokinet. 2006;45:957–64.CrossRefPubMed Chen ML. Ethnic or racial differences revisited: impact of dosage regimen and dosage form on pharmacokinetics and pharmacodynamics. Clin Pharmacokinet. 2006;45:957–64.CrossRefPubMed
31.
Zurück zum Zitat Senda M, Yamamoto Y, Sasaki M, Yamane T, Brooks DJ, Farrar G, et al. An exploratory efficacy study of the amyloid imaging agent [(18)F]flutemetamol in Japanese Subjects. Ann Nucl Med. 2015;29:391–9.CrossRefPubMed Senda M, Yamamoto Y, Sasaki M, Yamane T, Brooks DJ, Farrar G, et al. An exploratory efficacy study of the amyloid imaging agent [(18)F]flutemetamol in Japanese Subjects. Ann Nucl Med. 2015;29:391–9.CrossRefPubMed
32.
Zurück zum Zitat Senda M, Sasaki M, Yamane T, Shimizu K, Patt M, Barthel H, et al. Ethnic comparison of pharmacokinetics of (18)F-florbetaben, a PET tracer for beta-amyloid imaging, in healthy Caucasian and Japanese subjects. Eur J Nucl Med Mol Imaging. 2015;42:89–96.CrossRefPubMed Senda M, Sasaki M, Yamane T, Shimizu K, Patt M, Barthel H, et al. Ethnic comparison of pharmacokinetics of (18)F-florbetaben, a PET tracer for beta-amyloid imaging, in healthy Caucasian and Japanese subjects. Eur J Nucl Med Mol Imaging. 2015;42:89–96.CrossRefPubMed
Metadaten
Titel
Inter-rater variability of visual interpretation and comparison with quantitative evaluation of 11C-PiB PET amyloid images of the Japanese Alzheimer’s Disease Neuroimaging Initiative (J-ADNI) multicenter study
verfasst von
Tomohiko Yamane
Kenji Ishii
Muneyuki Sakata
Yasuhiko Ikari
Tomoyuki Nishio
Kazunari Ishii
Takashi Kato
Kengo Ito
Michio Senda
J-ADNI Study Group
Publikationsdatum
13.12.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
European Journal of Nuclear Medicine and Molecular Imaging / Ausgabe 5/2017
Print ISSN: 1619-7070
Elektronische ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-016-3591-2

Weitere Artikel der Ausgabe 5/2017

European Journal of Nuclear Medicine and Molecular Imaging 5/2017 Zur Ausgabe