Skip to main content
Erschienen in: Abdominal Radiology 3/2016

02.01.2016

Measurement of pancreatic cystic lesions on magnetic resonance imaging: efficacy of standards in reducing inter-observer variability

verfasst von: Dell P. Dunn, Olga R. Brook, Alexander Brook, Giselle Revah, Sumayya Jawadi, Maryellen Sun, Karen S. Lee, Koenraad J. Mortele

Erschienen in: Abdominal Radiology | Ausgabe 3/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The purpose of this study is to assess inter-observer variability in the measurement of pancreatic cystic lesions with MRI and to determine the impact of measurement standards.

Materials and methods

In this IRB-approved, HIPAA-compliant study with waiver of informed consent, 144 MRI examinations, containing pancreatic cystic lesions measuring between 5 and 35 mm, were reviewed independently by two radiology attendings and two abdominal imaging fellows. Measurements were repeated by the same reviewers 12 weeks later after the introduction of measurement standards. Results were analyzed using within-subject standard deviation, intraclass correlation coefficient, and kappa.

Results

Prior to standardization, the within-subject standard deviation, showing measurement variability in each cyst, was 4.0 mm, which was reduced to 3.3 mm after introduction of measurement standards (p < 0.01). Overall inter-observer agreement, kappa, improved from 0.59 to 0.65 (p = 0.04). The frequency of all four reviewers agreeing on size category increased from 51% to 60%. The intraclass correlation coefficient increased from 0.81 to 0.86.

Conclusions

There is significant and frequent inter-observer variability in the measurement of pancreatic cystic lesions with MRI which could affect clinical management. Implementation of measurement standards reduces measurement variability and aids in preventing erroneous reporting of growth and potentially unwarranted changes in management.
Literatur
1.
Zurück zum Zitat Lee KS, Sekhar A, Rofsky NM, et al. (2010) Prevalence of incidental pancreatic cysts in the adult population on MR imaging. Am J Gastroenterol 105:2079–2084CrossRefPubMed Lee KS, Sekhar A, Rofsky NM, et al. (2010) Prevalence of incidental pancreatic cysts in the adult population on MR imaging. Am J Gastroenterol 105:2079–2084CrossRefPubMed
2.
Zurück zum Zitat Lee CJ, Scheiman J, Anderson MA, et al. (2008) Risk of malignancy in resected cystic tumors of the pancreas < or = 3 cm in size: is it safe to observe asymptomatic patients? A multi-institutional report. J Gastrointest Surg 12:234–242CrossRefPubMed Lee CJ, Scheiman J, Anderson MA, et al. (2008) Risk of malignancy in resected cystic tumors of the pancreas < or = 3 cm in size: is it safe to observe asymptomatic patients? A multi-institutional report. J Gastrointest Surg 12:234–242CrossRefPubMed
3.
Zurück zum Zitat Levy P, Jouannaud V, Otoole D, et al. (2006) Natural history of intraductal papillary mucinous tumors of the pancreas: actuarial risk of malignancy. Clin Gastroenterol Hepatol 4:460–468CrossRefPubMed Levy P, Jouannaud V, Otoole D, et al. (2006) Natural history of intraductal papillary mucinous tumors of the pancreas: actuarial risk of malignancy. Clin Gastroenterol Hepatol 4:460–468CrossRefPubMed
4.
Zurück zum Zitat Kimura W, Nagai H, Kuroda A, et al. (1995) Analysis of small cystic lesions of the pancreas. Int J Gastrointest Cancer 18:197–206 Kimura W, Nagai H, Kuroda A, et al. (1995) Analysis of small cystic lesions of the pancreas. Int J Gastrointest Cancer 18:197–206
5.
Zurück zum Zitat Tanaka M, Chari S, Adsay V, et al. (2006) International consensus guidelines for management of intraductal papillary mucinous neoplasms and mucinous cystic neoplasms of the pancreas. Pancreatology 6:17–32CrossRefPubMed Tanaka M, Chari S, Adsay V, et al. (2006) International consensus guidelines for management of intraductal papillary mucinous neoplasms and mucinous cystic neoplasms of the pancreas. Pancreatology 6:17–32CrossRefPubMed
6.
Zurück zum Zitat Tanaka M, Fernández-del Castillo C, Adsay V, et al. (2012) International consensus guidelines 2012 for the management of IPMN and MCN of the pancreas. Pancreatology 12:183–197CrossRefPubMed Tanaka M, Fernández-del Castillo C, Adsay V, et al. (2012) International consensus guidelines 2012 for the management of IPMN and MCN of the pancreas. Pancreatology 12:183–197CrossRefPubMed
7.
Zurück zum Zitat Berland LL, Silverman SG, Gore RM, et al. (2010) Managing incidental findings on abdominal CT: white paper of the ACR incidental findings committee. J Am Coll Radiol 7:754–773CrossRefPubMed Berland LL, Silverman SG, Gore RM, et al. (2010) Managing incidental findings on abdominal CT: white paper of the ACR incidental findings committee. J Am Coll Radiol 7:754–773CrossRefPubMed
8.
Zurück zum Zitat Maimone S, Agrawal D, Pollack MJ, et al. (2010) Variability in measurements of pancreatic cyst size among EUS, CT, and magnetic resonance imaging modalities. Gastrointest Endosc 71:945–950CrossRefPubMed Maimone S, Agrawal D, Pollack MJ, et al. (2010) Variability in measurements of pancreatic cyst size among EUS, CT, and magnetic resonance imaging modalities. Gastrointest Endosc 71:945–950CrossRefPubMed
9.
Zurück zum Zitat Eisenhauer EA, Therasse P, Bogaerts J, et al. (2009) New response evaluation criteria in solid tumours: revised RECIST guideline (version1.1). Eur J Cancer 45:228–247CrossRefPubMed Eisenhauer EA, Therasse P, Bogaerts J, et al. (2009) New response evaluation criteria in solid tumours: revised RECIST guideline (version1.1). Eur J Cancer 45:228–247CrossRefPubMed
10.
Zurück zum Zitat Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMed Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMed
11.
Zurück zum Zitat Das A, Wells CD, Nguyen CC (2008) Incidental cystic neoplasms of pancreas: what is the optimal interval of imaging surveillance? Am J Gastroenterol 103:1657–1662CrossRefPubMed Das A, Wells CD, Nguyen CC (2008) Incidental cystic neoplasms of pancreas: what is the optimal interval of imaging surveillance? Am J Gastroenterol 103:1657–1662CrossRefPubMed
12.
Zurück zum Zitat Ip IK, Mortele KJ, Prevedello LM, Khorasani R (2011) Focal cystic pancreatic lesions: assessing variation in radiologists’ management recommendations. Radiology 259:136–141CrossRefPubMed Ip IK, Mortele KJ, Prevedello LM, Khorasani R (2011) Focal cystic pancreatic lesions: assessing variation in radiologists’ management recommendations. Radiology 259:136–141CrossRefPubMed
13.
Zurück zum Zitat Macari M, Megibow AJ (2011) Focal cystic pancreatic lesions: variability in radiologists’ recommendations for follow-up imaging. Radiology 259:20–23CrossRefPubMed Macari M, Megibow AJ (2011) Focal cystic pancreatic lesions: variability in radiologists’ recommendations for follow-up imaging. Radiology 259:20–23CrossRefPubMed
14.
Zurück zum Zitat De Jong K, Nio CY, Mearadji B, et al. (2012) Disappointing interobserver agreement among radiologists for a classifying diagnosis of pancreatic cysts using magnetic resonance imaging. Pancreas 41:278–282CrossRefPubMed De Jong K, Nio CY, Mearadji B, et al. (2012) Disappointing interobserver agreement among radiologists for a classifying diagnosis of pancreatic cysts using magnetic resonance imaging. Pancreas 41:278–282CrossRefPubMed
15.
Zurück zum Zitat Do RKG, Katz SS, Gollub MJ, et al. (2014) Interobserver agreement for detection of malignant features of intraductal papillary mucinous neoplasms of the pancreas on MDCT. AJR 203:973–979CrossRefPubMedPubMedCentral Do RKG, Katz SS, Gollub MJ, et al. (2014) Interobserver agreement for detection of malignant features of intraductal papillary mucinous neoplasms of the pancreas on MDCT. AJR 203:973–979CrossRefPubMedPubMedCentral
16.
Zurück zum Zitat Hopper KD, Kasales CJ, Van Slyke MA, et al. (1996) Analysis of interobserver and intraobserver variability in CT tumor measurements. AJR 167:851–854CrossRefPubMed Hopper KD, Kasales CJ, Van Slyke MA, et al. (1996) Analysis of interobserver and intraobserver variability in CT tumor measurements. AJR 167:851–854CrossRefPubMed
17.
Zurück zum Zitat McErlean A, Panicek DM, Zabor EC, et al. (2013) Intra- and interobserver variability in CT measurements in oncology. Radiology 269:451–459CrossRefPubMed McErlean A, Panicek DM, Zabor EC, et al. (2013) Intra- and interobserver variability in CT measurements in oncology. Radiology 269:451–459CrossRefPubMed
Metadaten
Titel
Measurement of pancreatic cystic lesions on magnetic resonance imaging: efficacy of standards in reducing inter-observer variability
verfasst von
Dell P. Dunn
Olga R. Brook
Alexander Brook
Giselle Revah
Sumayya Jawadi
Maryellen Sun
Karen S. Lee
Koenraad J. Mortele
Publikationsdatum
02.01.2016
Verlag
Springer US
Erschienen in
Abdominal Radiology / Ausgabe 3/2016
Print ISSN: 2366-004X
Elektronische ISSN: 2366-0058
DOI
https://doi.org/10.1007/s00261-015-0588-4

Weitere Artikel der Ausgabe 3/2016

Abdominal Radiology 3/2016 Zur Ausgabe

Classics in Abdominal Imaging

The “winking owl” sign

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.