Diffusion Weighted MR Imaging of Primary and Recurrent Middle Ear Cholesteatoma: An Assessment by Readers with Different Expertise

Elefante, A.; Cavaliere, M.; Russo, C.; Caliendo, G.; Marseglia, M.; Cicala, D.; Piccolo, D.; Di Lullo, A.; Brunetti, L.; Palma, A.; Iengo, M.; Brunetti, A.

doi:https://doi.org/10.1155/2015/597896

BioMed Research International

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusion References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 597896 | https://doi.org/10.1155/2015/597896

Diffusion Weighted MR Imaging of Primary and Recurrent Middle Ear Cholesteatoma: An Assessment by Readers with Different Expertise

A. Elefante,¹M. Cavaliere,²C. Russo,¹G. Caliendo,¹M. Marseglia,¹D. Cicala,¹D. Piccolo,¹A. Di Lullo,²L. Brunetti,¹A. Palma,¹M. Iengo,²and A. Brunetti¹

Academic Editor: Martin G. Mack

Received30 Jul 2014

Revised11 Nov 2014

Accepted12 Nov 2014

Published02 Feb 2015

Abstract

Introduction and Purpose. Diffusion weighted imaging (DWI) has been proven to be valuable in the diagnosis of middle ear cholesteatoma. The aims of our study were to evaluate the advantage of multi-shot turbo spin echo (MSh TSE) DWI compared to single-shot echo-planar (SSh EPI) DWI for the diagnosis of cholesteatoma. Material and Methods. Thirty-two patients with clinical suspicion of unilateral cholesteatoma underwent preoperative MRI (1.5T) with SSh EPI and MSh TSE. Images were separately analyzed by 4 readers with different expertise to confirm the presence of cholesteatoma. Sensitivity, specificity, diagnostic accuracy, and positive (PPV) and negative predictive values (NPV) were assessed for each observer and interrater agreement was assessed using kappa statistics. Diagnosis was obtained at surgery. Results. Overall MSh TSE showed higher diagnostic accuracy and lower negative predictive value (NPV) compared to conventional SSh EPI. Interreader agreement between the observers revealed the superiority of MSh TSE compared to SSh EPI. Interrater agreement among all the four observers was higher by using MSh TSE compared to SSh EPI. Conclusion. Our findings suggest that MSh TSE DWI has higher sensitivity for detection of cholesteatoma and lower probability of misdiagnosis. MSh TSE DWI is useful in guiding less experienced observers to the diagnosis.

1. Introduction

Middle ear cholesteatoma is a common inflammatory disease requiring prompt surgical treatment to prevent local and intracranial complications due to the activation of osteoclastic function [1]. The diagnosis is generally based on clinical presentation, otoscopic examination, and audiometry. CT scan is used routinely to assess disease extension before surgery. Nevertheless, when the global picture is nonspecific and differential diagnosis is needed, MRI can be used [1]. In particular, diffusion weighted imaging (DWI) can be helpful, since the high content of keratin of cholesteatoma is associated with restricted diffusion [2, 3]. Currently, single-shot echo-planar DWI (SSh EPI) is the most used DWI technique because of its short imaging time (about 2 minutes). On the other hand, multi-shot non-echo-planar DWI sequences (MSh TSE), while requiring a longer imaging time (about 8 minutes), are associated with decreased susceptibility artifacts at the skull base [3–5].

The goal of our study was to compare the diagnostic value of multi-shot non-echo-planar DWI sequences with conventional single-shot echo-planar DWI in patients with clinical suspicion of primary or recurrent middle ear cholesteatoma and to test the interrupter agreement of readers with different expertise levels.

2. Materials and Methods

2.1. Case Selection

From 2011 to 2013 we conducted a prospective study on a group of 32 patients (18 females and 14 males; age range 11–69 y; mean age 38,9 y) out of 55 in total with clinical and otoscopic suspicion of unilateral middle ear cholesteatoma; 16 patients were suspected of having primary cholesteatoma and 16 of having recurrent disease (residual or relapse). Patients with suspicion of primary or recurrent disease were recruited only when clinical diagnosis was uncertain or differential diagnosis was difficult. All patients with formal contraindications in performing MRI and patients who refuse undergoing MRI or surgery were preliminarily excluded from the study. Between 3 and 7 days before surgery, all patients underwent preoperative MRI to evaluate the extent of the process. The protocol was approved by the local ethical committee and written informed consent was obtained from all patients. An experienced otorhinolaryngologist performed final surgical diagnosis (Table 1).

2.2. Imaging Techniques

MRI was carried out at 1.5 T (Philips Intera; Philips Medical Systems; Best, The Netherlands) using an 8-channels head coil. All patients underwent the same protocol, consisting of axial and coronal SE T1w images, axial T2w images, coronal MSh TSE DWI (thickness 3 mm; TE 80.672 ms; TR 3000 ms; FOV 230 × 230 mm; number of average 2; value: 0–1000), coronal SSh SE-EPI DWI (thickness 2 mm; TE 88.364 ms; TR 3774 ms; FOV 230 × 230 mm; number of average 4; value: 0–800), and axial 3D-T2w DRIVE. For each subject we retrospectively calculated diffusion maps (ADC), whose mean value measured 1,19 with SSh SE-EPI and 1,05 with MSh TSE; ADC maps have not been used for the purposes of this study. DWI images with value 1000 s/mm² are positive when the lesion appears hyperintense. For MSh TSE, cardiac gating was applied using peripheral pulse-oximetry to limit artifacts caused by heartbeat and blood flow.

2.3. Imaging Evaluation and Statistical Analysis

DWI evaluation was performed by two 10-year experienced neuroradiologists (observers 1 and 2, resp.), who had access neither to patients’ clinical data nor to conventional MR findings; MSh-TSE and SSh EPI images were shown to the two examiners separately and in a random order. All readers were asked to express their evaluation by using a dichotomous variable (presence/absence of the middle ear cholesteatoma) defined as a noticeable hyperintensity in the middle ear region. Presence of the lesion was considered as a positive result while absence of the lesion as a negative result, according to the signal characteristics described above. For the two nonexperienced readers the same diagnostic criteria were applied after a brief training sessions where 2 representative cases were shown. ADC map was not shown to the four observers.

Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and diagnostic accuracy were calculated for each reader and compared with the ones obtained from the other observers. Interrater agreement between the components of each subgroup was assessed by using Cohen’s Kappa statistics; interrater agreement among the four observers was assessed by using Fleiss’ Kappa statistics.

3. Results

The clinical suspicion of middle ear cholesteatoma was surgically confirmed in 24/32 patients (75%). We analyzed the results of the four examiners separately (Figures 1, 2, 3, and 4).

(a)

(b)

(c)

(d)

(a)

(b)

(a)

(b)

(a)

(b)

Considering SSh EPI sequences, observer 1 identified 23 true positives, 6 true negatives, 2 false positives, and 1 false negative, while observer 2 identified 19 true positives, 6 true negatives, 2 false positives, and 5 false negatives. Considering MSh TSE image, the first observer identified 24 true positives, 7 true negatives, 1 false positive, and no false negatives and the second observer identified 23 true positives, 6 true negatives, 2 false positives, and 1 false negative.

As regards the two nonexperienced observers, their results were in line with the ones obtained from the two neuroradiologists. Considering SSh EPI sequences, observer 3 identified 18 true positives, 2 true negatives, 6 false positives, and 6 false negatives; observer 4 identified 19 true positives, 2 true negatives, 6 false positives, and 5 false negatives. Considering MSh TSE image, observer 3 identified 22 true positives, 3 true negatives, 5 false positives, and 2 false negatives, while observer 4 identified 19 true positives, 2 true negatives, 6 false positives, and 5 false negatives.

The values measured for sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and diagnostic accuracy are shown in Table 2.

For all the observers MSh TSE showed higher diagnostic accuracy and lower NPV compared to conventional SSh EPI, with fewer incorrect classifications.

Interrater agreement in each subgroup was assessed by using Cohen’s Kappa statistics. Interobserver agreement between observers 1 and 2 was considerably higher with MSh-TSE () compared to SSh SE-EPI (). Stratifying patients by age and sex, no significant difference in interobserver agreement was found; stratifying patients by type of surgical intervention (primary or recurrent cholesteatoma), the interobserver agreement was higher for recurrent cholesteatoma (; ) than for primary cholesteatoma (; ). On the other hand, interobserver agreement between observers 3 and 4 was comparable using MSh-TSE and SSh SE-EPI ( versus ). Even in this case, stratifying patients by type of surgical intervention, the interobserver agreement was higher for recurrent cholesteatoma (; ) than for primary cholesteatoma (; ). No substantial difference in interobserver agreement was brought to light stratifying patients by age or sex.

Interrater agreement among the four above mentioned observers and considering all patients at the same time was assessed by using Fleiss’ Kappa statistics. Interobserver agreement was higher with MSh-TSE (, good agreement) compared to SSh SE-EPI (, poor agreement) and no significant difference was found stratifying patients by primary/recurrent cholesteatoma, age, or sex.

4. Discussion

Recent studies highlighted the ability of diffusion weighted imaging (DWI) to differentiate cholesteatoma from other inflammatory diseases of the middle ear [6]. DWI has shown to have high sensitivity and specificity for detecting cholesteatoma; this is possible because of the peculiar composition of this lesion, whose high keratin content determines a sharp signal hyperintensity in these sequences [3, 4, 7]. The main field of application of this technique is the screening of postsurgical patients, to distinguish residual/recurrent disease requiring second-look surgery from postoperative fibrosis not requiring surgical revision. Hence, DWI can contribute to a significant reduction in the number of second-look surgeries performed, thereby decreasing surgical costs and patient morbidity, with a global advantage in the management of cases of cholesteatoma [7–12]. Since there are many different DWI acquisition sequences, the selection of the most appropriate DWI imaging approach has a potential practical value.

Previous studies demonstrated that, among DWI acquisition techniques, non-echo-planar imaging (EPI) MRI is a more accurate method in detecting middle ear cholesteatoma compared to EPI and it improves the detection of small-sized cholesteatoma and decreases artifacts occurring in the EPI diffusion weighted technique [1, 2, 4, 8, 11, 12]; non-EPI requires also shorter acquisition time in comparison to delayed postcontrast sequences conventionally used in cholesteatoma imaging [2, 4, 7, 8, 13]. In another study it has been demonstrated that MSh EPI improves the diagnostic accuracy of acquired middle ear cholesteatoma compared with SSh EPI [14]. However, even if SSh EPI is the most widely used DWI technique, these procedures can be associated to susceptibility artifacts due to field inhomogeneity in the temporal bone region and this may lead to severe image degradation. In MSh EPI, a longer examination time than SSh EPI is required, but reduced geometric distortions and improved image quality should lead to the use of MSh non-EPI instead of SSh EPI [14].

In our study, with a direct comparison between SSh EPI and MSh TSE, we take a stock of the current situation regarding the most accurate imaging technique in middle ear cholesteatoma diagnosis. Our results are concordant with previous reports supporting the superior value of non-EPI approaches [2, 4, 8]. The diffusion images interpretation by two experienced neuroradiologists showed that, comparing different DWI techniques, MSh TSE increased sensitivity, specificity, and diagnostic accuracy compared to conventional SSh EPI. In MSh TSE DWI, high specificity for keratin-containing lesions is associated with high sensitivity for detection of small lesions. The considerable interrater agreement between experienced neuroradiologists obtained by using Cohen’s Kappa statistics, taking into account also the agreement occurring by chance, may suggest that MSh TSE, compared to SSh EPI, can reduce the error rate resulting from the interpretation of DWI images. This is even more critical when considering recurrent middle ear cholesteatoma in patients who have already undergone surgery.

Furthermore, our results suggest that MSh TSE can facilitate the correct diagnosis for neuroradiologists with different levels of expertise in middle ear cavity imaging interpretation. To support our thesis, we decided to administer DWI images to two nonexperienced observers (in our case, two medical students at their last academic year with a good basic technical knowledge); the results obtained were in line with the ones deriving from more experienced observers and, also in this case, MSh TSE was found to have higher sensitivity, specificity, and diagnostic accuracy compared to conventional SSh EPI.

The discrepancy between observers 3 and 4 and observers 1 and 2 regarding sensitivity, specificity, PPV, NPV, and diagnostic accuracy is mainly attributable to the lower level of expertise and to the difficulty in interpreting diffusion images of middle ear cavity. Compared to observers 1 and 2, the interrater agreement between observers 3 and 4 was negatively influenced by the larger number of incorrect interpretations; the majority of these incorrect interpretations are due to the small size (2–5 mm) of the lesion detected in some cases (false negatives) and to the artifacts at the skull base, which could be misinterpreted by observers with limited experience (false positives). However, even in this case the values for agreement were higher considering patients with recurrent cholesteatoma than with primary lesion, for both SSh EPI and MSh non-EPI.

Comparing the results of all the four observers simultaneously by using Fleiss’ Kappa statistics, the closeness of the agreement was proved to be superior with MSh TSE compared to with SSh EPI; no significant difference was found stratifying patients by primary or recurrent cholesteatoma and by age or sex. Despite a certain number of discrepancies between the two subgroups of observers due to different levels of expertise, it can be deduced that MSh TSE makes it easier to reach the right diagnosis. From this standpoint it may be concluded that MSh TSE can provide greater support in daily clinical practice compared to SSh EPI, even for less experienced operators.

In conclusion, currently DWI is used to identify suspected recurrent cholesteatoma and to prevent unnecessary second-look surgery [2, 7, 8]. In our experience, MSh TSE can be considered a reliable alternative to conventional SSh EPI for this purpose. The results obtained by nonexperienced readers confirm the potential value of MSh TSE in making the correct diagnosis. In the light of these considerations, we can propose the adoption of an optimized examination protocol for the evaluation of middle ear cholesteatoma. This shorter protocol should be based on a reduced number of MRI sequences, including MSh TSE instead of SSh EPI, with no postcontrast images. MSh TSE brings several advantages, because it is available in most imaging systems, does not require contrast injection, and produces images of easier interpretation for both experienced and nonexperienced observers. The main problems of this technique are susceptibility artifacts at the skull base, motion artifacts due to cardiac movement/blood vessel pulsation, and longer imaging time.

The main limitation of our study is the relatively low number of patients, even if our sample size is in line with the one used in other studies in literature.

5. Conclusion

Our results show the superiority of MSh TSE compared to conventional SSh EPI in the study of middle ear cholesteatoma. Therefore, replacement of SSh EPI with MSh TSE in the MRI routine study of primary and recurrent middle ear cholesteatoma because of the increased diagnostic accuracy and the lower NPV, with a substantial reduction of misdiagnosis, could be recommended. We intend to highlight the fact that MSh TSE provides a greater ease in DWI interpretation, which is a crucial factor specially for radiologists not experienced in middle ear cholesteatoma imaging.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

References

F. Más-Estellés, M. Mateos-Fernández, B. Carrascosa-Bisquert, F. F. de Castro, P.-R. Iciar, and C. Morera-Pérez, “Contemporary non-echo-planar diffusion-weighted imaging of middle ear cholesteatomas,” Radiographics, vol. 32, no. 4, pp. 1197–1213, 2012.
View at: Publisher Site | Google Scholar
J.-P. Vercruysse, B. De Foer, M. Pouillon, T. Somers, J. Casselman, and E. Offeciers, “The value of diffusion-weighted MR imaging in the diagnosis of primary acquired and residual cholesteatoma: a surgical verified study of 100 patients,” European Radiology, vol. 16, no. 7, pp. 1461–1467, 2006.
View at: Publisher Site | Google Scholar
K. M. Schwartz, J. I. Lane, B. D. Bolster Jr., and B. A. Neff, “The utility of diffusion-weighted imaging for cholesteatoma evaluation,” American Journal of Neuroradiology, vol. 32, no. 3, pp. 430–436, 2011.
View at: Publisher Site | Google Scholar
B. de Foer, J.-P. Vercruysse, A. Bernaerts et al., “Detection of postoperative residual cholesteatoma with non-echo-planar diffusion-weighted magnetic resonance imaging,” Otology and Neurotology, vol. 29, no. 4, pp. 513–517, 2008.
View at: Publisher Site | Google Scholar
B. de Foer, J.-P. Vercruysse, A. Bernaerts et al., “The value of single-shot turbo spin-echo diffusion-weighted MR imaging in the detection of middle ear cholesteatoma,” Neuroradiology, vol. 49, no. 10, pp. 841–848, 2007.
View at: Publisher Site | Google Scholar
C. E. Corrales and N. H. Blevins, “Imaging for evaluation of cholesteatoma: current concepts and future directions,” Current Opinion in Otolaryngology and Head and Neck Surgery, vol. 21, no. 5, pp. 461–467, 2013.
View at: Publisher Site | Google Scholar
F. Dubrulle, R. Souillard, D. Chechin, F. M. Vaneecloo, A. Desaulty, and C. Vincent, “Diffusion-weighted MR imaging sequence in the detection of postoperative recurrent cholesteatoma,” Radiology, vol. 238, no. 2, pp. 604–610, 2006.
View at: Publisher Site | Google Scholar
M. H. G. Dremmen, P. A. M. Hofman, J. R. Hof, R. J. Stokroos, and A. A. Postma, “The diagnostic accuracy of non-echo-planar diffusion-weighted imaging in the detection of residual and/or recurrent cholesteatoma of the temporal bone,” The American Journal of Neuroradiology, vol. 33, no. 3, pp. 439–444, 2012.
View at: Publisher Site | Google Scholar
H. Sharifian, E. Taheri, P. Borghei et al., “Diagnostic accuracy of non-echo-planar diffusion-weighted MRI versus other MRI sequences in cholesteatoma,” Journal of Medical Imaging and Radiation Oncology, vol. 56, no. 4, pp. 398–408, 2012.
View at: Publisher Site | Google Scholar
N. C. Cimsit, C. Cimsit, B. Baysal, I. C. Ruhi, S. Ozbilgen, and E. A. Aksoy, “Diffusion-weighted MR imaging in postoperative follow-up: reliability for detection of recurrent cholesteatoma,” European Journal of Radiology, vol. 74, no. 1, pp. 121–123, 2010.
View at: Publisher Site | Google Scholar
R. K. Lingam, P. Khatri, J. Hughes, and A. Singh, “Apparent diffusion coefficients for detection of postoperative middle ear cholesteatoma on non-echo-planar diffusionweighted images,” Radiology, vol. 269, no. 2, pp. 504–510, 2013.
View at: Publisher Site | Google Scholar
S. Khemani, R. K. Lingam, A. Kalan, and A. Singh, “The value of non-echo planar HASTE diffusion-weighted MR imaging in the detection, localisation and prediction of extent of postoperative cholesteatoma,” Clinical Otolaryngology, vol. 36, no. 4, pp. 306–312, 2011.
View at: Publisher Site | Google Scholar
B. de Foer, J.-P. Vercruysse, A. Bernaerts et al., “Middle ear cholesteatoma: non-echo-planar diffusion-weighted MR imaging versus delayed gadolinium-enhanced T1-weighted MR imaging—value in detection,” Radiology, vol. 255, no. 3, pp. 866–872, 2010.
View at: Publisher Site | Google Scholar
K. Yamashita, T. Yoshiura, A. Hiwatashi et al., “Detection of middle ear cholesteatoma by diffusion-weighted MR imaging: Multishot echo-planar imaging compared with single-shot echo-planar imaging,” The American Journal of Neuroradiology, vol. 32, no. 10, pp. 1915–1918, 2011.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2015 A. Elefante et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

3736

Downloads

1239

Citations