Reproducibility of Retinal Nerve Fiber Layer Measurements with Manual and Automated Centration in Healthy Subjects Using Spectralis Spectral-Domain Optical Coherence Tomography

Lange, Alex P.; Sadjadi, Reza; Costello, Fiona; Guber, Ivo; Traboulsee, Anthony L.

doi:https://doi.org/10.5402/2012/860819

International Scholarly Research Notices

On this page

Abstract Introduction Materials and Methods Results Discussion Acknowledgments References Copyright Related Articles

Clinical Study | Open Access

Volume 2012 | Article ID 860819 | https://doi.org/10.5402/2012/860819

Reproducibility of Retinal Nerve Fiber Layer Measurements with Manual and Automated Centration in Healthy Subjects Using Spectralis Spectral-Domain Optical Coherence Tomography

Alex P. Lange,¹Reza Sadjadi,²Fiona Costello,³Ivo Guber,⁴and Anthony L. Traboulsee²

Academic Editor: M. P. Shanmugam, K. Wu

Received07 May 2012

Accepted05 Jun 2012

Published30 Jul 2012

Abstract

Objective. The aim of this study was to test the reproducibility of the Heidelberg Spectralis SD-OCT and to determine if provided software retest function for follow-up exam is superior to manual centration. Design. Prospective, cross-sectional study. Participants. 20 healthy subjects. Methods. All subjects underwent SD-OCT testing to determine retinal nerve fiber layer (RNFL) measurements sequentially on two different days and with two different centration techniques. Within-subject standard deviation, coefficient of variation, and intraclass correlation coefficient were used to assess reproducibility. Results. RNFL measurements showed high reproducibility, low within-subject standard deviation (1.3), low coefficient of variation (0.63%), and low intra-class correlation coefficient (0.98 (95% CI 0.97–0.99)) in the automated centration and manual centration groups for average RNFL Thickness. Quadrants showed slightly higher variability in the manual group compared to the automated group (within-subject standard deviation 2.5–5.3 versus 1.1–2.4, resp.). Conclusions. SD-OCT provides high-resolution RNFL measurements with high reproducibility and low variability. The re-test function allows for easier recentration for longitudinal examinations with similar results in average RNFL, but less variability in quadrant RNFL. SD-OCT high reproducibility and low variability is a promising fact and should be further evaluated in longitudinal studies of RNFL.

1. Introduction

Optical coherence tomography (OCT) is a noninvasive technique that provides high-resolution, cross-sectional tomographic imaging of retinal tissue using backscattered light. OCT imaging is analogous to ultrasound B-mode imaging but uses infrared light instead of ultrasound waves. From multiple axial scans (A scans) at different transverse locations, a two-dimensional, cross-sectional image can be obtained [1].

Until recently, third-generation time-domain OCT (TD-OCT) using Stratus OCT (Carl Zeiss Meditec AG, Jena, Germany) has been widely used to acquire images at a rate of 400 axial scans per second with an axial resolution of 10 μm [2]. The recently introduced fourth-generation, spectral-domain OCT (SD-OCT) has improved depth resolution by a factor of three (axial resolution up to 3.8 μm) and allows a significantly higher acquisition speed (40,000 axial scans per second) resulting in improved image quality and minimized motion artefacts [3]. Furthermore, software improvements allow reconstruction of a three-dimensional image of the retina with SD-OCT.

Recent studies have shown differences between other SD-OCT machines (Cirrus SD-OCT, Carl Zeiss Meditec AG, Jena, Germany [4–9], RTVue-100, Optovue Inc., Fremont, CA, USA [10] and Spectralis, Heidelberg Engineering, Heidelberg, Germany [11, 12]) and TD-OCT in healthy controls and glaucoma patients. These studies showed better reproducibility compared to TD-OCT and significant differences in retinal nerve fiber layer thickness (RNFLT) measurements between the two generations of OCT machines.

Heidelberg Spectralis OCT software helps centering the optic disc on a frozen fundus image and uses an integrated eye tracking system to compensate for eye movement artefacts during data acquisition. Additionally, Heidelberg noise reduction technology (ART) improves image quality by averaging several consecutive scans and increasing signal-to-noise ratio [13]. Furthermore, software-assisted re-test function, using previous landmarks (location and direction of blood vessels) to recenter the SD-OCT beam to a previously scanned location, facilitates follow-up exams in longitudinal studies.

This would theoretically help to rescan the same location with every follow-up examination without the risk of variability due to different locations. The potential value of this re-centration function is significant to future longitudinal studies as it allows to detect very small changes in RNFL over time and can distinguish these changes from test-retest variability inherent to the technology.

However, before this new technology can be used as outcome measure for longitudinal study of slow, subtle axonal loss (e.g., in MS or glaucoma), it is crucial to determine the reproducibility and variability.

Therefore, the aim of this study is to determine reproducibility and variability of RFNL measurements using Spectralis SD-OCT with optimized settings and to compare manual centration versus automated re-test function in follow-up examinations of healthy controls.

2. Materials and Methods

2.1. Recruitment of Study Subjects

Healthy subjects were recruited from hospital staff by advertisement. Subjects with eye or systemic diseases by history were not enrolled in this study.

2.2. Spectral-Domain Optical Coherence Tomography

Heidelberg Spectralis OCT (software version 5.1.2, Heidelberg Engineering, Heidelberg, Germany) with RNFL protocol in high-resolution mode (resolution 3.8 μm, 19,000 scans per second) was used. Sixteen consecutive circular B Scans with a diameter of 3.4 mm were automatically averaged to reduce speckle noise (ART mode 16). The online tracking system compensated for eye movements. Both eyes of every subject were measured several times and the best centered scan with the highest quality score (≥25) [14] was chosen as a reference scan. Every eye was measured several times with manual centration (the circle scan was manually centered on the frozen fundus image) and automated re-test function (the previously taken reference scan was selected and the circle scan was positioned by the software) without pupil dilation [15]. When 5 scans (including reference scan) with a quality score of ≥25 were achieved, the exam was stopped and images were taken for analysis. The same procedure was performed on a second day within one week. Figure 1 shows the exact OCT algorithm.

2.3. Statistical Analysis

Microsoft Office 2007 and SPSS Version 16.0 were used to explore descriptive analysis and mean comparisons (Student’s t-test). The data was tested for normality. SD-OCT reproducibility was assessed using within-subject standard deviation (Sw; within subject standard deviation is the square root of the within-subjects sum of squares divided by degree of freedom), coefficient of variation (CV; within-subject standard deviation divided by the arithmetic mean, expressed as a percentage with CV <5% as good reproducibility), and intraclass correlation coefficient (ICC).

2.4. Ethics Statement

This study was reviewed by Clinical Research Ethics Board at the University of British Columbia and received research ethical approval prior to recruitment. A study information sheet was provided and informed consent was obtained prior to enrolment in the study.

3. Results

39 eyes of 20 healthy controls were included in the study. One eye had to be excluded due to inability of the OCT to recognize RNFL margins in a patient with high myopia. Theoretically, the software allowed for manual correction, but we did not want to bias any scans. There were 11 male and 9 female subjects with mean age 31.51 years (SD = 8.04 years). Mean RNFL value was 98.46 μm (95% CI 97.57–99.35 μm) for all eyes. An overview on descriptive data is given in Table 1.

In total, 3800 values for RNFL were included into statistical analysis. The data was normally distributed (Shapiro-Wilk > 0.05). The Sw, CV, and ICC findings are shown in Table 2.

In general, the overall reproducibility (day 1 + day 2) was excellent in both groups, especially for average RNFL with ICC of 0.98 (95% CI 0.974–0.990) in the automated group and ICC of 0.99 (95% CI 0.998–0.999) in the manual group. The quadrants showed slightly higher variability with Sw between 2.5 and 5.3 in the manual and Sw between 1.1 and 2.4 in the automated centration group.

If analysis was performed on data of day 1 and 2 separately (intersession reproducibility), no significant difference was found (; item reliability Cronbach’s alpha = 0.99).

If analysis was performed on data of right and left eyes separately, no significant difference was found (; item reliability Cronbach’s alpha = 0.98).

4. Discussion

This study evaluated reproducibility in the fourth-generation Heidelberg Spectralis OCT with optimum settings and compared manual centration and automated centration.

We were able to demonstrate high reproducibility of RNFL measurements with high ICC of 0.98 (95% CI 0.97–0.99) and low CV measuring less than 1%. Our results show less variability compared to those of Langenegger et al. [14], who in a cross-sectional study of 56 healthy controls and 47 glaucoma eyes using eye-tracker showed CV between 2.7% and 10.5% in the manual group and 1.3%–3.5% in the re-test function group. Our slightly lower variability can be explained by the high-resolution mode, allowing an axial resolution of 3.8 μm, whereas their high-speed mode cuts the resolution in half, and by using the eye tracker in our manual centration group as well, facilitating the centration. On the other hand, a cross-sectional study performed by Serbecic et al. [15] on both eyes of 31 healthy participants with activated re-test function found a similar CV between 0.29% and 1.07% and did not find any differences between measurements in high-speed or high-resolution mode. This implicates that the eye tracker rather than the higher resolution can explain these differences.

Another cross-sectional study on 30 healthy eyes that used no re-test function reported lower reproducibility with eyes ICC of 0.96 (95% CI 0.94–0.99) for average RNFLT and ICC between 0.87 and 0.96 for quadrants with Spectralis SD-OCT [12]. Although not directly comparable, especially quadrants variability was lower in our study when the re-test function was used.

In contrast, Seibold et al. [11] in a study on 80 healthy eyes with the same device showed ICC of 0.90 (95% CI 0.88–0.95), which is significantly lower than our results. They used only a single scan and compared it to a second single scan within 8 weeks using the follow-up function. The longer interval and the lack of repeated scanning might explain the differences.

On the other hand, previously published studies using the older generation TD-OCT devices showed lower ICC between 0.83 [2] and 0.95 [16] (Table 3).

A coefficient of variation of less than 1% in RNFL measurements of up to 140 μm will give a reproducibility within ±1-2 μm. This is the maximum that could be expected from the axial resolution of 3.8 μm of this device and superior to the older technology with axial resolution of 10 μm. One study found a difference in thickness of 8 micrometer to be within normal test-retest variability of the older TD-OCT machine [17].

The high reproducibility of the SD-OCT technology is very important in two particular applications: long-term follow-up of MS patients and monitoring of glaucoma progression.

In a recent cross-sectional study, RNFL measurements in healthy controls showed an age-related decrease of 2 μm per decade. Patients with relapsing-remitting MS (RRMS) in the interval were shown in a longitudinal study to have an average decrease in RNFL of 2 μm per year, which was a tenfold increase relative to healthy controls [18]. This was found using the older generation TD-OCT, and the results were only significant in the groups with more than 3 years of follow-up.

Glaucoma patients have been shown to have a median decrease in RNFL thickness measuring 3.3 μm per year [19]. Considering the recent launch of the commercially available SD-OCT and the slowly progressive character of glaucoma and MS, we must wait for more longitudinal SD-OCT data to become available. But our data show that reproducibility of the used machine is high enough to detect very small increments of change in RNFLT over time and, moreover, can distinguish these changes from test-retest variability inherent to the technology.

The Heidelberg Spectralis SD-OCT software has the advantage of providing automated re-test in follow-up examinations. We were able to show that manual centration and automated re-test function were equally reliable measuring the average RNFLT. However, there was a compensated variability in manual measurements compared to the automated ones. The most likely explanation is a possible decentration during manual scans. RNFL has been shown to decrease in more peripheral zones of the optic disc [20, 21]. While the average value for one shifted quadrant may decrease as a result of decentration, a corresponding quadrant value increases as there is more central area covered by this quadrant. This would also explain why average RNFL thickness is not affected. The automated centration seems to be more reliable if individual quadrant values are investigated as independent outcome measures, which is particularly important in the follow-up of glaucoma patient, where localised thinning of RNFL is expected.

Although we did not find any significant difference in reproducibility of average RNFLT between centration techniques, automated re-test function is a better outcome measure in clinical trials and research studies as it is a more standardised method and less subject to human error.

Shortcomings of our study were that only healthy eyes with generally higher RFNL values than glaucoma or MS eyes were included and we were not able to demonstrate the variability in thinner RNFL. On the other hand, RNFL analysis in different quadrants covered reproducibility testing within a range of 70 to 125 μm comparable to RNFL thickness measured in MS and glaucoma eyes [18, 19]. The second point is that inclusion of both eyes of the subjects may produce artificial inflation of study power and falsely narrow confidence intervals. The third point is that only well-centered scans were taken into analysis and scans were all performed by the same experienced operator. We are therefore not able to demonstrate variability in off-centered scans or interoperator variability.

In conclusion, SD-OCT machine shows high reproducibility in measuring RNFLT in healthy controls and may prove to be a valuable tool for assessing small longitudinal changes in RNFLT. Manual and automated centration showed similar reproducibility for average RNFL, with slightly more variation in the manual group for quadrants suggesting a use of the automated re-test function if quadrants are the primary outcome measure as in glaucoma monitoring.

Acknowledgments

None of the authors has any financial interests in any products mentioned in the study. A. P. Lange is supported by the Swiss National Science Foundation and the UBC Hospital NMO Research Program. This project was supported by the UBC Hospital NMO Research Program.

References

D. Huang, E. A. Swanson, C. P. Lin et al., “Optical coherence tomography,” Science, vol. 254, no. 5035, pp. 1178–1181, 1991.
View at: Google Scholar
L. A. Paunescu, J. S. Schuman, L. L. Price et al., “Reproducibility of nerve fiber thickness, macular thickness, and optic nerve head measurements using StratusOCT,” Investigative Ophthalmology and Visual Science, vol. 45, no. 6, pp. 1716–1724, 2004.
View at: Publisher Site | Google Scholar
C. K. S. Leung, C. Ye, R. N. Weinreb et al., “Retinal nerve fiber layer imaging with spectral-domain optical coherence tomography. A study on diagnostic agreement with heidelberg retinal tomograph,” Ophthalmology, vol. 117, no. 2, pp. 267–274, 2010.
View at: Publisher Site | Google Scholar
R. T. Chang, O. J. Knight, W. J. Feuer, and D. L. Budenz, “Sensitivity and specificity of time-domain versus spectral-domain optical coherence tomography in diagnosing early to moderate glaucoma,” Ophthalmology, vol. 116, no. 12, pp. 2294–2299, 2009.
View at: Publisher Site | Google Scholar
O. J. Knight, R. T. Chang, W. J. Feuer, and D. L. Budenz, “Comparison of retinal nerve fiber layer measurements using time domain and spectral domain optical coherent tomography,” Ophthalmology, vol. 116, no. 7, pp. 1271–1277, 2009.
View at: Publisher Site | Google Scholar
C. K. S. Leung, C. Y. L. Cheung, R. N. Weinreb et al., “Retinal nerve fiber layer imaging with spectral-domain optical coherence tomography. A variability and diagnostic performance study,” Ophthalmology, vol. 116, no. 7, pp. 1257.e2–1263.e2, 2009.
View at: Publisher Site | Google Scholar
K. R. Sung, D. Y. Kim, S. B. Park, and M. S. Kook, “Comparison of retinal nerve fiber layer thickness measured by cirrus HD and stratus optical coherence tomography,” Ophthalmology, vol. 116, no. 7, pp. 1264–1270, 2009.
View at: Publisher Site | Google Scholar
G. Vizzeri, R. N. Weinreb, A. O. Gonzalez-Garcia et al., “Agreement between spectral-domain and time-domain OCT for measuring RNFL thickness,” British Journal of Ophthalmology, vol. 93, no. 6, pp. 775–781, 2009.
View at: Publisher Site | Google Scholar
J. S. Kim, H. Ishikawa, K. R. Sung et al., “Retinal nerve fibre layer thickness measurement reproducibility improved with spectral domain optical coherence tomography,” British Journal of Ophthalmology, vol. 93, no. 8, pp. 1057–1063, 2009.
View at: Publisher Site | Google Scholar
A. O. González-García, G. Vizzeri, C. Bowd, F. A. Medeiros, L. M. Zangwill, and R. N. Weinreb, “Reproducibility of RTVue retinal nerve fiber layer thickness and optic disc measurements and agreement with stratus optical coherence tomography measurements,” American Journal of Ophthalmology, vol. 147, no. 6, pp. 1067–1074, 2009.
View at: Publisher Site | Google Scholar
L. K. Seibold, N. Mandava, and M. Y. Kahook, “Comparison of retinal nerve fiber layer thickness in normal eyes using time-domain and spectral-domain optical coherence tomography,” American Journal of Ophthalmology, vol. 150, no. 6, pp. 807–814, 2010.
View at: Publisher Site | Google Scholar
S. N. Arthur, S. D. Smith, M. M. Wright et al., “Reproducibility and agreement in evaluating retinal nerve fibre layer thickness between stratus and spectralis OCT,” Eye, vol. 25, no. 2, pp. 192–200, 2011.
View at: Publisher Site | Google Scholar
A. Sakamoto, M. Hangai, and N. Yoshimura, “Spectral-Domain optical coherence tomography with multiple b-scan averaging for enhanced imaging of retinal diseases,” Ophthalmology, vol. 115, no. 6, pp. 1071–1078, 2008.
View at: Publisher Site | Google Scholar
S. J. Langenegger, J. Funk, and M. Toteberg-Harms, “Reproducibility of retinal nerve fiber layer thickness measurements using the eye tracker and the retest function of spectralis SD-OCT in glaucomatous and healthy control eyes,” Investigative Ophthalmology and Visual Science, vol. 52, no. 6, pp. 3338–3344, 2011.
View at: Google Scholar
N. Serbecic, S. C. Beutelspacher, F. C. Aboul-Enein, K. Kircher, A. Reitner, and U. Schmidt-Erfurth, “Reproducibility of high-resolution optical coherence tomography measurements of the nerve fibre layer with the new heidelberg spectralis optical coherence tomography,” British Journal of Ophthalmology, vol. 95, no. 6, pp. 804–810, 2011.
View at: Publisher Site | Google Scholar
D. L. Budenz, R. T. Chang, X. Huang, R. W. Knighton, and J. M. Tielsch, “Reproducibility of retinal nerve fiber thickness measurements using the stratus OCT in normal and glaucomatous eyes,” Investigative Ophthalmology and Visual Science, vol. 46, no. 7, pp. 2440–2443, 2005.
View at: Publisher Site | Google Scholar
D. L. Budenz, M. J. Fredette, W. J. Feuer, and D. R. Anderson, “Reproducibility of peripapillary retinal nerve fiber thickness measurements with stratus OCT in glaucomatous eyes,” Ophthalmology, vol. 115, no. 4, pp. 661–666, 2008.
View at: Publisher Site | Google Scholar
L. S. Talman, E. R. Bisker, D. J. Sackel et al., “Longitudinal study of vision and retinal nerve fiber layer thickness in multiple sclerosis,” Annals of Neurology, vol. 67, no. 6, pp. 749–760, 2010.
View at: Publisher Site | Google Scholar
C. K. S. Leung, C. Y. L. Cheung, R. N. Weinreb et al., “Evaluation of retinal nerve fiber layer progression in glaucoma: a study on optical coherence tomography guided progression analysis,” Investigative Ophthalmology and Visual Science, vol. 51, no. 1, pp. 217–222, 2010.
View at: Publisher Site | Google Scholar
M. L. Gabriele, H. Ishikawa, G. Wollstein et al., “Peripapillary nerve fiber layer thickness profile determined with high speed, ultrahigh resolution optical coherence tomography high-density scanning,” Investigative Ophthalmology and Visual Science, vol. 48, no. 7, pp. 3154–3160, 2007.
View at: Publisher Site | Google Scholar
G. Savini, P. Barboni, M. Carbonelli, and M. Zanini, “The effect of scan diameter on retinal nerve fiber layer thickness measurement using stratus optic coherence tomography,” Archives of Ophthalmology, vol. 125, no. 7, pp. 901–905, 2007.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2012 Alex P. Lange et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2130

Downloads

904

Citations