Clinical Study | Open Access
Clinical Significance of Optic Disc Progression by Topographic Change Analysis Maps in Glaucoma: An 8-Year Follow-Up Study
Aim. To investigate the ability of Heidelberg Retina Tomograph (HRT3) Topographic Change Analysis (TCA) map to predict the subsequent development of clinical change, in patients with glaucoma. Materials. 61 eyes of 61 patients, which, from a retrospective review were defined as stable on optic nerve head (ONH) stereophotographs and visual field (VF), were enrolled in a prospective study. Eyes were classified as TCA-stable or TCA-progressed based on the TCA map. All patients underwent HRT3, VF, and ONH stereophotography at 9–12 months intervals. Clinical glaucoma progression was determined by masked assessment of ONH stereophotographs and VF Guided Progression Analysis. Results. The median (IQR) total HRT follow-up period was 8.1 (7.3, 9.1) years, which included a median retrospective and prospective follow-up time of 3.9 (3.1, 5.0) and 4.0 (3.5, 4.7) years, respectively. In the TCA-stable eyes, VF and/or photographic progression occurred in 5/13 (38.4%) eyes compared to 11/48 (22.9%) of the TCA-progressed eyes. There was no statistically significant association between TCA progression and clinically relevant (photographic and/or VF) progression (hazard ratio, 1.18; ). The observed median time to clinical progression from enrollment was significantly shorter in the TCA-progressed group compared to the TCA-stable group (). Conclusion. Our results indicate that the commercially available TCA progression criteria do not adequately predict subsequent photographic and/or VF progression.
Accurate assessment of structural and functional change in glaucoma is important for diagnosis and progression detection. In current clinical practice, functional progression is monitored by standard automated perimetry (SAP). Structural progression is subjectively determined by clinical evaluation of optic nerve head (ONH) stereophotographs [1–4]. Results from the Collaborative Initial Glaucoma Treatment Study (CIGTS) and Ocular Hypertension Treatment Study (OHTS) support the view that optic disc change may be a more sensitive indicator of glaucomatous progression than VF change in patients with glaucoma or ocular hypertension (OHT) [5, 6]. However, in many cases VF defects were the first sign of glaucomatous development in OHT eyes .
Objective technologies such as the Heidelberg Retina Tomograph (HRT, Heidelberg Engineering, GmbH, Dossenheim, Germany) have been developed as adjuncts to subjective ONH evaluation. The HRT is a confocal scanning laser tomography device that creates reproducible and repeatable three-dimensional topographic images of the ONH and the peripapillary retina .
The TCA map is an event-based technique for detecting topographic surface height changes across the entire ONH and peripapillary surface at a superpixel level between baseline and follow-up images. Progression is identified when the change exceeds measurement variability and is confirmed in, at least, 3 consecutive tests (error probability <5%). In the currently available software (HRT3), progression is defined as a cluster of 20 or more significantly depressed superpixels [9, 10].
There is increasing evidence in the literature that TCA can detect progressive optic disc changes [9, 11–14]. Additionally, eyes with previous optic disc change by TCA map were more likely to have subsequent VF progression . Nevertheless, as our previous study and other studies have demonstrated, there is a significant subset of patients who show TCA changes without ONH stereophotograph [11–13] nor VF progression .
The aim of this study was to determine, in a prospective fashion, how well TCA maps are able to predict the subsequent development of ONH and/or VF changes.
This was a prospective cohort study that enrolled clinically stable eyes with glaucoma. Subject recruitment took place in the Glaucoma Unit of Toronto Western Hospital, University Health Network, Toronto, Canada. Data analysis and interpretation took place in the Glaucoma Units of Toronto Western Hospital, and University of Athens, Athens, Greece. In accordance with the Declaration of Helsinki, patients gave informed consent to participate in the study and the protocol was approved by the University Health Network Research Ethics Board.
To identify clinically stable eyes a retrospective chart review of all patients that had undergone ONH scanning with HRT between 1997 and 2006 was performed. Inclusion criteria were the following.(1)Diagnosis of glaucoma: subjects were defined as having glaucoma according to VF defects regardless of the clinical appearance of the optic disc. Glaucomatous VF defect was defined  by a Glaucoma Hemifield Test (GHT) outside normal limits on at least two VFs, or a cluster of three or more nonedge points in a location typical for glaucoma, all of which are depressed on the pattern deviation plot at a level and one of which is depressed at a level on two consecutive VFs, or a pattern standard deviation (PSD) with level on two consecutive VFs.(2)Best corrected visual acuity >20/60.(3)>2 years followup.(4)≥4 good-quality HRT examinations (SD ≤ 50);(5)Reliable baseline VF (≤33% false positives, false negatives, and fixation losses) performed within 8 months of their first and most recent HRT examination.(6)ONH stereophotographs within 8 months of their first and most recent HRT examination.Exclusion criteria were (1) systemic disease or systemic medication known to affect the visual field; (2) refractive error exceeding 5 diopters (equivalent sphere) of myopia or hyperopia, or 3 diopters of astigmatism; and (3) concomitant eye disease. If both eyes were eligible, one eye was randomly chosen.
From a total of 1200 patients, 92 eyes of 92 patients met the above criteria. ONH stereophotographs and VF tests of those 92 patients were retrospectively evaluated to identify if they had VF and/or photographic change (Figure 1).
After this initial retrospective evaluation, 61 eyes of 61 glaucoma patients were identified as clinically stable (stable on both ONH stereophotographs and VFs) and were enrolled in a prospective study. At enrollment in the prospective study, 27/61 clinically stable eyes were classified as TCA-stable and 34/61 clinically stable eyes were classified as TCA-progressed according to HRT3 progression criteria. During the prospective period all patients underwent testing with HRT3, SAP, and ONH stereophotographs at 9–12 months intervals.
Treatment changes were made in order to maintain target IOP. As there is no published evidence to show TCA’s benefit regarding initiation or change to treatment regimes, no treatment changes were initiated based on TCA indications for progression alone [11, 17].
2.2. Glaucoma Progression
The total followup consisted of an initial (retrospective or preenrollment) and a subsequent (prospective) followup with the objective of determining how TCA change during the initial follow-up predicted clinical progression during the subsequent followup. For all three testing methods used in this study, progression was determined by comparing the most recent examination to the initial baseline using the progression criteria described below. In the current study, clinical progression was defined as a worsening on VFs and/or ONH stereophotographs by the following criteria.
2.2.1. HRT ONH Imaging
While HRTII software was used for image acquisition in the preenrollment period, HRT3 was used for image acquisition in the prospective period. HRT image analysis, throughout the study period (retrospective and prospective period), was performed by HRT3 software. According to currently available TCA progression criteria, progression was defined based on the largest cluster of repeatable depressed superpixels (>20 superpixels)  with statistically significant change within the optic disc-cluster totally or partially inside the ONH margin. Progression was not considered when the clusters of superpixels were observed on ONH vessels [18, 19]. Additionally, HRT images were checked for good alignment. Poor quality (SD > 50 μm) and misaligned images were excluded and the whole series reprocessed. Throughout the study, eyes were classified as TCA-progressed or TCA-stable based on the HRT3 TCA results.
2.2.2. Stereoscopic Optic Disc Photography
All stereophotographs were sequentially obtained with the same model fundus camera (Topcon retinal camera TRC.50IX) by experienced technicians. Progressive change in stereophotographs (focal or concentric rim thinning, increased vertical cup-to-disc ratio, new or enlarged RNFL defect, or the presence of a new disc hemorrhage) was defined as a clinical change in the ONH.
Evidence of progression was based on masked comparison between the baseline and most recent stereophotograph, independently by two experienced glaucoma specialists (Trope and Buys) [11, 20]. Observers were masked to patient identity, diagnosis, and the other observer’s results. The temporal order of each photo pair was unmasked. Progression was defined as a dichotomous variable (progression versus no progression). Additionally, the observers were asked to indicate the location where change had occurred. If the observers disagreed, a consensus evaluation was undertaken.
2.2.3. Visual Field Testing
Progression on VFs was defined as “likely progression” based on SAP GPA, requiring significant change in ≥3 points in 3 consecutive follow-up VFs.
2.2.4. Statistical Analysis
Quantitative characteristics of the study population were summarized through median and interquartile range (IQR), whereas absolute and relative frequencies were used to summarize categorical variables. Descriptive characteristics were presented according to the TCA status at enrollment date in the prospective study (Progressed or Stable). Comparisons between these two groups were performed using Mann-Whitney tests and Fisher’s exact tests for quantitative and qualitative characteristics, respectively.
Differences in time-to-clinical (stereophotograph and/or VF) progression according to TCA status were evaluated through survival analysis techniques. More specifically, log-rank tests and Cox proportional hazards models were used to evaluate the prognostic value of TCA status along with other factors.
Probability of clinical progression was estimated and plotted using the Kaplan-Meier method. The focus of this study was to see if TCA progression or TCA stability had any influence on the subsequent development of clinically detectable glaucomatous change. Therefore, enrollment date in the prospective study (time-point when TCA status became known) was used as the time origin for the survival analyses. The TCA status was used as a time-updated variable (time-varying covariate).
Interobserver reliability with respect to stereophotograph evaluation was calculated by Cohen’s Kappa statistic;  The Bias index (BI), the Prevalence index (PI), the Bias Adjusted Kappa (BAK), and the Prevalence and Bias Adjusted Kappa (PABAK) were also calculated [23–25].
A power analysis was performed to determine the smallest hazard ratio for clinical progression that could be detected with the current study size. For the primary outcome of VF and/or ONH stereophotograph progression, given the number of TCA stable and TCA-progressed eyes at enrollment and assuming an annual progression rate of 0.08 in the TCA stable group (similar to EMGT) , the smallest hazard ratio that could be detected with at least 80% power (at by 2-tailed test) was 3.3.
Sixty-one clinically stable eyes of 61 patients with glaucoma were included. Each study eye was classified as TCA-stable or TCA-progressed. Demographic and clinical characteristics of study patients/eyes are shown in Tables 1 and 2. At baseline, 53/61 eyes had early VF defects (MD >−6.0 dB), 6/61 eyes had moderate VF defects (−6.0 dB > MD >−12.0 dB), and 2/61 eyes had advanced VF defects (MD <−12.0 dB) (Table 2).
|POAG: primary open angle glaucoma; LTG: low tension glaucoma; CACG: chronic angle closure glaucoma; PG: pigmentary glaucoma; MMG: mixed mechanism glaucoma; MRA: moorfields regression analysis.|
|IQR: interquartile ranges; CCT: central corneal thickness; VF: visual field; MD: mean deviation; PSD: pattern standard deviation; VFI: visual field index; SD: standard deviation; Stdev: standard deviation; GHT: glaucoma hemifield test (1.0: within normal limits, 2.0: borderline, and 3.0: outside normal limits); MRA: moorfields regression analysis (1.0: within normal limits, 2.0: borderline, and 3.0: outside normal limits). |
Agreement between the two observers in the evaluation of stereophotographs was moderate (proportion of observed agreement (95% confidence interval, CI): 0.86–0.94), with Cohen’s kappa coefficient (95% CI: 0.23–0.63). The BI was −0.014, the PI was 0.81, the BAK was 0.43, and the PABAK was 0.81.
The median (IQR) absolute time difference between the baseline HRT examination and baseline disc photograph was 0.27 (0, 0.87) months, and the baseline HRT examination and baseline VF was 0.23 (0, 1.37) months. The median (IQR) total HRT followup was 8.1 (7.0, 9.1) years, which includes a median preenrollment (or retrospective) and prospective follow-up time of 3.9 (3.1, 5.0) and 4.0 (3.5, 4.7) years respectively (Table 2). There were no statistically significant differences in enrollment characteristics between TCA stable and TCA-progressed eyes (Table 2).
Quality of HRT images was very good throughout the total follow-up period (median (IQR) HRT topography SD was 17 (13, 22)). Of the approximately 840 HRT images, only 7 had a SD between 40 and 50 μm. The median (IQR) HRT topography SD in the TCA-progressed group was 17 (13, 22) and in the TCA-stable group was 16 (12, 19). A Kruskal-Wallis analysis was performed that indicated a nonsignificant difference between the two groups (, 1 d.f., ).
TCA progression was documented in 48/61 (78.7%) eyes during the study but clinical progression (ONH stereophotograph and/or VF change) was detected in only 16/61 (26.2%) eyes.
Figure 1 shows the study selection and exclusion process and Figure 2 details the prospective period in which clinical progression (photographic ONH and/or VF change) occurred in 5/13 (38.4%) TCA-stable eyes and in 11/48 (22.9%) TCA-progressed eyes.
The Kaplan-Meier cumulative probability of stereophotograph and/or VF progression in eyes with previous TCA progression was 18%, 20.5%, and 24.4% by 3, 4, and 5 years after enrollment, respectively, compared with 0.0%, 26%, and 36.5% in TCA-stable eyes (Figure 3, Table 5).
Table 3 reports the hazard ratios (HRs) with 95% confidence intervals (CIs) from univariate Cox models for each potential predictive factor for glaucoma progression. TCA progression was not associated with a statistically significant increased risk of photographic and/or VF progression compared with TCA stability (HR, 1.18; ). For any fixed point in time, TCA-progressed eyes were at nearly four times the risk of VF progression as TCA-stable eyes; however, this was not statistically significant (HR 3.70; ).
|MRA: moorfields regression analysis; OHT: ocular hypertension; CCT: central corneal thickness; MD: mean deviation; PSD: pattern standard deviation; VFI: visual field index; c/d: cup/disc; HR: hazard ratio; SD: standard deviation; CI: confidence interval; dots (.) denote nonestimable quantities.|
The median survival time could not be computed because less than half the subjects reached the event of interest (stereophotograph and/or VF progression). Instead the observed median times to stereophotograph and/or VF progression were calculated, for those who showed stereophotograph and/or VF progression. The observed median time to VF and/or stereophotograph progression from enrollment was statistically significant shorter in the TCA-progressed group compared to the TCA-stable group (Table 4).
|ONH: optic nerve head; TCA: topography change analysis; SPG: stereophotograph; VF: visual field; IQR: interquartile ranges; dots (.) denote nonestimable quantities.|
|Dots (.) denote nonestimable quantities.|
In 9 eyes of our cohort, HRTI scans were used as baseline images. Survival analyses were also performed, after excluding the 9 eyes with HRTI baseline, which gave similar results. More in detail, the Kaplan-Meier cumulative probability of stereophotograph and/or VF progression in eyes with previous TCA progression was 20.6%, 23.4%, and 28.2% by 3, 4, and 5 years after enrollment, respectively, compared with 0.0%, 28.6%, and 40.5% in TCA-stable eyes (log rank ). TCA progression was not associated with a statistically significant increased risk of photographic and/or VF progression compared with TCA stability (HR, 1.14; ).
TCA-map has shown good ability to detect progressive ONH changes [9, 11–14]. However, the clinical usefulness of commercially available TCA progression criteria  is significantly limited since a large subset of patients with ONH changes on TCA has no clinically detectable change (22.2% to 55.4% of TCA progressing eyes) [9, 11].
In the present study, we investigated whether eyes with TCA progression at enrollment, but no VF and ONH stereophotograph change, were associated with increased risk of subsequently developing clinically detectable glaucoma progression based on VF GPA and expert assessment of ONH stereophotographs. For this reason, we included eyes that had neither photographic ONH nor functional progression for a median retrospective follow-up period of 3.9 years (Table 2). In addition, we should note the fact that we mostly enrolled clinically stable eyes with early glaucomatous VF damage (Table 2)—as a result of the patient selection process and the availability of eligible patient—and, therefore, our results may not apply to glaucoma patients in general.
Although SAP and ONH stereophotographs may be imperfect reference standards, they are widely used in clinical practice and have been validated by major clinical trials [27–29]. To the best of our knowledge, our study is the first publication on ONH stereophotograph and VF progression after longitudinally observed TCA change in patients with stable glaucoma.
Our results indicate that current TCA progression criteria  do not successfully predict subsequent photographic and/or VF progression as defined in this study. The predictive ability of TCA maps did not significantly improve when different criteria were used to define progression (disc stereophotographs, GPA, disc stereophotographs, and/or GPA) (Figure 3, Table 5). The survival curves reveal that, after 3 years of prospective followup, the TCA-progressed group had a nonstatistically significant higher probability of photographic and/or VF progression (Figure 3, Table 5).
Our previous work  tried to identify discrepancies between TCA-progression and progression detected by expert-assessed sequential disc stereophotographs. This 2.6 year retrospective study on 54 patients reported agreement in only 65% of cases. A smaller proportion progressed on stereophotograph assessment (6%, or 3 eyes) compared to TCA (30%, or 16 eyes). Other studies [9, 12] comparing longitudinal TCA and stereophotographs have also reported that agreement between these 2 structural assessments is moderate, with concordances of 81% and 44% to 71% (depending on progression criteria). This could be attributed to the fact that different methods possibly provide complimentary progression information as illustrated in our cases of disagreement (Figure 4).
Table 3 details univariate Cox’s models to investigate the relationship between clinically relevant glaucoma progression and patient characteristics. TCA progression was associated with an insignificant trendto increased risk for clinically relevant glaucoma progression. All other evaluated risk factors showed no significant prognostic effect. This result could be due to the relatively small number of clinically progressing eyes (16/61, 26.2%) in our cohort.
Data in Table 4 indicates that TCA change may be associated with earlier clinical glaucoma progression. More in detail, the observed median time to VF and/or ONH stereophotograph progression from enrollment was significantly shorter in the TCA-progressed group compared to the TCA-stable group (). Given the small numbers, the quality of available evidence is low and not suitable for drawing conclusions. Chauhan et al.  recently showed, by using a conservative TCA criterion, that mean time to VF progression was statistically significantly shorter in patients with previous TCA disc changes. Nevertheless, the predictive ability of TCA progression was found to be rather weak with more than 70% of the TCA progressing eyes not developing VF progression when followed for more than 6 years after TCA progression was detected .
Of concern was the fact that a significant number of TCA stable patients (5/13, 38.4%) showed photographic ONH or VF progression. In each case, TCA identified the corresponding ONH area as being abnormal but with fewer than 20 red superpixels (Figure 5). This suggests that in these cases the TCA criteria were too conservative and may need adjustment based on other factors such as disease severity or location to detect progression.
Several different methods have been proposed to improve the performance of the TCA technique to monitor progression, which are yet to be incorporated into the operational software. These include using TCA cutoffs, statistical image mapping (SIM) technique, and proper orthogonal decomposition [13, 30, 31]. O’Leary et al.  compared change in HRT image series identified by 3 automated statistical analytical methods (TCA, SIM, and ordinary least squares linear regression of rim area (RALR)) with optic disc stereophotographs assessments by glaucoma specialists. This study showed poor agreement between glaucoma expert-assessed stereophotographs and the 3 HRT statistical analyses. At a fixed specificity of 90% for all 3 methods, sensitivities were 25% for TCA, 27% for SIM, and 40% for RALR.
Bowd et al.  introduced new TCA parameters and suggested parameter cutoffs for detecting progression in eyes with suspected or known primary open angle glaucoma. When the best performing cutoffs were applied to longitudinal topographic series obtained from patient eyes observed for four or more years and showing no evidence of progression based on SAP or stereophotographic assessment, specificities were poor to moderate (from 0.464 for CAREAdisc (area of a cluster, in mm2, within the optic disc margin), with the 0.90 specificity cutoff of 0.036 mm2, to 0.647, with the 0.99 specificity cutoff of 0.074 mm2).
There are certain limitations that need to be acknowledged and addressed regarding the present study. One limitation of this and similar studies is the lack of a sufficiently independent valid reference standard for progression. We decided to employ structural and functional endpoints despite the fact that the comparison of an imaging technology is likely more relevant to photographic optic disc progression rather than perimetry. The EMGT criterion for VF progression was recently shown to have high specificity . Nevertheless, it may be the case that true progression is missed using subjective stereophotograph assessment. Also, it is likely that VF progression does not occur in temporal conjunction with structural change, regardless of progression criteria.
Our observers’ agreement reviewing ONH stereophotographs has been evaluated in previous studies [11, 20] and is consistent with other studies [33–35]. Despite an interobserver agreement of 90% (proportion of observed agreement (95%, CI): 0.86–0.94), the kappa value suggests moderate agreement. However, the PABAK (0.81) revealed that kappa (0.43) was influenced by the low prevalence of disc change as judged by either observer and therefore it may be erroneous to conclude that our observers’ ratings were unreliable .
Another limitation of this study is the fact that TCA progression criteria included statistically significant clusters of red superpixels located either totally or partially inside the ONH margin. Clusters lying mostly outside the ONH margin could probably not be detected clinically by looking at optic disc stereophotos. Therefore, such a criterion could induce false positive TCA-progressed patients. Nevertheless, the commercially available HRT3 software, we used in the current study, does not have the ability to delineate a significant cluster of superpixels within the ONH margin if it belongs to a larger cluster that is extended partially outside the optic disc as well.
A possible weakness of this study is that the HRT software was updated during the 8-year followup. Image acquisition was performed by using HRTII in the preenrollment period and HRT3 in the prospective period. In 9 eyes, HRTI scans were used as baseline images. Image analysis however was carried out in both pre-enrollment and prospective periods by using only HRT3. The HRT3 has the advantage of compatibility with the earlier versions allowing glaucoma progression to be detected over a much longer time period . Recent evidence shows that in some eyes, TCA progression may be overestimated when HRTI scans are used as baseline images with HRTII scans as follow-up images . In our cohort, results from the survival analyses were similar after excluding the 9 eyes with HRTI baseline.
Possible limitation also includes the fact that the current study was powered to detect a large HR (HR ≥ 3.3) for development of clinical progression. Given the fact we did not find that the expected association raises the possibility that this could have been due to a small sample size and thus our evaluations were possibly underpowered. This is also suggested by the fact that no other risk factor was associated with clinical progression in the Cox proportional hazards analysis. Nevertheless, the HR magnitude that could be detected by our study size was generally lower compared to hazard ratios for the association between other HRT parameters (moorfields regression analysis (MRA) and Glaucoma Probability Score (GPS)) and the development of glaucoma progression in the OHTS. Weinreb et al.  reported hazard ratios ranging from 2.92 to 3.59 for the GPS global and regional parameters outside normal limits compared with within normal limits, and from 3.34 to 14.25 for the MRA global and regional parameters outside normal limits compared with not outside normal limits.
In conclusion, the identification of clusterwise significant change needs clinical interpretation and possibly redefinition of current progression criteria in order to take advantage of the many practical advantages of the HRT. Our results suggest that TCA progression on its own was associated with only a statistically insignificant trendto increased risk for clinically relevant glaucoma progression. It is possible that TCA ONH change may be associated with earlier clinical glaucoma progression but longer followup is required to prove this. In addition, clinical change was found in nearly 40% of eyes deemed stable by TCA. Although TCA maps are widely used there are currently only few suggestions as to what constitutes clinically relevant change. Therefore, clinicians should not rely on a single method to determine disease progression.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
The authors thank Nikos Pantazis, Biostatistician, Ph.D., Department of Hygiene, Epidemiology and Medical Statistics, Medical School, University of Athens, Greece, for providing necessary statistical support for conducting this study. This research was supported by the Glaucoma Research Society of Canada and Sponsored by the Glaucoma Research Society of Canada.
- J. Caprioli, “Clinical evaluation of the optic nerve in glaucoma,” Transactions of the American Ophthalmological Society, vol. 92, pp. 589–641, 1994.
- P. J. Airaksinen, S. M. Drance, G. R. Douglas, M. Schulzer, and K. Wijsman, “Visual field and retinal nerve fiber layer comparisons in glaucoma,” Archives of Ophthalmology, vol. 103, no. 2, pp. 205–207, 1985.
- T. Odberg and D. Riise, “Early diagnosis of glaucoma: the value of successive stereophotography of the optic disc,” Acta Ophthalmologica, vol. 63, no. 3, pp. 257–263, 1985.
- H. A. Quigley, J. Katz, R. J. Derick, D. Gilbert, and A. Sommer, “An evaluation of optic disc and nerve fiber layer examinations in monitoring progression of early glaucoma damage,” Ophthalmology, vol. 99, no. 1, pp. 19–28, 1992.
- M. A. Kass, D. K. Heuer, E. J. Higginbotham et al., “The ocular hypertension treatment study: a randomized trial determines that topical ocular hypotensive medication delays or prevents the onset of primary open-angle glaucoma,” Archives of Ophthalmology, vol. 120, no. 6, pp. 701–713, 2002.
- R. K. Parrish II, W. J. Feuer, J. C. Schiffman, P. R. Lichter, and D. C. Musch, “Five-year follow-up optic disc findings of the collaborative initial glaucoma treatment study,” American Journal of Ophthalmology, vol. 147, no. 4, pp. 717–724, 2009.
- N. G. Strouthidis, E. T. White, V. M. F. Owen, T. A. Ho, C. J. Hammond, and D. F. Garway-Heath, “Factors affecting the test-retest variability of Heidelberg retina tomograph and Heidelberg retina tomograph II measurements,” British Journal of Ophthalmology, vol. 89, no. 11, pp. 1427–1432, 2005.
- B. C. Chauhan, J. W. Blanchard, D. C. Hamilton, and R. P. LeBlanc, “Technique for detecting serial topographic changes in the optic disc and peripapillary retina using scanning laser tomography,” Investigative Ophthalmology and Visual Science, vol. 41, no. 3, pp. 775–782, 2000.
- B. C. Chauhan, T. A. McCormick, M. T. Nicolela, and R. P. LeBlanc, “Optic disc and visual field changes in a prospective longitudinal study of patients with glaucoma: comparison of scanning laser tomography with conventional perimetry and optic disc photography,” Archives of Ophthalmology, vol. 119, no. 10, pp. 1492–1499, 2001.
- Heidelberg, “Glaucoma module. Heidelberg retina tomograph (HRT II and HRT 3),” Operating Instructions, Software Version 3. 0. Version, 3. 02-E03. Heidelberg, Germany, 2006.
- D. Kourkoutas, Y. M. Buys, J. G. Flanagan, W. V. Hatch, C. Balian, and G. E. Trope, “Comparison of glaucoma progression evaluated with Heidelberg retina tomograph II versus optic nerve head stereophotographs,” Canadian Journal of Ophthalmology, vol. 42, no. 1, pp. 82–88, 2007.
- B. C. Chauhan, D. M. Hutchison, P. H. Artes et al., “Optic disc progression in glaucoma: comparison of confocal scanning laser tomography to optic disc photographs in a prospective study,” Investigative Ophthalmology and Visual Science, vol. 50, no. 4, pp. 1682–1691, 2009.
- C. Bowd, M. Balasubramanian, R. N. Weinreb et al., “Performance of confocal scanning laser tomograph topographic change analysis (TCA) for assessing glaucomatous progression,” Investigative Ophthalmology and Visual Science, vol. 50, no. 2, pp. 691–701, 2009.
- J. C. Ervin, H. G. Lemij, R. P. Mills, H. A. Quigley, H. W. Thompson, and C. F. Burgoyne, “Clinician change detection viewing longitudinal stereophotographs compared to confocal scanning laser tomography in the LSU experimental glaucoma (LEG) study,” Ophthalmology, vol. 109, no. 3, pp. 467–481, 2002.
- B. C. Chauhan, M. T. Nicolela, and P. H. Artes, “Incidence and rates of visual field progression after longitudinally measured optic disc change in glaucoma,” Ophthalmology, vol. 116, no. 11, pp. 2110–2118, 2009.
- E. Hodapp, R. K. Parrish, and D. R. Anderson, Clinical Decisions in Glaucoma, Mosby, St. Louis, Mo, USA, 1st edition, 1993.
- D. S. Kamal, D. F. Garway-Heath, R. A. Hitchings, and F. W. Fitzke, “Use of sequential Heidelberg retina tomograph images to identify changes at the optic disc in ocular hypertensive patients at risk of developing glaucoma,” British Journal of Ophthalmology, vol. 84, no. 9, pp. 993–998, 2000.
- L. Brigatti, M. Weitzman, and J. Caprioli, “Regional test-retest variability of confocal scanning laser tomography,” American Journal of Ophthalmology, vol. 120, no. 4, pp. 433–440, 1995.
- B. C. Chauhan and T. A. McCormick, “Effect of the cardiac cycle on topographic measurements using confocal scanning laser tomography,” Graefe's Archive for Clinical and Experimental Ophthalmology, vol. 233, no. 9, pp. 568–572, 1995.
- W. V. Hatch, G. E. Trope, Y. M. Buys, P. Macken, E. E. Etchells, and J. G. Flanagan, “Agreement in assessing glaucomatous discs in a clinical teaching setting with stereoscopic disc photographs, planimetry, and laser scanning tomography,” Journal of Glaucoma, vol. 8, no. 2, pp. 99–104, 1999.
- A. Heijl, M. C. Leske, B. Bengtsson et al., “Measuring visual field progression in the early manifest glaucoma trial,” Acta Ophthalmologica Scandinavica, vol. 81, no. 3, pp. 286–293, 2003.
- B. Bengtsson, A. Lindgren, A. Heijl, G. Lindgren, P. Åsman, and M. Patella, “Perimetric probability maps to separate change caused by glaucoma from that caused by cataract,” Acta Ophthalmologica Scandinavica, vol. 75, no. 2, pp. 184–188, 1997.
- A. Agresti, Categorical Data Analysis, Wiley, New York, NY, USA, 1990.
- A. Mackinnon, “A spreadsheet for the calculation of comprehensive statistics for the assessment of diagnostic tests and inter-rater agreement,” Computers in Biology and Medicine, vol. 30, no. 3, pp. 127–134, 2000.
- T. Byrt, J. Bishop, and J. B. Carlin, “Bias, prevalence and kappa,” Journal of Clinical Epidemiology, vol. 46, no. 5, pp. 423–429, 1993.
- M. C. Leske, A. Heijl, L. Hyman, B. Bengtsson, L. Dong, and Z. Yang, “Predictors of long-term progression in the early manifest glaucoma trial,” Ophthalmology, vol. 114, no. 11, pp. 1965–1972, 2007.
- S. Miglior, T. Zeyen, N. Pfeiffer, J. Cunha-Vaz, V. Torri, and I. Adamsons, “Results of the European glaucoma prevention study,” Ophthalmology, vol. 112, no. 3, pp. 366–375, 2005.
- A. Heijl, B. Bengtsson, B. C. Chauhan et al., “A comparison of visual field progression criteria of 3 major glaucoma trials in early manifest glaucoma trial patients,” Ophthalmology, vol. 115, no. 9, pp. 1557–1565, 2008.
- M. O. Gordon, J. A. Beiser, J. D. Brandt et al., “The ocular hypertension treatment study: baseline factors that predict the onset of primary open-angle glaucoma,” Archives of Ophthalmology, vol. 120, no. 6, pp. 714–720, 2002.
- A. J. Patterson, D. F. Garway-Heath, N. G. Strouthidis, and D. P. Crabb, “A new statistical approach for quantifying change in series of retinal and optic nerve head topography images,” Investigative Ophthalmology and Visual Science, vol. 46, no. 5, pp. 1659–1667, 2005.
- M. Balasubramanian, C. Bowd, R. N. Weinreb et al., “Clinical evaluation of the proper orthogonal decomposition framework for detecting glaucomatous changes in human subjects,” Investigative Ophthalmology and Visual Science, vol. 51, no. 1, pp. 264–271, 2010.
- N. O'Leary, D. P. Crabb, S. L. Mansberger et al., “Glaucomatous progression in series of stereoscopic photographs and heidelberg retina tomograph images,” Archives of Ophthalmology, vol. 128, no. 5, pp. 560–568, 2010.
- T. Zeyen, S. Miglior, N. Pfeiffer, J. Cunha-Vaz, and I. Adamsons, “Reproducibility of evaluation of optic disc change for glaucoma with stereo optic disc photographs,” Ophthalmology, vol. 110, no. 2, pp. 340–344, 2003.
- R. K. Parrish II, J. C. Schiffman, W. J. Feuer et al., “Test-retest reproducibility of optic disk deterioration detected from stereophotographs by masked graders,” American Journal of Ophthalmology, vol. 140, no. 4, pp. 762–764, 2005.
- A. Azuara-Blanco, L. J. Katz, G. L. Spaeth, S. A. Vernon, F. Spencer, and I. M. Lanzl, “Clinical agreement among glaucoma experts in the detection of glaucomatous changes of the optic disk using simultaneous stereoscopic photographs,” American Journal of Ophthalmology, vol. 136, no. 5, pp. 949–950, 2003.
- A. R. Feinstein and D. V. Cicchetti, “High agreement but low kappa: I. the problems of two paradoxes,” Journal of Clinical Epidemiology, vol. 43, no. 6, pp. 543–549, 1990.
- N. G. Strouthidis and D. F. Garway-Heath, “New developments in Heidelberg retina tomograph for glaucoma,” Current Opinion in Ophthalmology, vol. 19, no. 2, pp. 141–148, 2008.
- M. Balasubramanian, C. Bowd, R. N. Weinreb, and L. M. Zangwill, “Agreement between Heidelberg retina tomograph-I and-II in detecting glaucomatous changes using topographic change analysis,” Eye, vol. 25, no. 1, pp. 31–42, 2011.
- R. N. Weinreb, L. M. Zangwill, S. Jain et al., “Predicting the onset of glaucoma: the confocal scanning laser ophthalmoscopy ancillary study to the ocular hypertension treatment study,” Ophthalmology, vol. 117, no. 9, pp. 1674–1683, 2010.
Copyright © 2014 D. Kourkoutas et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.