Longitudinal Screening for Diabetic Retinopathy in a Nationwide Screening Program: Comparing Deep Learning and Human Graders

Limwattanayingyong, Jirawut; Nganthavee, Variya; Seresirikachorn, Kasem; Singalavanija, Tassapol; Soonthornworasiri, Ngamphol; Ruamviboonsuk, Varis; Rao, Chetan; Raman, Rajiv; Grzybowski, Andrzej; Schaekermann, Mike; Peng, Lily H.; Webster, Dale R.; Semturs, Christopher; Krause, Jonathan; Sayres, Rory; Hersch, Fred; Tiwari, Richa; Liu, Yun; Ruamviboonsuk, Paisan

doi:https://doi.org/10.1155/2020/8839376

Journal of Diabetes Research

On this page

Abstract Introduction Methods Results Discussion Conclusion Data Availability Additional Points Conflicts of Interest Acknowledgments Supplementary Materials References Copyright Related Articles

Special Issue

Early Biomarkers for New Risk Stratification Modalities and Treatments in Diabetic Eye Disease

View this Special Issue

Research Article | Open Access

Volume 2020 | Article ID 8839376 | https://doi.org/10.1155/2020/8839376

Longitudinal Screening for Diabetic Retinopathy in a Nationwide Screening Program: Comparing Deep Learning and Human Graders

Jirawut Limwattanayingyong,¹Variya Nganthavee,¹Kasem Seresirikachorn,¹Tassapol Singalavanija,²Ngamphol Soonthornworasiri,³Varis Ruamviboonsuk,⁴Chetan Rao,⁵Rajiv Raman,⁵Andrzej Grzybowski,^6,7Mike Schaekermann,⁸Lily H. Peng,⁸and Dale R. Webster⁸ et al.

Academic Editor: Jordi Lluis Reverter

Received28 Aug 2020

Revised06 Nov 2020

Accepted30 Nov 2020

Published16 Dec 2020

Abstract

Objective. To evaluate diabetic retinopathy (DR) screening via deep learning (DL) and trained human graders (HG) in a longitudinal cohort, as case spectrum shifts based on treatment referral and new-onset DR. Methods. We randomly selected patients with diabetes screened twice, two years apart within a nationwide screening program. The reference standard was established via adjudication by retina specialists. Each patient’s color fundus photographs were graded, and a patient was considered as having sight-threatening DR (STDR) if the worse eye had severe nonproliferative DR, proliferative DR, or diabetic macular edema. We compared DR screening via two modalities: DL and HG. For each modality, we simulated treatment referral by excluding patients with detected STDR from the second screening using that modality. Results. There were 5,738 patients (12.3% STDR) in the first screening. DL and HG captured different numbers of STDR cases, and after simulated referral and excluding ungradable cases, 4,148 and 4,263 patients remained in the second screening, respectively. The STDR prevalence at the second screening was 5.1% and 6.8% for DL- and HG-based screening, respectively. Along with the prevalence decrease, the sensitivity for both modalities decreased from the first to the second screening (DL: from 95% to 90%, ; HG: from 74% to 57%, ). At both the first and second screenings, the rate of false negatives for the DL was a fifth that of HG (0.5-0.6% vs. 2.9-3.2%). Conclusion. On 2-year longitudinal follow-up of a DR screening cohort, STDR prevalence decreased for both DL- and HG-based screening. Follow-up screenings in longitudinal DR screening can be more difficult and induce lower sensitivity for both DL and HG, though the false negative rate was substantially lower for DL. Our data may be useful for health-economics analyses of longitudinal screening settings.

1. Introduction

Blindness from diabetes is expected to rise dramatically in this new decade [1]. To reduce diabetes-associated blindness, nationwide systematic screening for diabetic retinopathy (DR) has been implemented [2]. Many countries have studied the development of systematic screening programs [3–6], resulting in several lessons learnt. First, though a large proportion of patients with well-controlled diabetes showed no retinopathy with low risk of visual loss over the years [7], nonattendance in screening programs increased risk of visual loss from sight-threatening DR (STDR) [8]. While annual DR screening is generally recommended [9, 10], studies in some resource-rich countries have found a ceiling uptake of patients [11] which was compromised by an abundance of resource investment [12]. Extending the screening interval from annual to once every 2-3 years was found to be cost-effective in several studies in Europe [13, 14].

Automated retinal disease assessment tools have been studied for DR screening since before the commercial availability of digital retinal photography [15]. Using conventional methods of machine learning, this tool reached a plateau for detecting referable DR with high sensitivity (90%) but less-stellar specificity (45%) [16] in the early 2010s. Deep learning (DL), a subfield of machine learning, has recently demonstrated robust performance with very high sensitivity (95%) and specificity (95%) [17]. Most cross-sectional studies on DL for DR screening have demonstrated this level of performance [17–21]. As a result, DR screening trends have shifted towards the use of DL in assisting or replacing trained human graders (HG) for detecting referrals in DR screening programs [18].

To assess the roles of DL in longitudinal screening for DR, a study on longitudinal performance of DL is important, particularly if the screening was to be repeated in subsequent visits. The continual screening for DR in subsequent years would encounter a shift in the case spectrum since patients correctly detected to have referable DR or STDR would be referred for treatment and exit the screening program. The cohort of patients rescreened in the following years should contain mainly cases that did not display findings of STDR in the previous screenings but might have developed new subtle changes of early STDR in the following screenings. These subtle changes may be more difficult to detect than the more obvious findings associated with well-established STDR.

In this study, we used a real-world, nationwide, longitudinal screening program for DR as a model to assess biennial screening for DR using DL and HG to grade color retinal photographs. The objective was to analyze possible changes in various screening outcomes for detecting STDR determined by DL over two years and compare them with those determined by HG.

2. Methods

This study utilized demographic information, laboratory data, and retinal fundus photographs from patients with diabetes in 13 health regions in the Thai national DR screening program. All data were deidentified. This study was conducted according to the Declaration of Helsinki with approvals from the Institutional Review Board of hospitals where the patients were recruited.

Instituted in 2013 by the Ministry of Public Health, the Thai DR screening program has been implemented in every province and conducted by the Noncommunicable Disease Unit in each Provincial Health Office. All patients with diabetes can access this program without cost thanks to the Universal Coverage insurance scheme provided by the National Health Security Office. Consistent with level 1 evidence suggesting its adequacy, this program employs nonmydriatic, single-field (45-degree, macular-centered) color fundus photography [22] as a screening tool with gradings by trained HG in each region to determine referral to ophthalmologists.

Our study included randomly selected patients in the DR screening program who underwent DR screening twice, two years apart (years 2014 and 2016 or 2015 and 2017). All patients had color retinal photographs of the both eyes taken at each screening. The color retinal photographs were captured by various fundus cameras: Topcon TRC-NW8, Nidek (AFC-210 and AFC-230), and KOWA (Nonmyd α-DIII 8300, Nonmyd 7, VX-10α, Nonmyd α-DIII, Nonmyd WX, VX-20). The diagnosis of DR was based on grading of the retinal photographs. Each photograph was graded for its DR severity level and the presence or absence of diabetic macular edema (DME) according to the International Clinical Classification of DR. The reference standard grades were provided via adjudication by three international retina specialists (from USA, India, and Thailand). As part of the study, we compared gradings from a DL system and HG to this reference standard. The HG were selected from regional DR graders within the national DR screening program. Details of gradings by the retinal specialists, DL, and HG were described previously [19].

Patients were excluded from this study if they had retinal diseases other than DR which precluded diagnosis of DR in either eye, did not have gradings from all three modalities, or if the reference standard, DL, or HG found the images ungradable. Patients were labelled as ungradable if the both eyes were ungradable, or if either eye was ungradable or the fellow eye did not have severe non-proliferative DR (NPDR), proliferative DR (PDR), or DME.

In this study, we studied a simulated setting where each patient was assigned a DR severity level based on the severity of the worse eye. Patients were labelled as STDR if either eye had either DME, severe NPDR or PDR. Those with STDR in the first screening were “referred out” for treatment and excluded from the second screening.

2.1. Statistical Analysis

We estimated the sample size for the first screening of no less than 5,530 patients, considering a margin of error of 10%, type 1 error at 0.05 and type 2 error at 0.2, and an STDR prevalence in Thailand of approximately 6.5% of all patients with diabetes screened for DR [23]. The number of patients included from each of the 13 health regions in the sample was proportional to the number of patients with diabetes in each region [19].

We then computed the prevalence, incidence rate, sensitivity, specificity, positive predictive value, negative predictive value, and accuracy, as well as the number and proportion of true positives, false positives, true negatives, and false negatives. The chi-squared test was used to evaluate statistical significance, with .

3. Results

In this retrospective study, we examined 5,738 patients who were screened for DR on two separate occasions, approximately two years apart and simulated scenarios where either the DL or HG screened for STDR. To mimic a realistic scenario, all cases who were indicated for referral by either DL or HG were verified by retina specialists (our reference standard), and only patients with verified STDR were “referred” out of the screening program (Figure 1, additional details below). Patient demographics, including prevalence of DR of different severities and DME at each screening, are shown in Table 1.

Figure 1

Flow of patients from the first to the second screening. The number of patients in the cohorts of deep learning (DL) and trained human graders (HG) is compared at each point of the screening. The reference standard for these cases was based on an overread by retina specialists (Methods). Screen positive/negative indicates patients whom the DL or HG indicated as positive/negative. In this simulated setting, only patients who were confirmed by retina specialists to have STDR (i.e., true positives) were referred for treatment. The remaining patients were entered into the second screening. Dropout before the second screening included patients with missing data in either DL or HG or determined as ungradable by the reference standard during the second screening.

3.1. Comparison between DL and HG at the First Screening

At the first screening, prevalence of STDR in both the DL and HG cohorts was 12.3% (704 out of 5,738; the cohorts have yet to diverge based on the screening outcome). The DL arm indicated a greater number of cases than HG as positive for STDR (771 vs. 590, corresponding to 13% and 10% of the cohort), resulting in a substantially higher sensitivity (95% vs. 74%). Specificities of both arms was high at 98-99%. Detailed results for positive predictive value, negative predictive value, and accuracy are presented in Table 2, and the full contingency table (also termed “confusion matrix”) is presented in Table 3.

3.2. Cohort Changes at the Second Screening

After the first screening, cases indicated as positive by the DL or HG were reviewed by retina specialists, and cases confirmed to have STDR were “referred out.” This resulted in different numbers of patients and a different case spectrum presenting for the second screening in the DL and HG arms of the study: 4,148 and 4,263 (72% and 74% of the original 5,738 patients), respectively.

During the intervening period between screenings, 195 patients developed new STDR according to the reference standard, with the majority of these cases arising from patients with moderate NPDR during the first screening (Table 4). Looking across the whole cohort, the rates of STDR were substantially higher with increasing severity of DR at the first screening: 2% for no DR, 9% for mild NPDR, and 25% for moderate NPDR. This trend of increasing 2-year STDR incidence with DR severity was also preserved when stratifying patients based on the DL and HG grades at the first screening.

Despite the approximately 200 new STDR cases, because many true positive STDR cases were referred out (669 for DL and 519 for HG), the prevalence of STDR was substantially lower in the second screening than the first screening (DL arm: 5.1% vs. 12%, ; HG arm: 6.8% vs. 12.3%, ).

3.3. Comparison between First and Second Screening for DL and HG

Consistent with the prevalence changes, the rates of positive screens by the DL and HG were both significantly lower in the second screen than in the first (DL: 6.6% vs. 13%, ; HG: 5.3% vs. 10%, ). The sensitivity of the DL and HG was also both lower than at their first screening, at 90% (vs. 95%, ) and 57% (vs. 74%, ), respectively. For both DL and HG, the specificity remained high at 98-99% without significant changes (). The positive predictive value decreased in both arms (DL: from 87% to 69%, ; HG: from 88 to 74%, ). Negative predictive value remained at 99% for DL and 96-97% for HG, and accuracy remained at 97-98% for DL and 96% for HG; neither of these trends were statistically significant at the level. Confidence intervals are presented in Table 2.

When examining the full contingency table (Table 3), the fraction of true positives and true negatives differed significantly between the first and second screenings; the fraction of false positives and false negatives was not statistically significantly different. This trend was consistent in both the DL and HG arms.

3.4. Breakdown of STDR into DR and DME

Next, we examined the prevalence of severe NPDR and PDR vs. DME among the STDR cases and among the false negatives (Supplementary Table 1). Of all STDR cases, over 91% were due to DME in the first screening as well as in both arms of the second screening. When examining the false negatives specifically, rates of DME were around 90% for HG. For DL, there were only 35 and 11 false negatives in the first and second screening, respectively; the rates of DME in the two screenings were 94% and 64%, respectively.

A similar breakdown for the non-STDR cases is presented in Supplementary Table 2, showing that among all non-STDR cases, fewer than 7% were moderate NPDR without DME. For the false positive cases specifically, a much greater proportion were moderate NPDR without DME: 65% and 54% for DL and 18% and 20% for HG.

3.5. Performances of DL and HG at the Eye Level

Finally, we explored the STDR detection performance of DL and HG at the eye level (Supplementary Table 3). Similar trends were observed for both DL and HG: sensitivity and positive predictive value for STDR decreased on the second screening compared to the first screening, while specificity, negative predictive value, and accuracy remained similar. The trends for considering DME and severe NPDR/PDR separately were similar.

4. Discussion

Globally, it is estimated that Asia-Pacific accounts for the majority of patients with poor DR-induced visual outcomes, including both blindness (51%, ) and visual impairment (56%, ) [24]. To improve DR-related visual outcomes, several countries have established DR screening programs. In our study, we conducted a longitudinal analysis of data from the Thai national DR screening program.

Our DR screening program’s endpoint of interest is “STDR” (severe NPDR, PDR or DME [25]). However, we note that other definitions exist (e.g., moderate NPDR or worse [7]), which can hinder comparisons across studies. In our study, the prevalence of STDR during the first screening was 12.3%, which is comparable to the prevalence of STDR estimated from a meta-analysis of 35 studies (10.2%) [26]. As part of a longitudinal analysis, we observed 2-year incident STDR rates of 1.7% and 8.6% among patients without DR and mild DR, respectively, and 3.9% across all non-STDR patients. For comparison, a meta-analysis of 17 studies found that patients without DR and mild DR at baseline had average STDR incidence rates of approximately 1% and 8% per year, respectively [27]. Trends were similar in another study in Asia, where the incidence rate was 1.5% per year in patients without retinopathy at baseline and 13.6% at 4 years [28]. Others have reported a 4-year incidence of 1.45% from no DR at baseline and a rate of 5.02% from all cases (with or without DR) [29].

Given prior work showing that DL can be used to help detect STDR, our study focused on better understanding the longitudinal implications of using DL, as compared to HG. To do so, we followed a single nationwide cohort of more than 5,000 patients across 13 regions. Our data showed that consistent with intuition, referring true positives out of the system decreases the prevalence of STDR in the cohort over time. This decrease happens because the number of true positives was detected with high sensitivity, and their removal presumably leaves behind more difficult examples (false negatives). As the cohort continued to develop STDR, new-onset STDR (i.e., more subtle cases) developed, further enriching the cohort with diagnostically challenging STDR cases. This enrichment for difficult cases may help explain the decreased sensitivity and positive predictive value of both DL and HG in the second screening.

The degree to which this enrichment happens is dependent on the sensitivity of the screening modality. For example, HG had a lower sensitivity in the first screening, which led to a larger number of false negative cases (185 vs. 35) that entered the second screening, and correspondingly a relative 33% higher STDR prevalence at the second screening (HG: 6.8% vs. DL: 5.1%). Thus, we expect that more accurate DL methods or experienced HG will lead to fewer false negatives but a more rapid increase in case difficulty at follow-up visits.

False negative cases are also concerning because they represent cases missed for treatment referral and are thus at risk of vision loss. While such misses are inevitable, this proportion was relatively small when expressed as a fraction of the entire screening population: 0.5-0.6% for DL and about 3% for HG. In addition, most false negative cases were DME, with generally less than 10% being severe NPDR or PDR in both DL and HG cohorts. The increase in proportion of severe NPDR or PDR in false negatives in the second screening might reflect the limitation of both modalities in being able to detect subtle changes of new severe NPDR or PDR compared to DME. Because “screen-negative” cases (i.e., true negatives and false negatives) comprise more than 85% of the cohort, having retina specialists overread all such cases is likely impractical. To help improve the ability to detect more difficult or subtle STDR cases, better DL algorithms or continuing education, monitoring, and audits of HG may be useful. Nonetheless, the particularly low incidence of false negatives by DL (and even then with DME representing the majority) suggests DL-based biennial DR screening can be clinically acceptable.

In contrast to false negatives, decreasing the rate of false positives might improve costs. In our setup, overreads were performed for every “screen-positive” (i.e., true positives and false positives). Reducing the rate of this “over-triggering” can reduce the need for such overreads and help scale DR screening. We anticipate that our detailed data can aid future cost-effectiveness or cost-utility analyses into evaluating DL for DR screening and cost-benefit analysis of overreads vs. unnecessary referrals.

Our study contains some limitations. First, as a retrospective study, our inclusion criteria and desire to study longitudinal outcomes required patients to have retinal photographs in two screenings. Such a cohort may not fully reflect real-world screening settings. Similarly, cohorts do not remain static, but instead, newly diagnosed patients with diabetes enter the screening program on an on-going basis. Though we have not accounted for this, the proportion of new patients with diabetes is expected to be small (estimated at 5% by the National Health Security Office in Thailand). Second, though we expect the trends observed in increasing diagnostic-difficulty and decreasing sensitivity to hold over subsequent screenings (beyond the second), we have not conducted that analysis in this study. Third, the performance of HG may be underestimated because they did not have images from previous screenings available, whereas access to previous images is common practice in real-world settings. Finally, patients with moderate NPDR without DME were included in our biennial screening cohort. Although this group accounted for only 5% of the patients in the first screening, 25% of them progressed to STDR in the second screening. It may be advisable to stratify DR screening patients by their expected risk of developing STDR [27, 30, 31] and initiating biennial screening only for patients in the low-risk group.

The DL used in our study was developed to categorize DR severity and detect DME, and hence, the evaluation of the algorithm’s capability to detect other retinal diseases was not possible. The development of DL models that are capable of detecting multiple retinal conditions is an important area of active research. Similarly, the ungradable images in our simulated cohort were “referred” based on our program’s standard protocol, with the reason being that many contain cataracts. In this regard, future development of an AI that can more accurately detect DR in the eyes with cataracts may be valuable to reduce the overall referral burden.

5. Conclusion

In a longitudinal follow-up of a biennial DR screening cohort, DL performed well, with higher sensitivities and positive predictive values than HG in both the first and second screening. This was despite a case spectrum shift as STDR cases were referred for treatment, and the remaining false negative cases were joined by new STDR cases, both of which were presumably more subtle and difficult to detect. To reduce unnecessary referrals, further studies on health economics could provide guidance on whether expert overreading is required for all “screen-positive” cases.

Data Availability

The deidentified data underlying this study may be available from DR screening programs of Rajavithi Hospital, Lamphun Hospital, Somdejphrajaotaksin Maharaj Hospital, Sawanpracharak Hospital, Nakhon Nayok Hospital, Photharam Hospital, Prapokklao Hospital, Mahasarakham Hospital, Nongbualamphu Hospital, Pakchong-nana Hospital, Mukdahan Hospital, Suratthani Hospital, Sungaikolok Hospital, and Bangkok Metropolitan Administration Public Health Center 7, but restrictions apply. Researchers interested in collaborating should contact the corresponding author.

Additional Points

Code Availability. Machine learning models were developed in prior work and deployed using standard software libraries and scripts in TensorFlow. Custom deployment code was specific to our computing infrastructure and mainly used for data processing.

Conflicts of Interest

J.S., V.N., K.S., T.S., N.S., V.R. C.R., R.R., AG., and P.R. express no conflicts of interest. M.S., L.P., D.R.W., C.S., J.K., R.S., F.H., and Y.L. are Google employees and receive salary and stock as a part of the standard compensation package. R.T. provides services for Google via Optimum Solutions and expresses no conflict of interest.

Acknowledgments

The authors would like to acknowledge the following people for their advice and assistance with this paper: Kornwipa Hemarat, Mongkol Tadarati, Sukhum Silpa-Archa, Oscar Kuruvilla, Jesse Jung, Jeffrey Tan, Peranut Chotcomwongse, Surapong Orprayoon, Chawawat Kangwanwongpaisan, Ramase Sukumalpaiboon, Chainarong Luengchaichawang, Jitumporn Fuangkaew, Pipat Kongsap, Lamyong Chualinpha, Sarawuth Saree, Srirut Kawinpanitan, Korntip Mitvongsa, Siriporn Lawanasakol, Chaiyasit Thepchatri, Lalita Wongpichedchai, Piyada Pholnonluang, Rada Kanjanaprachot, Yothin Jindaluang, Nitaya Suwannaporn, Niteeya Narapisut, Naraporn Sumalgun, Tanawan Sinprasert, Tienchai Methanoppakhun, Ratana Boonyong, Preeyawan Tanomsumpan, Rojsak Phuphiphat, Porntip Nitikarun, Phirun Wongwaithayakonkun, Achareeya Saenmee, Cheunnapa Komkam, Supaporn Numsui, Praween Tantiprapha, Sopon Nilkumhang, Roongruedee Thangwongchai, Supaporn Petcharat, Jansiri Laiprasert, Premrudee Maneechaweng, Sareerah Waesamah, Poowadon Pimpakun, Prapaphan Charncheaw, Ramida Panyarattannakul, Suwannee Saelee, Nutchana Onarun, Peter Wubbels, Florence Thng, Sunny Virmani, Varun Gulshan, Philip Nelson, David Coz, Derek Wu, Elin Pedersen, William Chen, Jessica Yoshimi, Xiang Ji, Quang Duong, and Brian Basham. This study is supported by research funds from Rajavithi Hospital.

Supplementary Materials

The supplementary information includes tables showing the number of patients with STDR or false negatives classified into severe NPDR/PDR and DME; the number of patients with non-STDR or false positive classified into no/mild NPDR and moderate NPDR without DME; the number of the eyes with STDR, including DME and severe NPDR/PDR, and screening outcomes in the first and second screening determined by each modality. (Supplementary Materials)

References

K. Ogurtsova, J. D. da Rocha Fernandes, Y. Huang et al., “IDF diabetes atlas: global estimates for the prevalence of diabetes for 2015 and 2040,” Diabetes Research and Clinical Practice, vol. 128, pp. 40–50, 2017.
View at: Publisher Site | Google Scholar
S. Vujosevic, S. J. Aldington, P. Silva et al., “Screening for diabetic retinopathy: new perspectives and challenges,” The Lancet Diabetes and Endocrinology, vol. 8, no. 4, pp. 337–347, 2020.
View at: Publisher Site | Google Scholar
P. H. Scanlon, “The English national screening programme for diabetic retinopathy 2003–2016,” Acta Diabetologica, vol. 54, no. 6, pp. 515–525, 2017.
View at: Publisher Site | Google Scholar
R. Danielsen, F. Jónasson, and T. Helgason, “Prevalence of retinopathy and proteinuria in type 1 diabetics in Iceland,” Acta Medica Scandinavica, vol. 212, no. 5, pp. 277–280, 1982.
View at: Publisher Site | Google Scholar
Diabetic RetinaScreen, “The National Diabetic Retinal Screening Programme,” Tech. Rep., Ireland, 2020, https://www.diabeticretinascreen.ie/.
View at: Google Scholar
J. Pieczynski, The Voivodal Specialistic Hospital, Olsztyn, Zolnierska, Poland, A. Grzybowski, Chair of Ophthalmology, University of Warmia and Mazury, Olsztyn, Warszawska, Poland, and Department of Ophthalmology, Poznan City Hospital, Poznan, Poland, “Review of diabetic retinopathy screening methods and programmes adopted in different parts of the world,” European Ophthalmic Review, vol. 9, no. 1, p. 49, 2015.
View at: Publisher Site | Google Scholar
I. M. Stratton, S. J. Aldington, D. J. Taylor, A. I. Adler, and P. H. Scanlon, “A simple risk stratification for time to development of sight-threatening diabetic retinopathy,” Diabetes Care, vol. 36, no. 3, pp. 580–585, 2013.
View at: Publisher Site | Google Scholar
A. S. Forster, A. Forbes, H. Dodhia et al., “Non-attendance at diabetic eye screening and risk of sight-threatening diabetic retinopathy: a population-based cohort study,” Diabetologia, vol. 56, no. 10, pp. 2187–2193, 2013.
View at: Publisher Site | Google Scholar
T. Y. Wong, J. Sun, R. Kawasaki et al., “Guidelines on diabetic eye care: the International Council of Ophthalmology Recommendations for screening, follow-up, referral, and treatment based on resource settings,” Ophthalmology, vol. 125, no. 10, pp. 1608–1622, 2018.
View at: Publisher Site | Google Scholar
D. S. Fong, L. P. Aiello, F. L. Ferris, and R. Klein, “Diabetic retinopathy,” Diabetes Care, vol. 27, no. 10, pp. 2540–2553, 2004.
View at: Publisher Site | Google Scholar
G. P. Leese, P. Boyle, Z. Feng, A. Emslie-Smith, and J. D. Ellis, “Screening uptake in a well-established diabetic retinopathy screening program the role of geographical access and deprivation,” Diabetes Care, vol. 31, no. 11, pp. 2131–2135, 2008.
View at: Publisher Site | Google Scholar
J. G. Lawrenson, E. Graham-Rowe, F. Lorencatto et al., “What works to increase attendance for diabetic retinopathy screening? An evidence synthesis and economic analysis,” Health Technology Assessment, vol. 22, no. 29, pp. 1–160, 2018.
View at: Publisher Site | Google Scholar
On behalf of the Scottish Diabetes Research Network (SDRN) Epidemiology Group and the Scottish Diabetic Retinopathy Collaborative, H. C. Looker, S. O. Nyangoma et al., “Predicted impact of extending the screening interval for diabetic retinopathy: the Scottish Diabetic Retinopathy Screening programme,” Diabetologia, vol. 56, no. 8, pp. 1716–1725, 2013.
View at: Publisher Site | Google Scholar
E. Agardh and P. Tababat-Khani, “Adopting 3-year screening intervals for sight-threatening retinal vascular lesions in type 2 diabetic subjects without retinopathy,” Diabetes Care, vol. 34, no. 6, pp. 1318-1319, 2011.
View at: Publisher Site | Google Scholar
G. G. Gardner, D. Keating, T. H. Williamson, and A. T. Elliott, “Automatic detection of diabetic retinopathy using an artificial neural network: a screening tool,” The British Journal of Ophthalmology, vol. 80, no. 11, pp. 940–944, 1996.
View at: Publisher Site | Google Scholar
M. D. Abràmoff, J. M. Reinhardt, S. R. Russell et al., “Automated early detection of diabetic retinopathy,” Ophthalmology, vol. 117, no. 6, pp. 1147–1154, 2010.
View at: Publisher Site | Google Scholar
V. Gulshan, L. Peng, M. Coram et al., “Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs,” JAMA, vol. 316, no. 22, pp. 2402–2410, 2016.
View at: Publisher Site | Google Scholar
D. S. W. Ting, C. Y. L. Cheung, G. Lim et al., “Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes,” JAMA, vol. 318, no. 22, pp. 2211–2223, 2017.
View at: Publisher Site | Google Scholar
P. Ruamviboonsuk, J. Krause, P. Chotcomwongse et al., “Deep learning versus human graders for classifying diabetic retinopathy severity in a nationwide screening program,” npj Digital Medicine, vol. 2, no. 1, 2019.
View at: Publisher Site | Google Scholar
S. D. Solomon, E. Chew, E. J. Duh et al., “Erratum. Diabetic Retinopathy: A Position Statement by the American Diabetes Association. Diabetes Care 2017;40:412–418,” Diabetes Care, vol. 40, no. 9, p. 1285, 2017.
View at: Publisher Site | Google Scholar
A. Grzybowski, P. Brona, G. Lim et al., “Artificial intelligence for diabetic retinopathy screening: a review,” Eye, vol. 434, pp. 451–460, 2019.
View at: Google Scholar
G. A. Williams, I. U. Scott, J. A. Haller, A. M. Maguire, D. Marcus, and H. R. McDonald, “Single-field fundus photography for diabetic retinopathy screening: a report by the American Academy of Ophthalmology,” Ophthalmology, vol. 111, no. 5, pp. 1055–1062, 2004.
View at: Publisher Site | Google Scholar
S. Supapluksakul, P. Ruamviboonsuk, and W. Chaowakul, “The prevalence of diabetic retinopathy in Trang province determined by retinal photography and comprehensive eye examination,” Journal of the Medical Association of Thailand, vol. 91, pp. 716–722, 2008.
View at: Google Scholar
J. Chua, C. X. Y. Lim, T. Y. Wong, and C. Sabanayagam, “Diabetic retinopathy in the Asia-Pacific,” Asia-Pacific Journal of Ophthalmology, vol. 7, pp. 3–16, 2019.
View at: Google Scholar
P. Namperumalsamy, P. K. Nirmalan, and K. Ramasamy, “Developing a screening program to detect sight-threatening diabetic retinopathy in South India,” Diabetes Care, vol. 26, no. 6, pp. 1831–1835, 2003.
View at: Publisher Site | Google Scholar
J. W. Y. Yau, S. L. Rogers, R. Kawasaki et al., “Global prevalence and major risk factors of diabetic retinopathy,” Diabetes Care, vol. 35, no. 3, pp. 556–564, 2012.
View at: Publisher Site | Google Scholar
Y. Groeneveld, D. Tavenier, J. W. Blom, and B. C. P. Polak, “Incidence of sight-threatening diabetic retinopathy in people with type 2 diabetes mellitus and numbers needed to screen: a systematic review,” Diabetic Medicine, vol. 36, no. 10, pp. 1199–1208, 2019.
View at: Publisher Site | Google Scholar
J. S. Yun, T. S. Lim, S. A. Cha et al., “Clinical course and risk factors of diabetic retinopathy in patients with type 2 diabetes mellitus in Korea,” Diabetes and Metabolism Journal, vol. 40, no. 6, pp. 482–493, 2016.
View at: Publisher Site | Google Scholar
R. Raman, S. Ganesan, S. S. Pal, L. Gella, V. Kulothungan, and T. Sharma, “Incidence and progression of diabetic retinopathy in urban India: Sankara Nethralaya-Diabetic Retinopathy Epidemiology and Molecular Genetics Study (SN-DREAMS II), report 1,” Ophthalmic Epidemiology, vol. 24, no. 5, pp. 294–302, 2017.
View at: Publisher Site | Google Scholar
S. Vujosevic, P. Pucci, M. Casciano et al., “A decade-long telemedicine screening program for diabetic retinopathy in the north-east of Italy,” Journal of Diabetes and its Complications, vol. 31, no. 8, pp. 1348–1353, 2017.
View at: Publisher Site | Google Scholar
S. H. Lund, T. Aspelund, P. Kirby et al., “Individualised risk assessment for diabetic retinopathy and optimisation of screening intervals: a scientific approach to reducing healthcare costs,” The British Journal of Ophthalmology, vol. 100, no. 5, pp. 683–687, 2016.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2020 Jirawut Limwattanayingyong et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1665

Downloads

1212

Citations