Neuroimaging Biomarkers for Chronic DiseasesView this Special Issue
Research Article | Open Access
Yishuang Xu, Yu Su, Dihao Hua, Peter Heiduschka, Wenliang Zhang, Tianyue Cao, Jingcheng Liu, Zhenyu Ji, Nicole Eter, "Enhanced Visualization of Retinal Microvasculature via Deep Learning on OCTA Image Quality", Disease Markers, vol. 2021, Article ID 1373362, 8 pages, 2021. https://doi.org/10.1155/2021/1373362
Enhanced Visualization of Retinal Microvasculature via Deep Learning on OCTA Image Quality
Purpose. To investigate the impact of denoising on the qualitative and quantitative parameters of optical coherence tomography angiography (OCTA) images of the optic nerve and macular area. Methods. OCTA images of the optic nerve and macular area were obtained using a Canon-HS100 OCT device for 48 participants (48 eyes). Multiple image averaging (MIA) and denoising techniques were used to improve the quality of the OCTA images. The peak signal-to-noise ratio (PSNR) as an image quality parameter and vessel density (VD) as a quantitative parameter were obtained from single-scan, MIA, and denoised OCTA images. The parameters were compared, and the correlation was analyzed between different imaging protocols. Results. In the optic nerve area, there were significant differences in the PSNR and VD in all measured regions between the three groups (). The PSNR of the denoised group was significantly higher than that of the other two groups (). The VD in the denoised group was significantly lower than that in the single-scan group in all measured regions (). In the macular area, there were significant differences in the PSNR and VD in all measured regions among the three groups. The PSNR of the denoised group was significantly higher than that of the other two groups (). The VD in the denoised group was significantly lower than that in the single-scan group in all measured regions. The VD around the optic nerve in the denoised group was correlated with that in the single-scan group (, ), but the VD in the MIA group was not correlated with that in the single-scan group (, ). The VD around the fovea in the denoised and MIA images was correlated with that in the single-scan group (, ; , , respectively). Conclusion. Denoising could provide an easy and quick way to improve image quality parameters, such as PSNR. It shows great potential in improving the sensitivity of OCTA images as retinal disease markers.
Optical coherence tomography angiography (OCTA) is a noninvasive imaging method that offers depth-selective and three-dimensional mapping of the retinal microvasculature without dye injection . OCTA provides microvasculature images with higher contrast and better resolution than with fluorescein angiography; furthermore, it contributes to the quantitative evaluation of retinal microvasculature . Currently, OCTA images and quantitative parameters, such as vessel density (VD), have become important markers for retinal disease, and the detailed information of blood flow it provides has contributed greatly to the early detection of multiple eye diseases [3–5].
The quality of OCTA images is crucial for the accurate interpretation of morphological changes in the retinal vasculature and also affects the quantitative analysis results; therefore, improvement of image quality has become a hot research topic [6, 7]. Several protocols have been used to evaluate the image quality of OCTA, including objective evaluations, such as single strength, contrast-to-noise ratio (CNR), and peak signal-to-noise ratio (PSNR), and subjective retinal expert evaluation [8–11]. Of these, the PSNR is one of the most outstanding and widely used objective parameter of image quality evaluation between different images [11, 12]. Recently, it has been reported that multiple en face image averaging (MIA) techniques were able to increase the PNSR of OCTA images, which indicates an improvement in image quality. This technique allows the extraction of a false positive flow signal from multiple images, which lowers the background noise and enhances the positive signal to anneal discontinuous vessel segments [12, 13]. However, acquiring multiple images requires a longer time, which makes it less practical in clinical applications owing to the higher demand of patients’ tolerance .
Deep learning has become the most common artificial intelligence (AI) techniques, and it shows great potential for automated data analysis and improved image quality . Numerous paired single-scan OCTA and MIA images were applied to deep learning training to develop an algorithm for denoising images. Therefore, an MIA image could be generated from a single-scan image without acquiring multiple OCTA images by using this algorithm . The OCT-HS100 (Canon, Tokyo, Japan), commercialized in recent years, has built-in software to average multiple OCTA images and acquire denoised images using deep learning. It provides a convenient method for the application of the denoising technique in clinical settings. Although previous studies have reported that denoised images show lower background noise and higher image quality than that of single-scan images of the macular area [11, 14], the influence of denoising using commercially available devices on the qualitative and quantitative parameters of the images of both macular and optic areas has not been investigated. The VD is considered an important marker for the early detection of multiple eye diseases; for example, the VD in the macular area can help detect retinal damage in patients with diabetes and hypertension at an early stage, and the VD in the optic area can help in the early diagnosis of glaucoma [3–5]. Thus, the VD in both macular and optic areas acquired from denoised images needs to be verified as credible data before its application in the clinical setting.
Therefore, in this study, we aimed to evaluate the effect of denoising on the qualitative and quantitative parameters of OCTA images in both macular and optic areas by using OCT-HS100, to elucidate if denoising could provide a promising improvement in image quality and reliable quantitative data, and further facilitate the clinical practice with OCTA images as a retinal disease marker.
Forty-eight eyes of 48 healthy subjects were prospectively included in this study. Eyes with dense lens opacities, corneal opacities, refractive surgery, or a history of intraocular inflammation were excluded. The optic nerve area was scanned in 27 eyes of 27 patients, and the macular area was scanned in 21 eyes of 21 patients. Informed consent was obtained from each enrolled study patient, and the procedures adhered to the tenets of the Declaration of Helsinki.
2.2. Optical Coherence Tomography Angiography Imaging
The OCT-HS100 (Ophthalmic Software Platform RX V4.5) built-in software offers a specialized acquisition mode to repeatedly capture consecutive OCTA cube scans at the same position in a short time and can compound multiple OCTA images into a single high-quality image. In addition, this built-in software offers a “denoised OCTA image” assisted by deep learning. In this study, a scan was chosen for the macular area exam, and a scan was chosen for an optic nerve area exam. OCTA imaging was performed by an experienced examiner, and each patient underwent several scans until five OCTA scans that met the criteria were obtained. Images of poor quality (, motion artifact score (MAS) of 3 or 4, or segmentation errors) were excluded from the quantitative analysis. An MIA image was obtained by choosing five images and applying the MIA function. A denoised image was obtained by choosing one image and applying the denoised function. The PSNR was also recorded and is expressed as the maximum signal divided by the standard deviation . Images were exported and opened in ImageJ (histogram function). The maximum pixel value and standard deviation of the image luminance were calculated . With the exception of PSNR, all measured values were automatically determined using the manufacturer’s software.
2.3. Statistical Methods
Data management was performed using Microsoft Excel 2010 software. IBM SPSS Statistics 22 for Windows (IBM Corporation, Somers, NY, USA) was used for all statistical analyses. Continuous parametric variables are presented as (SD). Repeated-measure one-way analysis of variance (ANOVA) was used to compare the differences between the PSNR and the VD. Tukey’s correction was used for multiple comparisons. Pearson’s correlation coefficient was used to analyze the correlation between groups. Statistical significance was set at .
3.1. Demographic Information
Forty-eight eyes of 48 subjects were prospectively included in this study. The optic nerve area was scanned in 27 patients, of which 13 were women (48.1%). The mean age of the subjects was . The macular area was scanned in 21 patients; of these, 10 were women (47.6%), and the mean age was (Table 1).
Notes: age is presented as . Abbreviation: F: female; M: male; SD: standard deviation.
3.2. OCTA Parameters of the Optic Nerve Area
In the optic nerve area, there were significant differences in the PSNR and VD in all measured regions between the three groups (); details are shown in Table 2.
Notes: repeated-measure ANOVA was used to compare the differences in the PSNR and VD. Abbreviations: OCTA: optical coherence tomography angiography; PSNR: peak signal-to-noise ratio; MIA: multiple image averaging; VD: vessel density; ANOVA: analysis of variance.
Upon further comparison between the two groups, the PSNR of the denoised group was significantly higher than that of the other two groups (). As for the VD, the denoised group had a significantly lower value than the single-scan group in all measured regions (), and only a statistically significant decrease in the optic region was observed when comparing the denoised and MIA groups () (Table 3 and Figure 1).
Notes: Tukey correction was applied for multiple comparisons between two groups. Abbreviations: PSNR: peak signal-to-noise ratio; MIA: multiple image averaging.
A comparison of the optic area image between the three groups showed that the denoised image exhibited lower background noise and smoother vessels compared to the MIA and single-scan images, especially on the nasal side. A radial peripheral capillary was observed in the enlargement of the inferior temporal side of the optic nerve in a single-scan image, and it became vague in the MIA image and disappeared in the denoised image (Figure 2).
3.3. OCTA Parameters of the Macular Area
In the macular area, there were significant differences in the PSNR and VD in all measured regions between the three groups; the details are shown in Table 4.
Notes: repeated-measure ANOVA was used to compare the differences in the PSNR and VD. Abbreviations: OCTA: optical coherence tomography angiography; ANOVA: analysis of variance; PSNR: peak signal-to-noise ratio; MIA: multiple image averaging; VD: vessel density.
Upon further comparison between the two groups, the PSNR of the denoised group was significantly higher than that of the other two groups (). The VD of the denoised group was significantly decreased compared to that of the single-scan group in all measured regions. Interestingly, the VD in the denoised group was significantly lower in the foveal region compared to that of the MIA group (), but was higher in the superior and inferior regions (, ) (Table 5 and Figure 3).
Notes: Tukey correction was applied for multiple comparisons between two groups. Abbreviations: PSNR: peak signal-to-noise ratio; MIA: multiple image averaging.
Comparing the macular area image between the three groups showed that the denoised images exhibited lower background noise and smoother vessels compared to the MIA and single-scan images. In the enlargement of the avascular zone, a vessel dropped out in an MIA image and was enhanced in the denoised image, and enlargement of the temporal side showed a black shadow covering the blood flow signal in a single-scan image, which recovered in the MIA image, and persisted in the denoised image (Figure 4).
3.4. Correlation Analysis
The VD around the optic nerve in the denoised group was correlated with that in the single-scan group (, ), but the VD of the MIA group was not correlated with that of the single-scan group (, ). The VD around the foveal region in the denoised and MIA images were both correlated with that in the single-scan group (, ; , , respectively) (Figure 5).
OCTA is a noninvasive and fast tool to exhibit retinal microvasculature and has been widely applied in patients with optic and retinal diseases . Morphological changes in retinal vascular and quantitative parameters, including vessel density in the OCTA images, have become an outstanding disease marker in the diagnosis and treatment of optic and retinal diseases. Recent studies have focused on the improvement of OCTA image quality and accordingly increase its sensitivity as a disease marker using different techniques. Among them, AI techniques have shown great prospects [6, 7, 11]. However, research on the application of AI to improve the OCTA image quality was limited in each research group, and the manufacturer’s built-in AI denoising function has not been evaluated in the macular and optic nerve areas for practical clinical use.
Image quality has been evaluated objectively and subjectively in past researches. Subjective assessment is easily affected by varies reasons, such as the level of retinal expertise . Objective assessment includes several protocols, such as single strength, CNR, and PSNR, of which the PSNR is one of the most outstanding and widely used objective parameter of image quality evaluation in different images [8, 10–12]. The PSNR is defined as the maximum signal divided by the standard deviation. The PSNR is generally used for a project between the maximum signal and the background noise. Higher PNSR value represents smaller distortion, indicating a higher image quality. Usually after image compression, the output image will be different from the original image to some extent. While evaluating the image quality after processing, the PSNR is usually used to ascertain whether a certain processing procedure is satisfactory. Therefore, in our study, the PNSR was an ideal parameter to compare image quality between the original image and differently processed image . In this study, we compared the impact of two different methods: denoising and MIA on OCTA image quality and VD in both macular and optic nerve areas. Our results showed that the PSNR was significantly higher in the denoised group than in the MIA and single-scan groups, indicating that denoising can improve OCTA image quality even better than MIA by reducing the background noise within a shorter time in both the optic nerve and the macular area. Previous studies also demonstrated better image quality in denoised images than in MIA images , which may be because the images used for image averaging have relatively low image quality. Thus, a well-trained denoised algorithm, which outputs high-contrast images, improves the image quality to a greater extent than image averaging. We observed the enhancement of low signal flow in the denoised group, which was eliminated by image averaging (Figures 4(d)–4(f)). This also indicates a more accurate vessel exhibition in the denoised group than in the MIA group, which could improve the diagnosis of early retinal vasculature diseases, such as diabetic retinopathy.
In our study, a significantly lower VD was observed after denoising compared to single-scan OCTA images in both the macular and optic nerve areas. A previous study reported that the VD decreased significantly after MIA, which is in accordance with our results . The denoising algorithm was developed by applying paired single-scan and MIA OCTA images in deep learning training . Eventually, a denoising algorithm was built to generate a similar averaged OCTA image from a single image. This may explain the decrease in VD in both MIA and denoised OCTA images. Using the denoising technique and MIA to process OCTA images, different mechanisms can affect VD. On the one hand, a reduction of noise (and an increase of PSNR) can decrease VD. On the other hand, an increase in continuous vessels can increase VD, as well as an enlargement of vessel caliber . The previous study also reported the lower background noise and better continuity of vessels in the denoised image compare to the MIA image . Therefore, the proportion of vessel and none vessel would determine which factor became the stronger one. In our study, VD in the foveal of the MIA image was significantly higher than that of the denoised image. This may due to the low proportion of vessels in the foveal and result in the reduction of noise which shows a stronger effect on VD in the denoised image. Vice versa, VD in the superior and inferior foveal were a relatively high value compared with those in the nasal and temporal sides in our study, and this could result in the enhancement of vessel continuity which became the stronger factor to impact VD in these two areas which explains why the VD in MIA images was lower than that in the denoised images in areas. In addition, the VD in the denoised images was more correlated with that in the single-scan images than that in the MIA images. The MIA records the exact flow signal from several images, whereas the flow signal of the denoised images was only extracted from the original single OCTA scan. This could be the reason that the VD in the denoised images had a higher correlation to a single OCTA scan than that in the MIA images. In general, VD in the denoised image was significantly changed but still related to VD in the single-scan image. With the reduction of noise and increase in the continuous vessel process, VD in the denoised image should represent the real status of the microvasculature in the retina than that in the single-scan image.
Although the denoising function provides a quicker way to greater image quality acquisition, MIA has some advantages that we observed in this study. Artifacts caused by vitreous turbidity and eye rolling were more likely to be eliminated by image averaging than denoising. Heisler et al. also reported the advantages of MIA in reducing motion artifacts . Such artifacts that change with the movement of the eye were unlikely to be exhibited in the exact position in different scans. However, in the denoised images, these artifacts presented as flakes of low signal, which were difficult to distinguish from the nonperfusion area by morphologic features (Figures 4(g)– 4(i), red arrows). This difference between the denoised and MIA images may be because the denoising algorithm only extracts information from a single scan, which cannot recover the flow information covered by vitreous turbidity. In addition, the application of denoising and image averaging seems less effective in the optic nerve area than in the macular area (Figure 2). The radial peripheral capillary area was difficult to exhibit clearly in the three modes mentioned above, which could be because of the small caliber vessels with a discontinuous image exhibiting a spot-like high signal similar to background noise. This could be eliminated by image averaging and denoising, leading to a loss of flow information. This discovery indicates that there are still some limitations in applying the denoising function of the Canon-HS100 OCTA device in optic nerve diseases, since the potential risk of flow signal is missing. Further deep learning training may help address these problems.
The denoising technique provides a convenient way to enhance the OCTA image quality by processing with AI, which could be a useful tool for patients in whom it is difficult to acquire enough qualified OCTA images because of poor visual acuity. For example, patients with age-related macular degeneration and myopia with poor visual acuity and fixation are likely to benefit from this technique. Theoretically, a more precise VD value, which might improve the detection of sensitivity for the changes retinal vasculature disease such as diabetic retinopathy, can be obtained by this denoising process.
Our study has some limitations. First, we only conducted research in a small sample size, which may influence the accuracy of the statistical results. Second, we only used one OCTA device; it would be better to compare multiple devices to acquire more subject data to verify the reliability of our OCTA parameter results.
In general, denoising provides an easy and quick way to improve image quality, including PSNR, and shows great potential in improving the sensitivity of OCTA images as retinal disease markers. Although this new technique has some limitations at the current stage, additional training should be conducted for further clinical use.
Data are available from corresponding authors upon request.
Conflicts of Interest
The authors declare that there is no conflict of interest.
Yishuang Xu and Yu Su contributed equally to this work.
This study was supported by the National Natural Science Foundation of China (No. 81500744) and China Scholarship Council Grant (Yishuang Xu 201706270193; Dihao Hua 201806270215).
- R. F. Spaide, J. G. Fujimoto, N. K. Waheed, S. R. Sadda, and G. Staurenghi, “Optical coherence tomography angiography,” Progress in Retinal and Eye Research, vol. 64, pp. 1–55, 2018.
- A. Y. Kim, Z. Chu, A. Shahidzadeh, R. K. Wang, C. A. Puliafito, and A. H. Kashani, “Quantifying microvascular density and morphology in diabetic retinopathy using spectral-domain optical coherence tomography angiography,” Investigative Ophthalmology & Visual Science, vol. 57, no. 9, pp. OCT362–OCT370, 2016.
- L. Frizziero, G. Midena, E. Longhin et al., “Early retinal changes by OCT angiography and multifocal electroretinography in diabetes,” Journal of Clinical Medicine, vol. 9, no. 11, article 3514, 2020.
- D. Hua, Y. Xu, X. Zhang et al., “Retinal microvascular changes in hypertensive patients with different levels of blood pressure control and without hypertensive retinopathy,” Current Eye Research, vol. 46, no. 1, pp. 107–114, 2021.
- H. Hou, S. Moghimi, L. M. Zangwill et al., “Macula vessel density and thickness in early primary open-angle glaucoma,” American Journal of Ophthalmology, vol. 199, pp. 120–132, 2019.
- J. L. Lauermann, M. Treder, P. Heiduschka, C. R. Clemens, N. Eter, and F. Alten, “Impact of eye-tracking technology on OCT-angiography imaging quality in age-related macular degeneration,” Graefe's Archive for Clinical and Experimental Ophthalmology, vol. 255, no. 8, pp. 1535–1542, 2017.
- M. Zhang, T. S. Hwang, J. P. Campbell et al., “Projection-resolved optical coherence tomographic angiography,” Biomedical Optics Express, vol. 7, no. 3, pp. 816–828, 2016.
- C. Czakó, L. István, M. Ecsedy et al., “The effect of image quality on the reliability of OCT angiography measurements in patients with diabetes,” International Journal of Retina and Vitreous, vol. 5, no. 1, p. 46, 2019.
- A. K. Woetzel, J. L. Lauermann, K. Kreitz et al., “Optical coherence tomography angiography image quality assessment at varying retinal expertise levels,” Journal of Current Ophthalmology, vol. 31, no. 2, pp. 161–167, 2019.
- A. Uji, S. Balasubramanian, J. Lei et al., “Multiple enface image averaging for enhanced optical coherence tomography angiography imaging,” Acta Ophthalmologica, vol. 96, no. 7, pp. e820–e827, 2018.
- S. Kadomoto, A. Uji, Y. Muraoka, T. Akagi, and A. Tsujikawa, “Enhanced visualization of retinal microvasculature in optical coherence tomography angiography imaging via deep learning,” Journal of Clinical Medicine, vol. 9, no. 5, p. 1322, 2020.
- S. Murakawa, I. Maruko, T. Kawano, T. Hasegawa, and T. Iida, “Choroidal neovascularization imaging using multiple en face optical coherence tomography angiography image averaging,” Graefe's Archive for Clinical and Experimental Ophthalmology, vol. 257, no. 6, pp. 1119–1125, 2019.
- J. L. Lauermann, Y. Xu, P. Heiduschka et al., “Impact of integrated multiple image averaging on OCT angiography image quality and quantitative parameters,” Graefe's Archive for Clinical and Experimental Ophthalmology, vol. 257, no. 12, pp. 2623–2629, 2019.
- K. Kawai, A. Uji, T. Murakami et al., “Image evaluation of artificial intelligence supported optical coherence tomography angiography imaging using Oct-Hs100 device in diabetic retinopathy,” Retina, 2020.
- S. T. Welstead, Fractal and wavelet image compression techniques, Spie Press, 1999.
- A. Uji, S. Balasubramanian, J. Lei, E. Baghdasaryan, M. Al-Sheikh, and S. R. Sadda, “Impact of multiple en face image averaging on quantitative assessment from optical coherence tomography angiography images,” Ophthalmology, vol. 124, no. 7, pp. 944–952, 2017.
- M. Heisler, S. Lee, Z. Mammo et al., “Strip-based registration of serially acquired optical coherence tomography angiography,” Journal of Biomedical Optics, vol. 22, no. 3, p. 036007, 2017.
Copyright © 2021 Yishuang Xu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.