Research Article | Open Access
K. Somasundaram, P. Alli Rajendran, "Diagnosing and Ranking Retinopathy Disease Level Using Diabetic Fundus Image Recuperation Approach", The Scientific World Journal, vol. 2015, Article ID 534045, 8 pages, 2015. https://doi.org/10.1155/2015/534045
Diagnosing and Ranking Retinopathy Disease Level Using Diabetic Fundus Image Recuperation Approach
Retinal fundus images are widely used in diagnosing different types of eye diseases. The existing methods such as Feature Based Macular Edema Detection (FMED) and Optimally Adjusted Morphological Operator (OAMO) effectively detected the presence of exudation in fundus images and identified the true positive ratio of exudates detection, respectively. These mechanically detected exudates did not include more detailed feature selection technique to the system for detection of diabetic retinopathy. To categorize the exudates, Diabetic Fundus Image Recuperation (DFIR) method based on sliding window approach is developed in this work to select the features of optic cup in digital retinal fundus images. The DFIR feature selection uses collection of sliding windows with varying range to obtain the features based on the histogram value using Group Sparsity Nonoverlapping Function. Using support vector model in the second phase, the DFIR method based on Spiral Basis Function effectively ranks the diabetic retinopathy disease level. The ranking of disease level on each candidate set provides a much promising result for developing practically automated and assisted diabetic retinopathy diagnosis system. Experimental work on digital fundus images using the DFIR method performs research on the factors such as sensitivity, ranking efficiency, and feature selection time.
The identification of exudates in the macular region plays a significant part in diabetic macular edema and helps in the effective detection of the severity of the disease with higher level of sensitivity. As a result, exudates detection plays an important task in the efficient diagnosing. In the design of computer based diagnosis and ranking of diabetic retinopathy, many algorithms and techniques for efficient exudates detection were presented and discussed.
The first part of the introductory section provides a detailed discussion of different ways in which the contribution of image processing for efficient diagnosing of diabetic retinopathy has been made by different researchers. In , a twofold method for early detection of macular edema was presented with the help of mathematical morphology to identify the fovea region. With the application of mathematical morphology, significant minimization of load was achieved by efficiently capturing the global characteristics of images.
One of the most fundamental reasons for the cause of blindness in the modern world is diabetic retinopathy (DR), of which diabetic macular edema can be processed by efficient detection of exudates present in the fundus images. Feature Based Macular Edema Detection (FMED)  introduced a new technique for the effective diagnosing of the DME with the help of novel features, namely, color, decomposition of wavelet, segmentation of lesion, and so on. Even though the technique was proved to be efficient in terms of computation, an efficient feature selection system for transparent disease diagnose was not possible and was not categorized into true positive and true negative ratio.
Macular edema as one of the causes of retina results in the minimization of vision. In , a twofold technique for measuring the severity of DME was presented using the classification process for digital fundus images. A supervised learning model was framed using normal digital fundus images, where the extraction of features was performed to obtain the dynamic form of digital fundus images and efficient means were introduced to differentiate between the normal and DME images. Though sensitivity and specificity were improved, the work follows with an assumption that an image is said to be normal if it has no lesions.
In order to effectively measure the severity of retinal diseases, extraction of vessel is also considered as an important means for digital fundus images. Contrast-Limited Adaptive Histogram Equalization (CLAHE)  presented a novel method that efficiently segmented the retinal blood vessels that differentiated between the Proliferative Diabetic Retinopathy (PDR) and digital fundus images using 2D-Match (Gabor) filters resulting in higher level of accuracy. Though the level of accuracy was improved the threshold value had to be set for all digital fundus images.
A model that used 2D Gabor wavelet for enhancement of vessels  was presented for significant segmentation of vessel. With this, the proposed segmentation model proved to extract the thinnest vessels even for large differentiation in illumination. Though accuracy was obtained, the time with which the accuracy was performed increased with the segmentation of vessel.
Diabetic retinopathy which is considered as the critical eye can significantly minimize the danger of blindness in these patients by 50%. Optimally Adjusted Morphological Operator (OAMO)  investigated the states of the patients and presented Optimally Adjusted Morphological Operators for efficient detection of exudates on diabetic retinopathy patients. One of the main drawbacks of this method was that these mechanically detected exudates did not include detailed feature selection technique for diabetic retinopathy detection.
Effective diagnosis and measures for treating diabetic retinopathy (DR) in young adults have improved a lot in the recent years. In , summary of methods was provided for the early detection and treatment of DR. A framework  was designed for designing benchmark databases and novel measures for the protocol design for treatment of diabetic retinopathy in medical image analysis.
In , an image processing technique using adaptive histogram equalization was presented for efficient detection of the presence of exudates in digital fundus images. Followed by this, clustering algorithms were applied for significant segmentation of the exudates and were provided as inputs to Echo State Neural Network (ESNN) to provide an efficient differentiation between the normal and affected digital fundus images. Though the results proved to classify the lesion in accurate manner, various symptoms of diabetic retinopathy were not detected. Detection of microaneurysms (MAs) was used as a key for early detection of diabetic retinopathy.
In , a threefold mechanism was presented for early MA detection with the help of filter banks resulting in higher accuracy. In , measures were taken to investigate a group of morphological operators used for early detection of microaneurysm on the nondilated pupil in addition to the low-contrast retinal images resulting in precision and accuracy. Nonproliferative Diabetic Retinopathy (NPDR)  identified features in exudates from digital fundus image using segmentation based on the extraction of features and classification was performed on the basis of intensity level of the feature and exudates frequency measures. Results also confirmed the level of sensitivity and specificity reducing the diabetic retinopathy.
Based on the aforementioned techniques and methods, an efficient mechanism of diagnosing and ranking the disease level of diabetic retinopathy using Diabetic Fundus Image Recuperation (DFIR) method based on sliding window approach is presented. The contributions of DFIR method include the following:(1)to efficiently diagnose the diseased fundus images using DFIR method and observe the level of severity using the ranking model based on sliding window approach;(2)to diagnose the diabetic retinopathy disease state during the initial phase by selecting the features of optic cup in digital retinal fundus images;(3)to provide more detailed information of features using group sparsity nonoverlapping function with varying range based on the histogram value;(4)to effectively rank the diabetic retinopathy disease level using support vector model based on Spiral Basis Function;(5)to provide a promising result for developing practically automated and assisted diabetic retinopathy diagnosis system.
The organization of the paper is as follows. Section 2 provides the framework for diagnosing the disease level using image recuperation approach followed by a detailed algorithm and architecture diagram. Section 3 provides the experimental setups, the result analysis followed by the detailed comparisons with other state-of-the-art methods. Section 4 includes the related works and finally, Section 5 includes the concluding remarks.
2. Materials and Methods
2.1. Diabetic Fundus Image Recuperation Approach for Diagnosing Disease Level
In this section, an efficient method for diagnosing disease level for diabetic fundus image using recuperation approach is explained with the help of a neat architecture diagram. The work starts with the designing of sliding window using DFIR method, followed by the identification of disease using optic cup, and finally the designing of a support vector model for disease ranking.
Exudates are one of the most ordinary occurring lesions in diabetic retinopathy fundus images. The shape, intensity, and position of exudates differ a lot amongst diverse diabetic retinopathy patients. The existing diabetic macular edema included information related to blood vessels, length, width, tortuosity, and branching pattern but it did not provide much information related to pathological feature changes and also did not consider the disease severity. The DFIR method on the other hand analyzed the disease severity using the Spiral Basis Function. Initially, sliding window in DFIR method divides the digital fundus images into sliding window blocks of varying dimensional length. The size of digital fundus images varies according to the different set of patients and accordingly the dimensional length also varies.
Figure 1 clearly describes the DFIR method that is divided into blocks based on sliding window processing. The sliding window based feature selection in DFIR method initially divides the optic cup digital fundus images into blocks of specific window size. The overall sliding window blocks evaluate the two sets of histogram results using the DFIR method. The first set of histogram values works from the left boundary of block whereas the other set works from the right boundary of the block in the fundus images. The result obtained from the two sets is combined into one operational set using the Group Sparsity Nonoverlapping Function in DFIR method.
The DFIR method uses the Group Sparsity Function with nonoverlapping pixel for evaluating the histogram intensity range. With the aid of histogram intensity usage, the features are easily spotted on the digital fundus images. Group Sparsity Nonoverlapping Function removes the overlapping of pixel values, and as a result the feature is selected with the minimal time period.
The selected features are used in the second phase of the DFIR method to analyze the disease severity using the ranking level. To measure the ranking level, support vector model is used in DFIR method. The Spiral Basis Function identifies the distance of the disease affected area in the digital fundus image and ranks the patients severity level.
Figure 2 clearly described the distance, that is, severity level on digital fundus images. Spiral Basis Function uses the multivariate Gaussian distance for identifying the depth of affected level on the digital images. The multivariate Gaussian distance clearly describes the level of disease and rank based on the computation value. The overall architecture diagram of Diabetic Fundus Image Recuperation (DFIR) method is depicted in Figure 3.
Figure 3 clearly describes the DFIR method for diagnosing the diseased fundus images and examines the level of severity using the ranking model. Initially, the DIARETDB1 fundus images database is taken for the experimental work. The images use the sliding window approach to divide the fundus images into blocks and then the two sets of histogram values are computed. The computed histogram value uses the Group Sparsity Nonoverlapping Function to remove the overlapping of pixels on computation. The Group Sparsity Nonoverlapping Function chooses the features and offers the detailed feature information. The detailed information uses the support vector model to rank the diabetic retinopathy disease level. Finally, Spiral Basis Function is used to compute the distance, that is, depth of affected area using the multivariate Gaussian distance.
2.2. Sliding Window Approach
Sliding window approach is used in localizing the features from dividing the fundus images into blocks , and of size “.” The rectangular shaped boundary is selected for sliding window operation in DFIR method and rectangular shape division operation is carried out in fundus images. The window of “” size contains the block such that
Equation (1) describes the sliding window division operation on the optic cup “op” into “” blocks. In DFIR method, is the divided boundary on “” dimensional digital fundus mages. The histogram intensity value range of the left and the right boundary is computed as
The “LB” and “RB” are the left and right boundary of the fundus images to compute the histogram intensity value. The intensity range is measured based on rows and column pixel of the digital image. in DFIR method is the maximum group sparsity value used for the histogram value computation. In the left boundary range, the value is incremented as the window moves from the left end to the right end of the image. In the right boundary range, the value is decremented as the window moves from the right end to the left end of the image. The algorithmic step of the sliding window operation is described as follows:
Input. Digital Fundus Images from DIARETDB1 database
Output. Feature Selected with detailed optic cup information
Step 1. Divided into block of size “” such that , , and
Step 2. Compute
Step 3. For = Row point 1 to
Step 4. For = column point 1 to
Step 5. Histogram intensity value of left boundary form is
Step 6. Histogram intensity value of right boundary form is
Step 7. Compute Group Sparsity function to avoid overlapping of pixels
Step 8. Window Fundus image = .
Step 9. End For
Step 10. End For
The above algorithm clearly describes the sliding window through the algorithmic step with for loop structure. The histogram intensity value of left and right boundary is computed in DFIR method. The two sets of values are combined to remove the overlapping condition in Step 8 using the Group Sparsity Nonoverlapping Function. Group Sparsity Nonoverlapping Function is clearly described in Section 2.2.1.
2.2.1. Group Sparsity Nonoverlapping Function
The optic cup histogram value from the right and left boundary is combined together to reduce the feature selection time and Group Sparsity Nonoverlapping Function is computed as
“” denotes the sparsity histogram value from window value. The group Sparsity Nonoverlapping Function (GS) is squared where the left and right boundary values are combined together. The feature selection time taken using DFIR method is formularized as
The combined histogram value on time “” produces the result with features . is a combined value without any overlapping of pixel value.
2.3. Support Vector Model
The DFIR machine learning approach uses the support vector model to rank the disease severity level from the digital fundus images. The feature selected information is used in the support vector model to identify the position of the disease affected area in fundus images. Spiral Basis Function is used for the ranking of diseased fundus images using the DFIR method.
2.3.1. Spiral Basis Function
The Spiral Basis Function in support vector model of DFIR method uses the multivariate Gaussian distance to identify the depth of the disease affected position. The depth level points out the ranking of retinopathy disease level. The Spiral Basis Function with multivariate Gaussian distance is denoted as
The Gaussian distance with and denotes the depth of the affected portion in the fundus image from left to right position. and denote the length value to which the disease gets spread on the four directions denoted by . The distance is computed and threshold value is set to rank the disease level. If the computed (5) value is higher than the threshold value, then the rank gets increased; that is, the disease severity level gets increased. The ranking in DFIR method develops a practical assisted diabetic retinopathy disease ranking system.
3. Experimental Evaluation
DFIR method is developed in MATLAB platform. DFIR method uses the DIARETDB1-Standard Diabetic Retinopathy Database. DIARETDB1 database is a public database used for benchmarking diabetic retinopathy detection. The idea of the DFIR method is to define a database with a test image used as benchmark images for feature selection. The DIARETDB1 database includes 89 color fundus images. Out of 89 color fundus images, 84 contain at least mild nonproliferative signs of the diabetic retinopathy. The remaining 5 color fundus images are considered as normal which do not contain any signs of diabetic retinopathy. The method DFIR is evaluated using 35 color fundus images collected from 40 different patients.
3.1. Experimental Analysis of DFIR Method
By using DIARETDB1 database, the defined testing method results are compared with existing method. DFIR method is compared in the existing Feature Based Macular Edema Detection (FMED)  and Optimally Adjusted Morphological Operator (OAMO) . The experiment is conducted on factors such as sensitivity, specificity rate, ranking efficiency, and feature selection time. The sensitivity of DFIR method measures in (6) the capability of diagnosing those patients with the retinopathy disease (in terms of %), also referred to as a measure for providing a positive test with retinopathy disease:where refers to the number of diabetic retinopathy diseases; refer to the number of diabetic retinopathy diseases that were not detected. The specificity of DFIR method measures the capability to correctly identify those patients without retinopathy disease (in terms of %), also referred to as a measure for providing a negative test with retinopathy disease: where refer to the number of nondiabetic retinopathy diseases which were correctly identified as nondiabetic retinopathy whereas measure the number of nondiabetic retinopathy diseases which are detected wrongly as diabetic retinopathy disease. Ranking efficiency using DFIR method is measured using the support vector model based on Spiral Basis Function evaluated using (3). The ranking efficiency is measured in terms of percentage (%). The time taken to select the feature using DFIR method is evaluated from (4) which is measured in terms of milliseconds (ms).
3.2. Result Analysis of BFIR
The result analysis of BFIR for Diabetic Fundus Image Recuperation (DFIR) method using Standard Diabetic Retinopathy Database is compared with existing Feature Based Macular Edema Detection (FMED)  and Optimally Adjusted Morphological Operator (OAMO) . Table 1 represents the sensitivity rate obtained using MATLAB simulator and comparison is made with two other methods, namely, FMED  and OAMO .
Figure 4 shows that the proposed DFIR method provides higher sensitivity rate when compared to FMED  method and OAMO  method. This is because of the application of sliding windows in DFIR method with varying range that obtains the features based on the histogram value that provides more elaborated information of features using Group Sparsity Nonoverlapping Function improving the sensitivity value by 2–4% when compared to FMED. In addition to that, the use of intensity range based on row and column pixel of the digital image with left and right boundaries increases the rate of Sensitivity by 8–11% when compared to the OAMO  method.
The comparison of specificity is presented in Table 2 with respect to the number of images in the range of 5–40. With increase in the number of images, the specificity also gets increased.
To ascertain the performance of the specificity, comparison is made with two other existing methods, Feature Based Macular Edema Detection (FMED)  and Optimally Adjusted Morphological Operator (OAMO) . In Figure 5, the number of images is varied between 5 and 40. From the figure it is illustrated that the specificity is higher or increased using the proposed DFIR method when compared to the two other existing methods. This is because with the application of support vector model the DFIR method based on Spiral Basis Function effectively ranks the diabetic retinopathy disease level, therefore increasing the specificity by 3–5% when compared to FMED  method. Furthermore, by ranking the disease level on each candidate set, with the help of Spiral Basis Function, the specificity is increased considerably using DFIR method by 7–11% than when compared to OAMO  method.
The ranking efficiency for DFIR method is elaborated in Table 3. We consider the method with sliding windows of size 7 for experimental purpose using MATLAB.
In Figure 6, we depict the ranking efficiency attained using the sliding windows of size 1 to 8 for experimental purposes. From the figure, the value of ranking achieved using the proposed DFIR method is higher when compared to the other two existing methods, Feature Based Macular Edema Detection (FMED)  and Optimally Adjusted Morphological Operator (OAMO) . Besides we can also observe that, by increasing the size of the sliding windows, the ranking efficiency value is increased using all the methods. But comparatively it is higher in DFIR method because, the depth of the disease affected area are efficiently identified using the Spiral Basis function which intern uses the Multivariate Gaussian distance. With the identified depth level points, the ranking of retinopathy disease level is improved by 9–13% compared to FMED . Furthermore, use of Spiral Basis function ranks the patients disease severity level and improves it by 11–16% than compared to the OAMO  method.
Table 4 and Figure 7 illustrate the feature selection time versus the number of sliding windows measured in terms of milliseconds for experimental purpose conducted using MATLAB. From the figure we can note that the feature selection time attains 34.375% improvement for the sliding window of size 25 when compared to FMED  method and 43.75% improvement when compared to OAMO  method which shows that there is a significant gain using the proposed DFIR method. This is because the Group Sparsity Function with nonoverlapping pixel evaluates the histogram intensity range and with the aid of histogram intensity the feature is selected with minimal time period. Further, the two sets of values, that is, the left and right boundary, are combined to remove the overlapping condition by minimizing the feature selection time by 17–50% when compared to FMED  method and 26–52% compared to the OAMO  method.
4. Related Works
The major breakthrough of blindness is caused due to the diabetic retinopathy. Early identification and proper meditation can prevent the disease nearing the individual and avoid blindness to certain extent. One of the dangerous retinal injuries, hazardous by gazing of sun, is called the solar retinopathy which occurs with the observation of solar eclipse observation without any precautious measure. At the same time, one of the safest ways to view the solar eclipse is with the indirect projection of image as suggested by many researchers.
Fourier-domain optical coherence tomography (OCT)  was introduced as the imaging tool to prevent retinal damage by the individuals. Though proved to be an efficient tool, it was opted only for the left eye. A hybrid approach for both left and right eyes called the combined cross point number  was designed from retina fundus images for efficient diagnosing of diabetic retinopathy. Results when applied to retina fundus images proved to be highly precise and accurate with minimized false error rate for treating diabetic retinopathy. In , different measures were taken to identify the concentrations in patients suffering from type 2 diabetes mellitus and diabetic retinopathy and significantly measured the relationship between purine metabolites and disease.
Differential Morphological Profile (DMP)  structured an automatic method for efficient detection of exudates from digital color fundus images using three major phases. Gaussian smoothing and contrast enhancement were performed in the initial stage, followed by which DMP was applied on the features being extracted. Finally, actual exudates were obtained on the basis of the location of optic disc, shape index, and area resulting in accuracy. Microperimetry  has the added advantage of combining the functional parameter with the morphologic status of retina.
With the application of microperimetry, the changes observed in the level of diabetes were efficiently measured compared to that of DME. But accurate results were not obtained. To obtain accurate results, different techniques including normalization of images, efficient compactness classification model, significant morphology operations, process of filtering using Gaussian process, and threshold factor were introduced for early detection of neovascularization. To improve the accuracy of the results obtained, a region-based neovascularization classification method was applied.
Diagnosing and ranking retinopathy disease level has become the key for digital fundus images to achieve minimum error rate and improve the level of sensitivity with relatively lesser amount of feature selection time. In this work, we investigate the performance effects of machine learning methods to categorize the candidate exudates fundus images and propose a method called Diabetic Fundus Image Recuperation (DFIR) based on sliding window approach in digital retinal fundus images that minimizes the effects of sensitivity and greatly improves the ranking efficiency. First, we study the use of sliding window blocks to divide fundus images into blocks and propose using the rectangular shape division operation as the window moving direction for feature selection in DFIR. Second, we develop several Group Sparsity Functions with nonoverlapping pixel for evaluating the histogram intensity range that work with the feature selection module to minimize the feature selection time. We also integrate Spiral Basis Function with the features selected using support vector model to effectively rank the diabetic retinopathy disease using DIARETDB1-Standard Diabetic Retinopathy Database. The experiment conducted using DIARETDB1 shows that the DFIR method achieves up to 35 percent improvement on sensitivity compared to the state-of-the-art methods.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
- M. Shobhana and S. B. Chitrapreyanka, “A novel approach for abnormality detection of macula and fovea region from color fundus images,” International Journal of Emerging Trends in Electrical and Electronics, vol. 3, no. 2, pp. 29–35, 2013.
- L. Giancardo, F. Meriaudeau, T. P. Karnowski et al., “Exudate-based diabetic macular edema detection in fundus images using publicly available datasets,” Medical Image Analysis, vol. 16, no. 1, pp. 216–226, 2012.
- K. S. Deepak and J. Sivaswamy, “Automatic assessment of macular edema from color retinal images,” IEEE Transactions on Medical Imaging, vol. 31, no. 3, pp. 766–776, 2012.
- G. S. Ramlugun, V. K. Nagarajan, and C. Chakraborty, “Small retinal vessels extraction towards proliferative diabetic retinopathy screening,” Expert Systems with Applications, vol. 39, no. 1, pp. 1141–1146, 2011.
- M. U. Akram and S. A. Khan, “Multilayered thresholding-based blood vessel segmentation for screening of diabetic retinopathy,” Engineering with Computers, vol. 29, no. 2, pp. 165–173, 2013.
- A. Sopharak, B. Uyyanonvara, S. Barman, and T. H. Williamson, “Automatic detection of diabetic retinopathy exudates from non-dilated retinal images using mathematical morphology methods,” Computerized Medical Imaging and Graphics, vol. 32, no. 8, pp. 720–727, 2008.
- D. Raczyńska, K. Zorena, B. Urban et al., “Current trends in the monitoring and treatment of diabetic retinopathy in young adults,” Mediators of Inflammation, vol. 2014, Article ID 492926, 13 pages, 2014.
- T. Kauppi, J.-K. Kämäräinen, L. Lensu et al., “Constructing benchmark databases and protocols for medical image analysis: Diabetic retinopathy,” Computational and Mathematical Methods in Medicine, vol. 2013, Article ID 368514, 15 pages, 2013.
- C. Jaya Kumaria and R. Maruthi, “Detection of hard exudates in color fundus images of the human retina,” Procedia Engineering, vol. 30, pp. 297–302, 2012, Proceedings of the International Conference on Communication Technology and System Design.
- M. U. Akram, S. Khalid, and S. A. Khan, “Identification and classification of microaneurysms for early detection of diabetic retinopathy,” Pattern Recognition, vol. 46, no. 1, pp. 107–116, 2013.
- A. Sopharak, B. Uyyanonvara, S. Barman, and T. Williamson, “Automatic microaneurysm detection from non-dilated diabetic retinopathy retinal images,” in Proceedings of the World Congress on Engineering (WCE '11), pp. 1583–1586, July 2011.
- A. Kumar, A. Kumar Gaur, and M. Srivastava, “A segment based technique for detecting exudate from retinal fundus image,” in Proceedings of the 2nd International Conference on Communication, Computing & Security (ICCCS '12), Elsevier, 2012.
- Y.-H. Kung, T.-T. Wu, and S.-J. Sheu, “Subtle solar retinopathy detected by fourier-domain optical coherence tomography,” Journal of the Chinese Medical Association, vol. 73, no. 7, pp. 396–398, 2010.
- A. M. Aibinu, M. I. Iqbal, A. A. Shafie, M. J. E. Salami, and M. Nilsson, “Vascular intersection detection in retina fundus images using a new hybrid approach,” Computers in Biology and Medicine, vol. 40, no. 1, pp. 81–89, 2010.
- J. Xia, Z. Wang, and F. Zhang, “Association between related purine metabolites and diabetic retinopathy in type 2 diabetic patients,” International Journal of Endocrinology, vol. 2014, Article ID 651050, 9 pages, 2014.
- S. Tripathi, K. K. Singh, B. K. Singh, and A. Mehrotra, “Automatic detection of exudates in retinal fundus images using differential morphological profile,” International Journal of Engineering and Technology, vol. 5, no. 3, pp. 2024–2029, 2013.
- E. Midena and S. Vujosevic, “Microperimetry in diabetic retinopathy,” Saudi Journal of Ophthalmology, vol. 25, no. 2, pp. 131–135, 2011.
Copyright © 2015 K. Somasundaram and P. Alli Rajendran. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.