ISRN Signal Processing

Volume 2011 (2011), Article ID 672353, 9 pages

http://dx.doi.org/10.5402/2011/672353

## Edge-Detection in Noisy Images Using Independent Component Analysis

^{1}Department of ECE, Concordia University, 1455 de Maisonneuve West, Montreal, QC, Canada H3G 1M8^{2}EECS Department, University of Toledo, MS 308, 2801 W. Bancroft Street, Toledo, OH 43606, USA

Received 20 January 2011; Accepted 21 February 2011

Academic Editor: F. Palmieri

Copyright © 2011 Kaustubha Mendhurwar et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

Edges in a digital image provide important information about the objects contained within the image since they constitute boundaries between objects in the image. This paper proposes a new approach based on independent component analysis (ICA) for edge-detection in noisy images. The proposed approach works in two phases—the training phase and the edge-detection phase. The training phase is carried out only once to determine parameters for the ICA. Once calculated, these ICA parameters can be employed for edge-detection in any number of noisy images. The edge-detection phase deals with transitioning in and out of ICA domain and recovering the original image from a noisy image. Both gray scale as well as colored images corrupted with Gaussian noise are studied using the proposed approach, and remarkably improved results, compared to the existing edge-detection techniques, are achieved. Performance evaluation of the proposed approach using both subjective as well as objective methods is presented.

#### 1. Introduction

In typical images, edges characterize the object boundaries with sharp changes in intensity levels. Edges are useful for segmentation, registration, and identification of objects in a given scene. Most of these operations have edge-detection as the preprocessing step. Consequently, the success of these image processing tasks depends strictly on the performance of edge-detection step. Detection of these edges, therefore, not only helps in more accurate representation of an image, but it also significantly simplifies its processing. The edge detection usually involves calculation of derivative of the image intensity function at a given pixel location owing to the fact that image intensity shows sudden changes at edges. Pixels with relatively higher magnitude of derivative of the image intensity function are classified into edge pixels. To this end, Gradient and Laplacian operators/masks such as Prewitt, Roberts, Sobel, Canny [1–3] are usually employed for the purpose of edge-detection. These operators work well for specific cases; however, they fail for others. For instance, the Prewitt edge detector works quite well for digital images corrupted with Poisson noise, whereas its performance decreases sharply for other kinds of noise [4]. Moreover, these operators/masks are chosen independent of the image under consideration. As such, the performance of these operators masks degrades considerably with the increase in noise levels in images [2]. Unfortunately, digital images are inevitably degraded by noise during acquisition and/or transmission. Furthermore, most of the edge-detection operators assume that images contain regions separated by clear boundaries. However, this assumption is not valid for images corrupted with noise. Alternatively, better results can be obtained if the images are denoised employing an appropriate filter (e.g., linear/smoothing filter, nonlinear filter) before applying the operators/masks [2, 4]. However, filters while smoothing out the noise also remove genuine high-frequency edge features, degrade localization and detection of low-contrast edges, and, therefore are incapable of providing satisfactory results [2–4].

This paper proposes a new approach for edge-detection in noisy images. Proposed approach employs the independent component analysis (ICA) concept [5–7] in conjunction with the traditional edge-detection methods to obtain much better results for images corrupted with Gaussian noise. ICA has been previously applied for the purpose of edge-detection [8–11]. In the proposed approach, basic edge-detection method (i.e., Canny) is used along with ICA for the first time to improve the accuracy of edge-detection in noisy gray-scale and colored images. ICA provides a linear representation of non-Gaussian (i.e., super-Gaussian and sub-Gaussian) data making all the components statistically independent [12–16]. The proposed approach functions in two phases. In the first phase, FastICA algorithm which is a neural network learning algorithm based on a Gradient approach is used to find the separation matrix. In second phase, this obtained separation matrix is used for transitioning in and out of ICA domain, thereby facilitating denoising of noisy images. We apply the proposed approach to several gray-scale and colored images corrupted with high levels of Gaussian noise. Edge-detection results obtained from the proposed approach illustrate better performance than those obtained using Canny along with the nonlocal means filter.

A brief introduction of ICA followed by the information regarding basis functions, fast ICA algorithm, and edge-detection are given in Section 2. Section 3 presents the proposed approach and discusses key points involved in obtaining the improved results. Illustration of the proposed approach applied to gray scale as well as colored images is presented in Section 4, and conclusions with possible future work are included in Section 5.

#### 2. Independent Component Analysis (ICA)

Typically, ICA is used for blind source separation [14], which facilitates separation of a set of signals from mixed signals, with very little information about the source signals or the mixing process. In contrast to the correlation-based transformations, like principal component analysis (PCA) [15], ICA decorrelates the signals (2nd-order statistics) and also reduces higher-order statistical dependencies, in attempt to make signals as independent as possible [7]. Since all the natural images contain similar statistical information, a set of noise-free images can be used for the training phase of ICA [12]. The transform obtained from ICA is then employed for denoising a noisy image.

##### 2.1. Definition of ICA

Let be a linear mixture vector with linear mixtures of independent sources, . The relation between mixture vector and the source vector can be expressed as where is called the mixing matrix of size , and each column is called basis function. As such, basis functions project the independent sources to produce linear mixtures. Thus, (1) can be expressed mathematically as The above model (2) is known as the ICA model. Figure 1 illustrates a block diagram for ICA where has two elements – and . Mixtures and obtained from are fed to ICA as inputs. Therefore, only mixture vector is available, from which and are estimated by the ICA.

ICA starts with an assumption that elements of vector are statistically independent. The distributions of elements of , although unknown, are assumed to be non-Gaussian. Furthermore, for the sake of simplicity, mixing matrix is assumed to be a square matrix. The objective of ICA is to find a matrix which, when multiplied with the observed mixture vector , gives the source vector *,* that is, is referred to as the separation matrix, and its inverse results in the mixing matrix . There are numerous ways of finding matrix , but we employed “fixed-point FastICA algorithm” as it is computationally efficient and robust [5–7].

##### 2.2. Implementation of Fixed-Point FastICA

Sample image data obtained from the noise-free images is whitened, in order to make and unitary and then fed to FastICA algorithm. The computation steps for matrix are detailed below.

*Step 1. *Random image samples of size each, from the database that we have created, are fed to FastICA.

*Step 2. *Matrix (size ) is obtained from FastICA that performs orthogonalization during each iteration.

*Step 3. *Each row vector of corresponds to a basis function, and kurtosis is computed, as explained in the next section, for all the basis functions.

*Step 4. *Row vectors of , that is, the basis functions, are then arranged in descending order of computed value.

In this paper, we use . As such, both and have size of . Obtained matrix from FastICA is an orthogonal matrix, and therefore is simply . A detailed explanation of the use of FastICA algorithm and MATLAB code can be obtained from [17].

##### 2.3. Edge-Detection

Signal mixtures tend to have Gaussian probability density functions (PDFs), while source signals have non-Gaussian pdf [18]. Hence, ICA is optimized to obtain non-Gaussian signals at the output. In practice, there are two types of non-Gaussian signals, commonly referred to as Platykurtotic (i.e., super-Gaussian) and Leptokurtotic (i.e., sub-Gaussian) [18]. The super-Gaussian signals have most of the values centered at zero, unlike sub-Gaussian signals. This implies that the former signals have relatively higher peaks compared to the latter. Peaky nature of the signals is formally described by what is called kurtosis of the signal’s PDF, which is the 4th moment of PDF. The kurtosis of row vector of matrix is computed as [18] where is the mean of . Constant “3” guarantees that the Gaussian, super-Gaussian (sparse), and sub-Gaussian signals have, respectively, zero, positive, and negative values of . Essentially, kurtosis provides a measure for the 4th central moment, which takes a given signal’s variance into account. The proposed algorithm (as explained below) arranges the rows of in descending order of their values. This is to select the sparse components of an image as they represent edges of the image.

#### 3. Proposed Approach

As mentioned earlier, the proposed approach works in two phases—the training phase and the edge-detection phase. Training phase is carried out only once to find the matrix , which is then employed for edge-detection in any number of noisy images. Both the phases are described below.

##### 3.1. Training Phase

Training phase of the proposed approach consists of two main steps, that is, database creation and ICA followed by kurtosis computation.

###### 3.1.1. Database Creation

Selective images are taken from a website [19] to serve as a database. As can be seen in Figure 2, natural images are selected, since the ICA filters have more sparsely distributed (kurtotic) outputs on natural scenes [20].

###### 3.1.2. ICA and Kurtosis Computation

A detailed flow chart of the training phase is given in Figure 3(a). Random image samples, each of size , are selected and fed to FastICA as input. FastICA algorithm, as explained earlier, computes the separation matrix of size . This is orthogonalized during each iteration to avail several benefits stated in [20]. Reduced arithmetic operations, and relatively easier matrix inversion, are a few of the benefits. Orthogonalization of is carried out using

Kurtosis (i.e., the degree to which a statistical frequency curve is peaked) is then computed for each row vector of matrix . Positive values of are required for sparsity of the elements. Constant “3” in (4) ensures high sparseness of the elements. The row vectors of are arranged in descending order of their corresponding computed values. This ensures use of sparse components that represent edges. Separation matrix obtained after above-mentioned processing can be used for edge-detection in any noisy image [20].

##### 3.2. Edge-Detection Phase

The flowchart for edge-detection in noisy images is given in Figure 3(b). This phase makes use of the separation matrix , computed in training phase, to transition the given noisy image in and out of the ICA domain. A major advantage of ICA domain is that a set of adaptive basis functions can be obtained from the image alone. The sparse code shrinkage is employed for denoising in the ICA domain.

###### 3.2.1. Transitioning In and Out of the ICA Domain

As described above, processing in ICA domain allows stating of a set of adaptive basis functions from the image alone. Windowing approach is employed where an image sample is processed and replaced. An image sample of size is first projected in the ICA domain by multiplying it with . We denote the projection of the image in ICA domain as . For transitioning out of the ICA domain, is to be multiplied by . However, is orthogonal, that is, ; therefore, is simply multiplied by . For computational purpose, is reshaped to while entering and again while exiting ICA domain.

###### 3.2.2. Denoising

Recovering the original image from a noisy image is complex. This work, therefore, aims at estimating an image, which is significantly better than the noisy image.

Probability densities encountered in image denoising can be classified as (i) mildly sparse and (ii) strongly sparse [7]. In this work, we employ the strongly sparse density, which, for any in , is given by [21, 22]

Here, is the standard deviation, and controls the sparseness. We first estimate and , using which, is evaluated as where Next, the maximum a posteriori (MAP) estimation of the density model (6) is found using the shrinkage function given by where In (10), represents noise level. Using the above equations, the value of is approximated to be 0.707.

###### 3.2.3. Discussion

The edge-detection phase implemented in this work is based on the sparse code shrinkage algorithm [8], where a sample is initially transformed into the ICA domain using . Thereafter, these components are shrunk using the shrinkage function given in (9), and the sample is then taken out of the ICA domain using . Finally, Canny edge-detection algorithm [1] is applied to the image.

#### 4. Illustration

The proposed approach is applied to both gray-scale and colored images, and the results obtained are compared with those obtained using Canny and mean filters. We have also studied the effects of step size as well as noise levels on the performance of our approach.

##### 4.1. Training

For the training phase, a set of images are chosen from an image database [19] to create a local database (see Figure 2). Using the algorithm given in Figure 3(a), orthogonalized matrix is estimated. Training phase can be accomplished with any set of noise-free images. Noise-free images for the image on hand are not required, since matrix remains same for all known/unknown images [20].

##### 4.2. Effects of Noise and Step Size

Before proceeding to application of the proposed approach to gray-scale and colored images, we consider the effects of step size and noise levels on edge-detection. Step size is the distance between two successive image samples (i.e., sample windows). To study the effects of step size, the proposed approach is applied to an image with various step sizes (see Figure 4). As expected, the test image becomes increasingly susceptible to noise with increase in step size. However, increasing the step size improves the computational speed. As such, it is crucial to select a step size, which offers a compromise between the speed and immunity to noise of the proposed approach. For instance, for the image in Figure 4, a maximum step size of 4 can be used (for a step size of 8, the edges become indistinguishable). Processing of image is 16 times faster with step size 4 compared to that of step size 1.

Figure 5 illustrates the results of the proposed approach on an image corrupted with different levels of white Gaussian noise. From the results obtained, it appears that the proposed approach gives satisfactory results for noise levels as high as 6 dB. It would be of interest to test the proposed approach with real data, that is, data for which noise-free images are unavailable. However, such results are difficult to obtain and comment upon. As such, performance of the algorithm for images artificially corrupted with noise is shown. Images not used during training are tested with the proposed approach.

##### 4.3. Application to Gray-Scale Images

The proposed approach is applied to a number of gray-scale images, with step size of 1. For illustration, consider Figure 6. Here, three gray-scale images shown in Figures 6(a), 6(e), and 6(i) are tested with the proposed approach. Figures 6(b), 6(f), and 6(j) show the respective gray-scale images with artificially added 3 dB white Gaussian noise. nonlocal means filter [23] is used for denoising followed by Canny method for edge-detection, and the results obtained using this approach (NLMCanny) are depicted in Figures 6(c), 6(g), and 6(k). Finally, Figures 6(d), 6(h), and 6(l) show the results of the proposed approach. As can be seen from the images, due to high level of Gaussian noise (i.e., 3 dB) in the images, Canny method fails to provide satisfactory results. However, the proposed approach offers considerably better results.

##### 4.4. Application to Colored Images

The proposed approach is extended to colored images. Matrix , computed for gray scale images, is employed for the colored images as well. White Gaussian noise is added separately and edge-detection phase is repeated individually for all three components R, G, and B. The results are given in Figure 7. Three colored images 7(a), 7(e), and 7(i) are tested with the proposed approach. Figures 7(b), 7(f), and 7(j) show the respective images with 3 dB white Gaussian noise added. Figures 7(c), 7(g), and 7(k) illustrate the results of NLMCanny applied to the respective noisy images, and the results of the proposed approach are shown in Figures 7(d), 7(h) and 7(l). Canny fails to provide satisfactory results because of the high noise level. However, our approach offers noticeably improved results.

##### 4.5. Objective Evaluation of the Proposed Approach

Three important criterions must be fulfilled for the better performance of the edge-detection technique. (1) The edge detector should find all the real edges and not find any false edges. (2) The edges should be found in the correct place. (3) There should not be multiple edges found for a single edge [24]. Detailed subjective comparison for gray-scale as well as colored images is depicted in Figures 8(a), 8(c), and 8(e) in Figure 8 depict the NLMCanny results for gray-sale images. The respective proposed approach results are depicted in (b), (d), and (f) in Figure 8. Similarly. Figures 8(g), 8(i), and 8(k) depict the NLMCanny results for colored images, and the respective proposed approach results are depicted in Figures 8(h), 8(j), and 8(l). Apart from these subjective methods, there are objective methods which are used for the evaluation of edge detectors. However, these do not necessarily correlate with the human perception of the image quality. For example, an image with relatively lower error might look much worse than an image with relatively higher error. These objective measures are root-mean-square error (e_{RMS}), peak signal-to-noise ratio (SNR_{Peak}), signal-to-noise ratio (SNR_{RMS}), and Pratt’s figure of merit () (refer to (12), (13), (14), and (15), resp.) [4, 24].
where is the original image (one with added noise), is the final image of size , and is the number of gray levels, that is, 256. For colored images, objective measures are calculated for each channel and average is computed. Pratt’s figure of merit is defined by [4], where and represent the number of ideal and actual edge map points, is a scaling constant, and is the separation distance between actual and ideal edges. is normalized such that represents a perfectly detected edge. The value of is set to 1/9. Table 1 shows the performance comparison between NLMCanny and proposed approach using the objective methods. It can be seen that the proposed approach outperforms NLMCanny since values for SNR_{RMS}, SNR_{Peak}, e_{RMS}, and for the proposed approach are higher.

#### 5. Conclusion

A new approach based on ICA has been proposed for edge-detection in noisy images and has been applied to both gray-scale and colored images. Compared to the NLMCanny method, that is, Canny coupled with a state-of-the-art nonlocal means filter, the proposed approach has yielded considerably improved results. Several step sizes have been examined, and the results for the same have been presented. Moreover, the proposed approach exhibits higher immunity to noise levels. Since all the natural images contain same type of statistics, shrinkage algorithm parameters can be computed from any set of noise-free images for denoising an image. As such, the proposed approach is very robust in the noisy environment. Results for noise levels of 1 dB, 2 dB, 5 dB, 6 dB, and so forth have been depicted. The proposed approach allows step sizes as high as 4 to be employed, thereby speedingup its execution on the computer. Change in step size from 1 to 4 increases the speed 16 times. Step size of 4 has been shown to produce acceptable results. On a 2.47 GHz PC equipped with 4 GB of RAM, NLMCanny took 238.1 seconds to process gray-scale Barbara image. The same image took 448 seconds using the proposed approach with the step size of 1 and 32.4 seconds with the step size of 4. Superiority of the proposed approach has been validated using both subjective as well as objective measures. As a continuation of this work, we plan to test the approach with images in other research areas (e.g., medical images). We also plan to test it on the images corrupted with other types of noises.

#### References

- J. Canny, “A computation approach to edge-detection,”
*IEEE Transactions on Pattern Analysis and Machine Intelligence*, vol. 8, no. 6, pp. 679–698, 1986. View at Google Scholar · View at Scopus - R. C. Gonzalez and R. E. Woods,
*Digital Image Processing*, Prentice-Hall, Upper Saddle River, NJ, USA, 3rd edition, 2008. - M. Pathegama and Ö. Göl, “Edge-based image segmentation,”
*World Academy of Science, Engineering and Technology*, vol. 33, no. 2, pp. 164–167, 2005. View at Google Scholar - W. K. Pratt,
*Digital Image Processing*, John Wiley & Sons, Hoboken, NJ, USA, 2007. - A. Hyvärinen and E. Oja, “A fast fixed-point algorithm for independent component analysis,”
*Neural Computation*, vol. 9, no. 7, pp. 1483–1492, 1997. View at Google Scholar · View at Scopus - A. Hyvarinen, “Fast and robust fixed-point algorithms for independent component analysis,”
*IEEE Transactions on Neural Networks*, vol. 10, no. 3, pp. 626–634, 1999. View at Publisher · View at Google Scholar · View at Scopus - A. Hyvärinen and E. Oja, “Independent component analysis: algorithms and applications,”
*Neural Networks*, vol. 13, no. 4-5, pp. 411–430, 2000. View at Publisher · View at Google Scholar · View at Scopus - X. Han, S. Dai, J. Li, and G. Xia, “Edge-detection algorithm based on ICA-domain shrinkage in noisy images,”
*Science in China F*, vol. 51, no. 9, pp. 1349–1359, 2008. View at Publisher · View at Google Scholar · View at Scopus - Y. W. Chen, X. Y. Zeng, and H. Lu, “Edge-detection and texture segmentation based on independent component analysis,” in
*Proceedings of the 16th International Conference on Pattern Recognition*, pp. 351–354, Quebec, Canada, August 2002. View at Scopus - S. Hornillo-Mellado, R. Martín-Clemente, J. I. Acha, and C. G. Puntonet, “Application of independent component analysis to edge-detection and watermarking,”
*Lecture Notes in Computer Science*, vol. 2687, pp. 273–280, 2003. View at Google Scholar · View at Scopus - X. H. Han, Y. W. Chen, and Z. Nakao, “Robust edge-detection by independent component analysis in noisy images,”
*IEICE Transactions on Information and Systems*, vol. E87-D, no. 9, pp. 2204–2211, 2004. View at Google Scholar · View at Scopus - P. Hoyer,
*Independent component analysis in image denoising*, M.S. thesis, Helsinki University of Technology, 1999. - P. Comon, “Independent component analysis, a new concept?”
*Signal Processing*, vol. 36, no. 3, pp. 287–314, 1994. View at Google Scholar · View at Scopus - C. Jutten and J. Herault, “Blind separation of sources—part I: an adaptive algorithm based on neuromimetic architecture,”
*Signal Processing*, vol. 24, no. 1, pp. 1–10, 1991. View at Google Scholar · View at Scopus - A. J. Bell and T. J. Sejnowski, “An information-maximization approach to blind separation and blind deconvolution,”
*Neural Computation*, vol. 7, no. 6, pp. 1129–1159, 1995. View at Google Scholar · View at Scopus - J. Shlens,
*A Tutorial on Principal Component Analysis*, Center for Neural Science, New York University, New York, NY, USA, 2005. - Helsinki University of Technology, “The FastICA Package for MATLAB,” 2005, http://research.ics.tkk.fi/ica/fastica/.
- J. Stone,
*Independent Component Analysis: A Tutorial*, MIT Press, Cambridge, Mass, USA, 2004. - A. Olmos and F. A. A. Kingdom, “McGill calibrated colour image database,” 2004, http://tabby.vision.mcgill.ca/.
- A. J. Bell and T. J. Sejnowski, “The 'independent components' of natural scenes are edge filters,”
*Vision Research*, vol. 37, no. 23, pp. 3327–3338, 1997. View at Publisher · View at Google Scholar · View at Scopus - A. Hyvärinen, “Sparse code shrinkage: denoising of nongaussian data by maximum likelihood estimation,”
*Neural Computation*, vol. 11, no. 7, pp. 1739–1768, 1999. View at Google Scholar · View at Scopus - A. Hyvärinen, P. O. Hoyer, and E. Oja, “Image denoising by sparse code shrinkage,” in
*Intelligent Signal Processing*, IEEE Press, New York, NY, USA, 2000. View at Google Scholar - A. Buades, B. Coll, and J. M. Morel, “A non local algorithm for image denoising,”
*IEEE Computer Vision & Pattern Recognition*, vol. 2, pp. 60–65, 2005. View at Google Scholar - M. Roushdy, “Comparative study of edge-detection algorithms applying on the gray scale noisy image using morphological filter,”
*GVIP Journal*, vol. 6, no. 4, pp. 17–23, 2006. View at Google Scholar