Fabric Defect Detection Using Local Homogeneity Analysis and Neural Network

Rebhi, Ali; Benmhammed, Issam; Abid, Sabeur; Fnaiech, Farhat

doi:https://doi.org/10.1155/2015/376163

Journal of Photonics

On this page

Abstract Introduction Conclusions References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 376163 | https://doi.org/10.1155/2015/376163

Fabric Defect Detection Using Local Homogeneity Analysis and Neural Network

Ali Rebhi,¹Issam Benmhammed,¹Sabeur Abid,¹and Farhat Fnaiech¹

Academic Editor: Ivan Moreno

Received12 Aug 2014

Accepted08 Dec 2014

Published17 Mar 2015

Abstract

In the textile manufacturing industry, fabric defect detection becomes a necessary and essential step in quality control. The investment in this field is more than economical when reduction in labor cost and associated benefits are considered. Moreover, the development of a wholly automated inspection system requires efficient and robust algorithms. To overcome this problem, in this paper, we present a new fabric defect detection scheme which uses the local homogeneity and neural network. Its first step consists in computing a new homogeneity image denoted as -image. The second step is devoted to the application of the discrete cosine transform (DCT) to the -image and the extraction of different representative energy features of each DCT block. These energy features are used by the back-propagation neural network to judge the existence of fabric defect. Simulations on different fabric images and different defect aspects show that the proposed method achieves an average accuracy of 97.35%.

1. Introduction

Defect detection is one of the main steps in quality control of manufacturing processes. In the fabric field, defect detection becomes an important task due to the widely used material in daily life. Fabric defects are responsible for nearly 85% of the defects found in the garment industry [1]. Also, it has been observed [2] that price of textile fabric is reduced by 45% to 65% due to defects. It is imperative, therefore, to detect, identify, and prevent these defects from reoccurring. A fabric defect is generally represented by a wired variation with respect to the overall surface aspect. Visual human inspection leads to usual errors due to several reasons, namely, the fatigue and fine defects. Hence, the automation of these operations helps to improve quality and reduce labor costs. As confirmed by [3, 4], there are more than 70 kinds of fabric defects defined by the textile industry. A human fabric inspection achieves a success rate about 60 to 75% [3]. Figure 1 shows the same machine automated inspection.

Automated visual inspection methods are increasingly taken into account in recent years. There are various visual inspection systems such as defect detection of tiles [5], woods [6, 7], ceramic [8], sheet steel [9], and textiles [10–19].

Fabric defect detection is one of the most scheming problems in visual inspection. Currently, there are a lot of new studies and researches in fabric inspection [10–19]. This paper emphasizes this problem and investigates some new technique to solve this problem.

1.1. Related Work

Texture analysis has a great interest in image processing, and there are many applications in its analyzing and processing, one of which is defect detection. Therefore, numerous methods are typically developed to solve the defect detection task in fabric images. The authors in [4] propose a review of the art field in this state. Chan and Pang [10] provided a comprehensive overview of fabric defect detection by Fourier analysis. Wavelet transform is another method which was applied in [11–14].

On the other hand, Latif-Amet et al. [15] proposed an approach that uses wavelet theory and cooccurrence matrix for the detection of defects encountered in textile images and classifies each subwindow as defective or nondefective by a Mahalanobis distance. Gabor filter has been widely used in the field of fabric defect detection. All the detection approaches using Gabor filter can be classified into two categories. One is to use a filter bank, such as [16, 17], and the other one is to use optimal filters, such as [18–21]. In general, filtering with a filter bank can generate excessive data for processing though a set of filters may aid the segmentation. Correspondingly, the quality of localization and recognition is affected dramatically and the time consumption is large as well.

Moreover, model based approaches have been successfully used in the fabric defect detection. Some of textural analysis methods are based on the Markov random field model [22]. Campbell et al. [23] used the model based clustering method to detect linear pattern production defects.

Recently, neural network has attracted a lot of attention in defect detection applications. Huang and Chen [24] have used back-propagation neural network, with fuzzy logic, to achieve the classification of eight different kinds of fabric defects. In [25] an approach for the segmentation of local textile defects using feed-forward neural network is presented. Recently, Jing et al. in [26] present a machine vision system which uses basic patch statistics from raw image data combined with a two-layer neural network to detect surface defects on arbitrary textured and weakly labeled image data.

1.2. Present Work

In textured images, discontinuities represent generally an important feature such as boundaries. It is known that the local homogeneity analysis is the method to detect these discontinuities. Moreover, due to their nonparametric nature and their ability to describe complex decision regions, neural network is one of the best classifiers used for defect detection. In this paper, a new approach for fabric defect detection based on the local homogeneity analysis and neural network is proposed.

This paper is organized as follows. In Section 2 the local homogeneity computation (-image) for different window sizes is presented. The discrete cosine transform of the -image and feature extraction are then described in Section 3. Section 4 provides a system description of the proposed method. It is followed by the experimental results in Section 5. Details of training and test procedures which include our proposed method for fabric defect detection and detection performance are described in Sections 5.1 and 5.2, respectively. Finally, Section 6 draws conclusion and summarizes the paper.

2. Local Homogeneity Definition

It is known that discontinuities in textured images represent generally an important feature such as boundaries. The main problem is how to detect these discontinuities. A method to resolve this problem is the homogeneity (). The calculation of was proposed first by Jing et al. in [26]. Let be the coordinates of a pixel and the corresponding intensity level. Let be a squared window, that is, a mask of () width centered on the pixel. In the window one can define different vectors, such as , where is the neighbor of the center defined aswhere is the coordinate of the pixel , is the coordinate of the centre pixel (), and is an integer number which defines the mask size.

Note that this definition allows computing the homogeneity of a pixel for different mask sizes , , and so forth.

Figure 2 shows an example of the different pixels used to compute homogeneity in a window of size pixels.

Based on a new vector is constructed as follows:For a mask of width we have vectors .

Let be the sum of the whole vectors defined in the window , soThe value measurement (the homogeneity value) is defined as the norm of , so thatTo limit the huge variation of the local homogeneity the normalized homogeneity is used:where and are the minimum and the maximum value of homogeneity, respectively. The resulting -image is constructed by the different values of computed for each pixel value .

3. Discrete Cosine Transform (DCT) and Features Extraction from the DCT Block

3.1. Brief Description of DCT Transform

The DCT of an -image of size is given by (6). This expression must be computed for values of and also for .

The variables and are frequency variables, and are spatial variables, and and are the size of the DCT block:where

3.2. Feature Extraction

In order to characterize the frequency domain within texture image, this paper proposes to use the features energy distribution in the 2D-DCT domain from the -image, which is presented as follows [27]:(i)The horizontal energy value of the DCT block:(ii)The vertical energy value of a DCT block:(iii)The diagonal energy value of a DCT block:(iv)The average energy value of a DCT block:(v)The standard deviation energy value of a DCT block:Then the features vector of each pixel is expressed as

In the next section, the principal component analysis (PCA) is introduced to eliminate correlations between features and reduce the dimensionality of the original feature vectors.

3.3. Features Reduction

Feature reduction means transforming the original features into a lower dimensional space [28, 29]. Most of the feature extraction techniques have been based on linear techniques such as principal component analysis (PCA). PCA is a quantitatively rigorous method for achieving data dimensionality reduction. The method generates a new set of variables, called principal components (PCs), which maximize the variance of the projected vectors. Each PC is a linear combination of the original variables. All the PCs are orthogonal to each other, so there is no redundant information. The PCs as a whole form an orthogonal basis for the space of the data. Thus, the first PC consists of the highest variability, the second PC consists of the next highest variability, and so on for other directions. The first few components are kept and others with less variability are discarded. As shown in Figure 3, in the proposed work, the first 4 PCs are used to feed to the feed-forward neural networks (FFN) classifier.

4. Fabric Defect Detection Method

4.1. Fabric Defect Classification Based on FFN

This method consists in scanning the acquired image with a squared window and computing the local homogeneity for each pixel and constructing the -image. In our work we have used a window of size pixels. Then, we divided the -image into overlapping squared blocks. The five aforementioned types of energy are computed through the DCT applied for each block which produces these energies. Every pixel of the acquired image is characterized by a feature vector (five types of energy). Then, the statistical or -score normalization technique is applied to all the features vectors that form the input to the neural network. The number of the inputs of the neural network is not equal to the same number of feature extractions. They are obtained using a principal component analyzing (PCA) routine. This routine is applied in order to limit the number of inputs of neural network. In this case the number of inputs equals four (i.e., the number of chosen principal components). The number of the training vectors equals the number of pixels in the considered field of view of the investigated fabric surface. The network has a single output.

The concept diagram of the fabric defect detection scheme is presented in Figure 4.

The procedure of the proposed method can be summarized as follows.

Step 1. Scanning of the input image with a squared window and computing the local homogeneity for each pixel.

Step 2. Normalization of the local homogeneity.

Step 3. Division of the -image into overlapping squared blocks and application of a DCT transform.

Step 4. Features extraction from the DCT block.

Step 5. Features reduction using the PCA method.

Step 6. Normalization of all features using Zero mean and unity variance technique.

Step 7. Classification process for fabric defect by FFN based on -image (since only 2 conditions (block contains defect regions or not) need to be identified in this paper).

4.2. Learning Defect Classifier

After a feature calculation step, now we use the training data to train a neural network using back-propagation. An example of a FFN structure is shown in Figure 4 FFN classification. The size of the input layer is equal to the feature dimension; here (after applying a PCA technique the number of features is reduced to 4). The second layer, called the hidden layer, has L1 nodes. In the output layer, all nodes from the hidden layer are mapped to one final node showing the classification result. All weights in the neural network are initialized by random numbers. Training a network means optimizing network detection performance. This is realized by minimizing the performance function. The performance measurement function in this case is the mean squared error (MSE). The final classification result is a value between and predicts whether an unknown block contains defect regions or not.

5. Experimental Results: Application of the Proposed Method in Fabric Defect

This section presents the experimental results for fabric defect detection. The dataset used is established and the results are analyzed in Section 5.1. The performance of the proposed algorithm for a number of sample images is presented and analyzed in Section 5.2. Discussion and comparison with some previous works are given in Section 5.3.

5.1. Dataset

The dataset used in this work is provided by PARTNER textile industry in Tunisia [30]. The dataset consists of 89 images, of which 13 have no defects and 76 have various fabric defects. The total databases were divided into two sets: one for training (containing 60% of the samples) and the other for test (containing 40% of the samples). Table 1 summarizes some fabric defects types used in this study, their definition, and their reasons.

All simulations were implemented on a personal computer (Intel core 2Duo CPU T5870 @2 GHz and 3 GB of RAM). The programs were tested first in MATLAB language and after that they were rewritten in C++ language for the purpose to be implemented in a real time process. We note that once the neural network is trained in the learning phase (offline step) it will be inserted in the defect detection process and then the global needed time is considerably reduced.

Training of the network was carried out with the error back-propagation algorithm by using a set of fabric images data containing 46 images with defect and 8 images without defect covering every possible pattern of defect blocks and nondefect blocks.

Initially, all the weight values of the neural network were randomly set to small values between 0 and 0.1 and the learning coefficients were set to 0.6. Several experiments were conducted for selecting the best FFN. The factors that played a significant role in the performance of the system were the number of hidden layer neurons, the learning coefficients of the hidden layer neurons and the output layer, the activation function, and the learning rule. The parameters of the best architecture for FFN are summarized in Table 2.

5.2. Performance Detection

After the FFN is trained with 54 images, its performance has been tested with the remaining ones (35 images). The performance of this algorithm is validated by calculating the following performance measure for the train set and test set separately. The classification accuracy (CA) is as follows: ratio between the total number of correctly classified test samples and the total number of test samples. Generally, detection accuracy, also known as detection success rate, is defined as

Table 3 outlines definitions of true positive (TP), false positive (FP), true negative (TN), and false negative (FN) in defect detection.

The classification results of all classifiers in the training and testing processes are presented in Table 4. In the training process, all the FFN classifiers achieve an average accuracy of 98.30% and 99.05% in the whole dataset and the reduced dataset, respectively. This indicates that the classifiers are well trained and can be applied for fabric defect detection. However, in the testing process these classifiers are validated against the test data; the average accuracy is about 97.35% and 96.25% for the reduced and original features, respectively.

From the test results shown in Table 4 it can be seen that the FNN classifiers recognize the blocks defects effectively. The recognition results of FNN are ideal because of its high accuracy and a good generalization capability, when the average classification efficiency close to 97.35% is reasonably good.

For image the time needed for defect detection by scanning all the image is about 0.8 seconds. Taking into account the production rate (knitting speed), the algorithm can be used in a real time application.

5.3. Discussion and Comparison with Some Previous Works

In this experiment, the -image is obtained after scanning the input image using a window of size pixels. The features extractions are produced by dividing the -image into overlapping blocks of size pixels after applying the DCT transform. The final classification result is obtained from a feed-forward network trained with the back-propagation (BP). Figure 5 shows detection examples of the fabric dataset. The kinds of fabric defects vary in size, shape, and orientation.

(a)

(b)

(c)

In Figure 5, column (a) shows the original images. Columns (b) and (c), respectively, correspond to the -image and defect detection results. Image in the first line represents the “hole” defect. The proposed algorithm was able to correctly detect the defect. Image in the second line shows another type of defect (slub defect) and the corresponding defects detection results which were accurately detected. Other types of sample defects are shown in the rest of the figure.

It is interesting to note that despite the varying size and orientation of the defects, the algorithm managed to identify accurately most of the defects.

Based on these results, it can be concluded that the DCT features extraction method effectively improves classification performance for the given fabric defect classification problem.

Table 5 provides a summary of the studies on automated fabric defect detection. Bissi et al. (2013) [29] proposed an approach for automated texture defect detection in uniform and structured fabrics based on a complex symmetric Gabor filter bank and PCA. The performance of their algorithm has been extensively evaluated by using images of the TILDA Textile Texture Database and reported an accuracy of 98.8%. Tabassian et al. (2011) [31] used a wavelet based feature extraction method beside binary thresholding technique and morphological operations and classified them by MLP neural networks. The Dempster-Shafer theory of evidence was then employed for combining different evidence to decrease the value of uncertainty. It achieved a detection accuracy of 89.48%. Zhang et al. (2010) [32] used the neighborhood of each pixel to extract the features and to reduce them using PCA and classified them using radial basis function (RBF) network improved by Gaussian mixture model (GMM) with an accuracy of 83.4%. Qiuping et al. (2014) [33] used an approach for defect detection applied to twill, plain, gingham, and striped fabric using Gabor filter and sparse coding with an accuracy of 93%.

In conclusion, the evaluation of our method versus those in previous researches, given in Table 5, shows that our experiment has good potential for improving fabric defect detection. The features derived from the DCT transform of -image with the FFN classifier produce a good classification performance: the average CA result is 97.35%. This combination of the feature and classifier is promising for a high accuracy of fabric defect detection.

6. Conclusions and Future Work

In this paper a novel method is proposed to solve the problem of fabric defect detection, which is based on the local homogeneity analysis and the feed-forward neural networks. A DCT transform based feature extraction method beside the PCA was used. The performance of this algorithm has been extensively evaluated by using images of the PARTNER Textile Texture Database. The comparison with other existing algorithms reported in literature highlights the effectiveness of the proposed approach. The average accuracy of block condition was 97.35%; the results show that the proposed algorithm is a strong technique for fabric defect detection. The algorithm presents some drawbacks, namely, the arbitrarily choice of the windows size of the mask used to compute the -image. This in its turn affects intensively the defect detection of the algorithm. Indeed if the mask size is chosen relatively large (such as ) this will homogenize even some different regions and then this will cause some false alarms. If the mask size is chosen relatively small (such as or ) this will induce a poor homogenization and, therefore, similar areas (especially in stochastic textures) will be considered as different areas and may be seen as defects by the algorithm.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

The authors would like to thank Mr. Mohamed Ali Derbel Director of the PARTENER Textile for helpful discussion and for providing the fabric image database.

References

P. Sengottuvelan, A. Wahi, and A. Shanmugam, “Automatic fault analysis of textile fabric using imaging systems,” Research Journal of Applied Sciences, vol. 3, pp. 26–31, 2008.
View at: Google Scholar
T. Vikrant and S. Gaurav, “Automatic fabric fault detection using morphological operations on bit plane,” International Journal of Engineering Research & Technology, vol. 2, pp. 856–861, 2013.
View at: Google Scholar
Hong Kong Productivity Council, Textile Handbook 2000, The Hong Kong Cotton Spinners Association, 2000.
H. Y. T. Ngan, G. K. H. Pang, and N. H. C. Yung, “Automated fabric defect detection—a review,” Image and Vision Computing, vol. 29, no. 7, pp. 442–458, 2011.
View at: Publisher Site | Google Scholar
M. Ghazvini, S. A. Monadjemi, N. Movahhedinia, and K. Jamshidi, “Defect detection of tiles using 2D-wavelet transform and statistical features,” World Academy of Science, Engineering and Technology, vol. 37, pp. 901–904, 2009.
View at: Google Scholar
R. W. Conners, C. W. McMillin, and K. Lin, “Identifying and locating surface defects in wood: part of an automated lumber processing system,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 5, no. 6, pp. 573–583, 1983.
View at: Google Scholar
D. Zhu, R. Conners, and P. Araman, “CT image sequence processing for wood defect recognition,” in Proceedings of the IEEE 23rd Southeastern Symposium on System Theory, pp. 75–79, Columbia, SC, USA, 1991.
View at: Publisher Site | Google Scholar
C. Boukouvalas, “Color grading of randomly textured ceramic tiles using color histograms,” IEEE Transactions on Industrial Electronics, vol. 46, no. 1, pp. 219–226, 1999.
View at: Publisher Site | Google Scholar
K. Wiltschi, A. Pinz, and T. Lindeberg, “Automatic assessment scheme for steel quality inspection,” Machine Vision and Applications, vol. 12, no. 3, pp. 113–128, 2000.
View at: Publisher Site | Google Scholar
C.-H. Chan and G. K. H. Pang, “Fabric defect detection by Fourier analysis,” IEEE Transactions on Industry Applications, vol. 36, no. 5, pp. 1267–1276, 2000.
View at: Publisher Site | Google Scholar
X. Yang, G. Pang, and N. Yung, “Robust fabric defect detection and classification using multiple adaptive wavelets,” IEE Proceedings—Vision, Image and Signal Processing, vol. 152, pp. 715–723, 2005.
View at: Google Scholar
D. M. Tsai and B. Hsiao, “Automatic surface inspection using wavelet reconstruction,” Pattern Recognition, vol. 34, no. 6, pp. 1285–1305, 2001.
View at: Publisher Site | Google Scholar
Y. X. Zhi, G. K. H. Pang, and N. H. C. Yung, “Fabric defect detection using adaptive wavelet,” in Proceedings of the IEEE Interntional Conference on Acoustics, Speech, and Signal Processing (ICASSP '01), pp. 3697–3700, May 2001.
View at: Google Scholar
Y. Han and P. Shi, “An adaptive level-selecting wavelet transform for texture defect detection,” Image and Vision Computing, vol. 25, no. 8, pp. 1239–1248, 2007.
View at: Publisher Site | Google Scholar
A. Latif-Amet, A. Ertüzün, and A. Erçil, “An efficient method for texture defect detection: sub-band domain co-occurrence matrices,” Image and Vision Computing, vol. 18, no. 6, pp. 543–553, 2000.
View at: Publisher Site | Google Scholar
A. Kumar and G. K. H. Pang, “Fabric defect segmentation using multichannel blob detectors,” Optical Engineering, vol. 39, no. 12, pp. 3176–3190, 2000.
View at: Publisher Site | Google Scholar
A. Kumar and G. K. H. Pang, “Defect detection in textured materials using Gabor filters,” IEEE Transactions on Industry Applications, vol. 38, no. 2, pp. 425–440, 2002.
View at: Publisher Site | Google Scholar
A. Hamid, A. Alireza, and S. Esmaeil, “Defect detection in textiles using morphological analysis of optimal Gabor wavelet,” in Proceedings of the International Conference on Computer and Automation Engineering (ICCAE '09), pp. 26–30, 2009.
View at: Google Scholar
A. Bodnarova, M. Bennamoun, and S. Latham, “Optimal gabor filters for textile flaw detection,” Pattern Recognition, vol. 35, no. 12, pp. 2973–2991, 2002.
View at: Publisher Site | Google Scholar
R. Han and L. M. Zhang, “Fabric defect detection method based on Gabor filter mask,” in Proceedings of the WRI Global Congress on Intelligent Systems (GCIS '09), pp. 184–188, Xiamen, China, May 2009.
View at: Publisher Site | Google Scholar
M. Li and R. C. Staunton, “Optimum Gabor filter design and local binary patterns for texture segmentation,” Pattern Recognition Letters, vol. 29, no. 5, pp. 664–672, 2008.
View at: Publisher Site | Google Scholar
S. Ozdemir and A. Ercil, “Markov random fields and Karhumen-Loeve transforms for defect inspection of textile products,” in Proceedings of the IEEE Conference on Emerging Technologies and Factory Automation, vol. 2, pp. 697–703, 1996.
View at: Google Scholar
J. G. Campbell, C. Fraley, F. Murtagh, and A. E. Raftery, “Linear flaw detection in woven textiles using model-based clustering,” Pattern Recognition Letters, vol. 18, no. 14, pp. 1539–1548, 1997.
View at: Publisher Site | Google Scholar
C.-C. Huang and I.-C. Chen, “Neural-fuzzy classification for fabric defects,” Textile Research Journal, vol. 71, no. 3, pp. 220–224, 2001.
View at: Publisher Site | Google Scholar
A. Kumar, “Neural network based detection of local textile defects,” Pattern Recognition, vol. 36, no. 7, pp. 1645–1659, 2003.
View at: Publisher Site | Google Scholar
F. Jing, M. Li, H.-J. Zhang, and B. Zhang, “Unsupervised image segmentation using local homogeneity analysis,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '03), pp. II456–II459, IEEE, May 2003.
View at: Google Scholar
Y.-S. Chiu and H.-D. Lin, “An innovative blemish detection system for curved LED lenses,” Expert Systems with Applications, vol. 40, no. 2, pp. 471–479, 2013.
View at: Publisher Site | Google Scholar
S. Ding, C. Li, and Z. Liu, “Fabric defect detection scheme based on Gabor filter and PCA,” Advanced Materials Research, vol. 482–484, pp. 159–163, 2012.
View at: Publisher Site | Google Scholar
L. Bissi, G. Baruffa, P. Placidi, E. Ricci, A. Scorzoni, and P. Valigi, “Automated defect detection in uniform and structured fabrics using Gabor filters and PCA,” Journal of Visual Communication and Image Representation, vol. 24, no. 7, pp. 838–845, 2013.
View at: Publisher Site | Google Scholar
2013, http://www.partnertextile.com/.
M. Tabassian, R. Ghaderi, and R. Ebrahimpour, “Knitted fabric defect classification for uncertain labels based on Dempster-Shafer theory of evidence,” Expert Systems with Applications, vol. 38, no. 5, pp. 5259–5267, 2011.
View at: Publisher Site | Google Scholar
Y. Zhang, Z. Lu, and J. Li, “Fabric defect classification using radial basis function network,” Pattern Recognition Letters, vol. 31, no. 13, pp. 2033–2042, 2010.
View at: Publisher Site | Google Scholar
Z. Qiuping, W. Minyuan, L. Jie, and D. Dexiang, “Fabric defect detection via small scale over-complete basis set,” Textile Research Journal, vol. 84, no. 15, pp. 1634–1649, 2014.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2015 Ali Rebhi et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

4533

Downloads

582

Citations