Image Processing-Based Detection of Pipe Corrosion Using Texture Analysis and Metaheuristic-Optimized Machine Learning Approach

Hoang, Nhat-Duc; Tran, Van-Duc

doi:https://doi.org/10.1155/2019/8097213

Computational Intelligence and Neuroscience

On this page

Abstract Introduction Methods Experimental Results and Discussion Conclusion Data Availability Conflicts of Interest Supplementary Materials References Copyright Related Articles

Special Issue

Advances in Recent Nature-Inspired Algorithms for Neural Engineering

View this Special Issue

Research Article | Open Access

Volume 2019 | Article ID 8097213 | https://doi.org/10.1155/2019/8097213

Image Processing-Based Detection of Pipe Corrosion Using Texture Analysis and Metaheuristic-Optimized Machine Learning Approach

Nhat-Duc Hoang¹and Van-Duc Tran²

Academic Editor: Juan A. Gómez-Pulido

Received27 Mar 2019

Revised21 May 2019

Accepted17 Jun 2019

Published11 Jul 2019

Abstract

To maintain the serviceability of buildings, the owners need to be informed about the current condition of the water supply and waste disposal systems. Therefore, timely and accurate detection of corrosion on pipe surface is a crucial task. The conventional manual surveying process performed by human inspectors is notoriously time consuming and labor intensive. Hence, this study proposes an image processing-based method for automating the task of pipe corrosion detection. Image texture including statistical measurement of image colors, gray-level co-occurrence matrix, and gray-level run length is employed to extract features of pipe surface. Support vector machine optimized by differential flower pollination is then used to construct a decision boundary that can recognize corroded and intact pipe surfaces. A dataset consisting of 2000 image samples has been collected and utilized to train and test the proposed hybrid model. Experimental results supported by the Wilcoxon signed-rank test confirm that the proposed method is highly suitable for the task of interest with an accuracy rate of 92.81%. Thus, the model proposed in this study can be a promising tool to assist building maintenance agents during the phase of pipe system survey.

1. Introduction

In high-rise building maintenance, an important objective is concerned with the integrity of the water supply system and prevention of water contamination. Cast iron is widely used in water supply and waste disposal systems due to the advantage of high strength. Since stainless steel pipes often fall out of favor in domestic pipework because of their high expenses [1], corrosion is a widely observed type of structural damage.

Corrosion (see Figure 1) can be defined as a chemical process caused by chemical and electrochemical reactions. This phenomenon is typically observed in environmental conditions featuring a high level of moisture. There are different kinds of corrosion such as general corrosion which occurs as uniformly distributed nonprotective flakes of rust and pitting which is a localized point of corrosive attack [2]. Corrosion brings about the destruction of metal pipework surface and consequently leads to reduction in pipe service life and increase in building maintenance cost [3]. In certain case, this defect may strongly affect the health of building occupants due to deterioration of water quality. Thus, corrosion should be identified timely by means of periodic surveys to ensure the integrity of pipe systems and establish cost-effective maintenance strategies.

(a)

(b)

(c)

(d)

In Vietnam as well as in many other countries, manual methods performed by human inspectors are commonly employed for condition assessment of water supply/waste disposal systems. As clearly pointed out by Liu et al. [4] and Atha and Jahanshahi [5], these manual approaches are labor intensive and time consuming. Corroded regions can be neglected in positions of pipe system that are difficult to reach and observe visually. Moreover, the processes of data processing and reporting are also very tedious for human technicians. Therefore, there is a practical need to come up with a more productive and accurate method of pipe condition survey.

Although there is a wide range of existing pipe inspection approaches (such as magnetic flux leakage, ultrasonic testing, and external corrosion direct assessment), all of these methods have limitations including high equipment cost, restricted range of inspection, and incapability of detecting small pitting regions [3]. Considering the large amount of pipe systems needed to be surveyed and the limited access to sophisticated equipment in developing countries, there is an urgent need for a productive and low-cost solution for periodic surveys of pipe system condition. Recently, digital image processing has gained a great attention within the field of structural heath monitoring [6, 7].

Particularly, image processing techniques can be effectively employed to investigate the outer surface for detecting defects on pipes or other metal structures including corrosion and cracks [8]. Itzhak et al. [9] relied on statistic measurement of image pixels to quantify pitting corrosion. Choi and Kim [10] identified corrosion based on the morphology of the corroded surface; features of image color, texture, and shape are employed for corrosion recognition. A model for classifying corroded and noncorroded surfaces using texture descriptors obtained from gray level co-occurrence matrix and image color has been proposed in Medeiros et al. [11].

A method based on watershed segmentation has been employed in [12] for rating of corrosion defects; the percentage area of corroded region was used for determining the grade of defects. Idris and Jafar [13] used image filter-based image enhancement and neural network for corrosion inspection. Son et al. [14] proposed a model based on decision tree algorithm for identifying rusted surface area of steel bridge. A model based on image color analysis and K-means clustering for bridge rust identification has been constructed and verified by Liao and Lee [15].

Petricca et al. [16] compared standard computer vision techniques and deep neural network for rust and nonrust detection. Deep neural networks have also been employed for corrosion detection by Liu et al. [4] and Atha and Jahanshahi [5]. Safari and Shoorehdeli [17] applied artificial neural network, Gabor filter, and entropy filter for pipe defect detection. Cheriet et al. [18] incorporated expert knowledge and field data to construct a knowledge-based system for assessing corrosive damage on metallic pipe conduits. Gibbons et al. [19] relied on a Gaussian mixture model for probabilistic classification of corroded and noncorroded areas. Bondada et al. [3] detected and quantitatively assessed corrosion damages on pipelines by computing the mean of saturation value of image pixels; by image analysis, the corroded areas on pipelines can be segmented.

From the above literature, it can be seen that image processing and machine learning have been a feasible alternative for replacing the tedious process of manual survey. Based on a recent review work of Ahuja and Shukla [20], there is an increasing trend of applying computer vision techniques for corrosion detection. Moreover, due to the importance of the research theme, exploring other image processing and machine learning methods used for pipe corrosion detection can be highly meaningful in both academic and practical aspects.

As reported in the literature, although image texture analysis has been applied, few previous studies have employed a combination of image texture descriptors for pipe corrosion recognition. Hence, this study is an attempt to fill this gap in the literature by proposing a method used for analyzing texture of water pipe surface that integrates statistical measurement of color channels, gray-level co-occurrence matrix, and gray-level run length matrix. Based on the features extracted by the above texture descriptors, the support vector machine (SVM) [21] is employed to categorize image samples into two classes: noncorrosion (negative) and corrosion (positive). SVM is utilized in this study due to the fact that it has been confirmed to be a robust tool for pattern classification in various studies [22–24]. In addition, to optimize the training process of SVM-based corrosion detection model, differential flower pollination (DFP) metaheuristic is employed. A dataset consisting of 2000 image samples has been collected to train and verify the proposed method.

The rest of the study is organized as follows. Section 2 reviews the research material and methods used to construct the water pipe corrosion detection approach. Section 3 reports experimental results and discussions. Section 4 provides several concluding remarks of this study.

2. Material and Methods

2.1. Image Texture Analysis

Identifying corroded areas based on two-dimensional image samples is a challenging task due to the complex and deceptive features of pipe surfaces containing various irregular objects such as dirt and paints. Therefore, using information provided by one pixel is definitely not sufficient for corrosion detection. It is because a pixel having similar color values can belong to both categories of noncorrosion and corrosion. Hence, texture information extracted from a certain region of pipe surface can be used for recognizing the defect of interest. This section of the study describes the employed texture descriptors used for computing the features of water pipe surface.

2.1.1. Statistical Properties of Color Channels

Herein, the statistical properties of three color channels (red, green, and blue) of an image sample can be employed to represent image texture. Thus, an image is described in a RGB color space. It is noted that besides RGB, there are other color spaces such as HSV which can also be useful in the task of corrosion detection. However, in this study, we rely on the original RGB color model obtained from the employed digital camera. Let I be a variable representing the color levels of an image sample. The first-order histogram P(I) is calculated as follows [25]:where c denotes a color channel, N_I,c is the number of pixels with intensity value I of the channel c, and H and W represent the height and width of an image sample, respectively.

Thus, the mean (), standard deviation (), skewness (), kurtosis (), entropy (), and range () of color value are calculated as follows:where NL = 256 denotes the number of discrete color values.

2.1.2. Gray-Level Co-Occurrence Matrix (GLCM)

The GLCM [26] is also a commonly used texture descriptor. To employ this technique, a color image must first be converted to a gray scale one. The GLCM discriminates different image textures based on the repeated occurrence of some gray-level patterns existing in the texture [27]. Let be a vector in the polar coordinates of an image sample. For each , the joint probability of the pairs of gray levels that occur at the two points separated by the relationship is computed [28]. This joint probability is compactly displayed in a GLCM within which represents the probability of the two gray levels of i and j occurring according to . The original is often normalized via the following equation:where denotes the normalized GLCM and S_P is the number of pixels.

Based on the suggestion of Haralick et al. [29], four GLCMs with r = 1 and = 0°, 45°, 90°, and 135° can be established. Accordingly, angular second moment (AM), contrast (CO), correlation (CR), and entropy (ET) for each matrix can be computed to serve as texture descriptors as follows [28, 29]:where N_g is the number of gray-level values and , and are the means and standard deviations of the marginal distribution associated with a normalized GLCM [29].

2.1.3. Gray-Level Run Lengths (GLRL)

GLRL is a texture description method proposed by Galloway [30]. This method is highly effective in discriminating textures featuring different fineness and has been successfully applied in various fields of study [31, 32]. It is because GLRL is constructed based on the fact that relatively long gray-level runs are observed more frequently in a coarse texture and a fine texture typically has more short runs [33]. A run-length matrix p( i · j ) in a certain direction is defined as the number of times that a run length j of gray level i is observed [30].

Using this matrix, the short run emphasis (SRE), long run emphasis (LRE), gray-level nonuniformity (GLN), run length nonuniformity (RLN), and run percentage (RP) [30, 33] can be computed. Additionally, Chu et al. [34] put forward the indices of low gray-level run emphasis (LGRE) and high gray-level run emphasis (HGRE). Dasarathy and Holder [35] proposed to compute the short run low gray-level emphasis (SRLGE), short run high gray-level emphasis (SRHGE), long run low gray-level emphasis (LRLGE), and long run high gray-level emphasis (LRHGE). The above indices are summarized in Table 1. It is noted that one run length matrix is computed for each of direction in the set of and each matrix results in 11 GLRL-based features. Therefore, the total number of features obtained from GLRL matrices is 11 × 4 = 44.

2.2. Computational Intelligence Methods

2.2.1. Support Vector Machine (SVM)

SVM, described in [21], is a robust pattern recognition method established on the theory of statistical learning. Given the task at hand is to classify a set of input feature x_k into two categories of y_k = −1 (noncorrosion) and y_k = +1 (corrosion), a SVM model constructs a decision surface that separates the input space into two distinctive regions characterizing the two different two categories. The SVM algorithm aims at identifying a decision boundary so that the gap between classes is as large as possible [36]. In addition, SVM employs the kernel trick to convert a nonlinear classification task into a linear one. A SVM model first maps the input data from the original space to a high-dimensional feature space within which the data can be separated by a hyperplane (see Figure 2).

The SVM training process can be formulated as the following constrained optimization problem [36]:where Rⁿ is a normal vector to the classification hyperplane and b R is the model bias; e_k ≥ 0 is called a slack variable; c denotes a penalty constant; and is a nonlinear mapping from the input space to the high-dimensional feature space.

During the construction of a SVM model, it is not required to obtain the explicit form of . Instead of that, only the dot product of in the input space is required and expressed via a kernel function shown as follows:

The radial basis function (RBF) kernel function [37] is often employed for data classification; its functional form is given below:where is a free parameter.

Accordingly, a SVM model used for data classification is given compactly as follows:where denotes the solution of the dual form of the aforementioned constrained optimization. SV is the number of support vectors which is the number of .

2.2.2. Differential Flower Pollination (DFP)

As shown in the previous section, the model training and prediction phases of a SVM model depend on a proper selection of its hyperparameters including the penalty coefficient (c) and the kernel function parameter (). The first hyperparameter affects the penalty imposed on data samples deviating from the established decision surface; the later hyperparameter specifies the smoothness of the decision surface. Since this problem of hyperparameter selection can be formulated as an optimization problem [38–40], this study employs the DFP metaheuristic to optimize the model training phase of SVM.

DFP, proposed in [41], is a population-based metaheuristic that combines the advantages of the standard algorithms of differential evolution (DE) [42] and flower pollination algorithm (FPA) [43]. The employed hybrid metaheuristic consists of three main steps: initialization of population members, alteration of member locations, and cost function evaluation. Each member of the DFP metaheuristic is presented as a numerical vector consisting of the two SVM hyperparameters. In the first step, all population members are randomly generated within the feasible domain. In the second step, the location of population members is altered by local and global search phases. In the next step, the cost function of each member is computed and a greedy selection operator is performed to update the location of the DFP’s population.

The second step of the DFP includes the FPA-based global pollination operator and the DE-based local pollination operator. A switching probability is used to govern the frequencies of these two operators [43]. The FPA-based global pollination and the DE-based local pollination operators are presented as follows:(i)The FPA-based global pollination:where g is the index of the current generation, is a trial solution, denotes a solution of the current population, represents the best solution, and L denotes a random number generated from the Lévy distribution [43].(ii)The DE-based local pollination modifies the current member by creating a mutated flower and a crossed flower according to the following equations:(a)Creating a mutated flower:where r1, r2, and r3 are three random integers and F denotes a mutation scale factor which is drawn from a Gaussian distribution with the mean = 0.5 and the standard deviation = 0.15 [41].(b)Creating a crossed flower:where Cr = 0.8 is the crossover probability [44].

2.3. Collected Image Samples

Because SVM is a supervised machine learning algorithm, a dataset consisting of 2000 image samples of pipe surface with the ground truth label has been collected to construct the SVM-based corrosion detection model. It is proper to note that the numbers of image samples in the two labels of noncorrosion (negative class) and corrosion (positive class) are both 1000. The digital image samples have been collected during surveys of several high-rise buildings in Danang city (Vietnam). The used digital camera is the 18-megapixel resolution Canon EOS M10, and the images were manually acquired by human inspectors.

Accordingly, image samples of the two labels of noncorrosion (label = −1) and corrosion (label = +1) have been prepared for SVM-based classification process. In order to accelerate the texture computation process, the size of image samples has been set to be 50 × 50 pixels. Hence, image cropping operation is performed to generate the image samples used to train the SVM model. The collected image set is illustrated in Figure 3.

(a)

(b)

2.4. Proposed Hybridization of Image Processing and Metaheuristic-Optimized SVM for Pipe Corrosion Detection

This section of the study describes the structure of the newly developed hybrid model of image processing and metaheuristic-optimized SVM for pipe corrosion detection. The proposed model, named as MO-SVM-PCD, is a combination of image texture analysis and a metaheuristic-optimized machine learning approach. As mentioned earlier, the statistical measurements of color channels, GLCM, and GLRL are used to extract texture-based features from image samples. The hybrid model relies on SVM to classify data samples into the categories of noncorrosion and corrosion. In addition, the DFP metaheuristic is employed to optimize the SVM-based training and prediction phases. The overall structure of the MO-SVM-PCD model is shown in Figure 4. The model structure can be divided into two separated modules: computation of image texture and data classification based on SVM. The first module is constructed in Visual C#.NET; the second module is developed in MATLAB.

Within the first module, the image texture descriptors based on statistical analysis of color channels, GLCM, and GLRL compute numerical features from image samples. For each of the three color channels (red, green, and blue), six statistical measurements of mean, standard deviation, skewness, kurtosis, entropy, and range are calculated. Hence, the total number of numerical features extracted from the aforementioned statistical indices of an image sample is 6 × 3 = 18. Subsequently, the group of features extracted from the four co-occurrence matrices corresponding to the directions of 0°, 45°, 90°, and 135° is computed. Because four indices of the angular second moment, contrast, correlation, entropy are acquired from one co-occurrence matrix, the total number of GLCM-based features is 4 × 4 = 16.

In addition, each GLRL matrix yields 11 properties of SRE, LRE, GLN, RLN, RP, LGRE, HGRE, SRLGE, SRHGE, LRLGE, and LRHGE. Thus, as stated earlier, the number of GLRL-based features is 4 × 11 = 44. Accordingly, each image sample is characterized by a feature vector having 18 + 16 + 44 = 78 elements. This module can compute texture of one image for illustration purpose and can extract features from a batch of image samples to construct the training and testing numerical datasets.

When the module of feature computation is accomplished, a dataset consisting of 2000 data samples and 78 input features is ready for further analysis. This dataset has two class outputs: −1 meaning noncorrosion (negative class) and +1 meaning corrosion (positive class). In addition, for standardizing the data ranges and enhancing the data modeling process, the numerical dataset is preprocessed by the Z-score data normalization [45]. The equation of the Z-score data normalization is given as follows:where X_o and X_ZN represent an original and a normalized input variable, respectively, and m_X and s_X denote the mean and the standard deviation of the original input variable, respectively.

Subsequently, the normalized dataset is randomly divided into two subsets: a training set (70%) and a testing set (30%). The first data subset is employed for model training; the later data subset is reserved for model testing. The training dataset is employed by the SVM-based data classification module to generalize a corrosion recognition model. In addition, DFP is utilized to finetune the SVM model hyperparameters including the penalty coefficient and the RBF kernel parameter. It is worth mentioning that the SVM model operates via the help of the MATLAB’s Statistics and Machine Learning Toolbox [46]; in addition, the DFP and the hybridization of DFP and SVM model have been constructed in MATLAB by the authors.

As shown in Figure 4, the two SVM hyperparameters are randomly initialized at the first generation (). Using the local and global pollination operators, the DFP algorithm gradually guides the population of SVM hyperparameters to explore the search space and identify better solutions. Based on the guidance of parameter setting in previous studies [44, 47], the population size and the number of DFP searching generations are selected to be 12 and 100. The feasible domain of the SVM’s penalty coefficient and kernel parameter is [1, 100] and [0.1, 100], respectively. In the phase of solution evaluation, the quality of each member in the population is appraised via the following cost function:where K = 5 denotes the number of data folds and PPV and NPV are the positive predictive value and the negative predictive value. PPV and NPV are employed to express the model performance associated with a set of SVM hyperparameters.

PPV and NPV are computed according to the following equations [48]:where TP, TN, FP, and FN are the true positive, true negative, false positive, and false negative values, respectively.

It is noted that to compute the model’s cost function, a K-fold cross validation process with K = 5 is employed. Using this cross fold validation, the original dataset is separated into 5 mutually exclusive subsets. Accordingly, the SVM model training and evaluation is repeated 5 times. In each time, 4 subsets are utilized for model training and one subset is used for model validation. The overall model performance is obtained via averaging predictive outcomes of the 5 data folds. This process has been proved to be a robust method for model hyperparameter selection [49]. Notably, in each generation, based on the computed cost function, the location of population members is updated and the stopping criterion is checked to verify whether the current generation number exceeds the allowable value. If the stopping criterion is met, the DFP-based optimization process terminates and the optimized SVM model is ready to predict corrosion status for novel image samples.

3. Experimental Results and Discussion

As stated earlier, the dataset featuring 2000 samples and 78 image texture variables has been separated into the training and testing subset. The training and testing subsets occupy 70% and 30% of the original dataset, respectively. The first subset is used for model training. The second subset is employed for testing the model predictive capability when it predicts corrosion status of novel image samples which has not been encountered in the training subset. Moreover, to reliably assess the model performance and to diminish the randomness caused by the data sampling process, this research work has conducted a random subsampling of the original dataset consisting of 20 runs. In each run, 30% of the data is randomly extracted to constitute the testing subset; the rest of the data is used for model training. Accordingly, the overall model performance is reliably evaluated by averaging prediction results obtained from the repeated data sampling.

In addition to the aforementioned PPV and NPV, the classification accuracy rate (CAR), recall, and F1 score are also used for expressing the model’s predictive accuracy. These indices are computed as follows [50]:where TP, TN, FP, and FN are the true positive, true negative, false positive, and false negative values.

Demonstration of the feature extraction phase which computes image sample texture is provided in Figure 5. Herein, for each image sample, 78 features representing the statistical measurements of image colors, GLCM, and GLRL are attained and used for data classification purpose. In addition, the evolutionary process of the DFP metaheuristic-based SVM model optimization is illustrated in Figure 6 which shows the best and the average cost function values in each generation. The optimal values of the penalty coefficient and the RBF kernel function parameter are found to be 4.30 and 8.86 with the best cost function = 1.08.

(a)

(b)

The performance of the MO-SVM-PCD in the training and testing phases is reported in Table 2. As shown in this table, the proposed model has attained good predictive accuracy in both phases with CAR >90%. In detail, the MO-SVM-PCD has achieved CAR = 91.17%, PPV = 0.91, recall = 0.92, NPV = 0.92, and F1 score = 0.91 in the testing phase. There is a focus on the MO-SVM-PCD performance in the testing phase because this reflects the generalization capability of the model.

In addition, corrosion detection based on the MO-SVM-PCD for a large-sized image samples can be achieved via a blockwise image separation process. This image separation process is illustrated in Figure 7(a). In this figure, each block corresponds to a sample having the size of 50 × 50. The classification result for the entire image is carried out by combining the MO-SVM-PCD-based corrosion detection for each image block (see Figure 7(b)). The computational time required to classify one image block is about 4 seconds; therefore, the corrosion detection of the whole large-sized image (800 × 600 pixels) requires about 768 seconds. It is noted that the detected positive class (corrosion class) samples are highlighted by red squares. As can be seen from this figure, the proposed approach can achieved relatively good classification result. Nevertheless, several positive samples located in the boundary of the corroded area have not been identified correctly.

(a)

(b)

Furthermore, to better demonstrate the prediction capability of the newly constructed MO-SVM-PCD employed for detecting metal pipe corrosion, its performance has been compared to that of the least squares support vector machine (LSSVM) [51], classification tree (CTree) [52], backpropagation artificial neural network (BPANN) [53], and convolutional neural network (CNN) [54]. The reason for the selection of these benchmark models is that they have been confirmed to be capable methods for pattern classification by previous studies [5, 40, 55–57].

The LSSVM model is programmed in MATLAB by the authors; its tuning parameters including the regularization coefficient and kernel function parameter are also automatically identified by the DFP metaheuristic. The CTree is developed by the built-in functions provided in the MATLAB Statistics and Machine Learning Toolbox [46]. The BPANN model is programmed in MATLAB environment by the authors. Via experiment, the suitable parameter of minimum leaf size of the employed CTree model has been found to be 2. Based on the suggestions of Heaton [58] and several trial-and-error runs, the number of neuron in the hidden layer of the BPANN model is selected to be 2 × N_I/3 + N_O = 54, where N_I = 78 is the number of input features and N_O = 2 is the number of class labels. Moreover, the learning rate and the number of training epochs of the neural network are set to be 0.1 and 1000, respectively.

In addition, the CNN model employed for corrosion detection is constructed by the MATLAB image processing toolbox [59]; the stochastic gradient descent with momentum (SGDM) and mini-batch mode are used in the model training phase. Via experimental runs, the appropriate configuration of the deep learning method is as follows: input image size is 50 × 50 pixels. The number of convolution layers is 4. The sizes of the filters are 20 × 20, 16 × 16, 8 × 8, and 4 × 4 in the 1^st, 2^nd, 3^rd, and 4^th convolution layer, respectively. The number of filters in each layer is 36. The batch size is 20% of the training data. In addition, the CNN model has been trained in 1000 epochs. In CNN, the feature extraction phase is automatically performed by convolution layers; therefore, the CNN model does not requires the feature computation done by the three employed image texture descriptors.

The prediction results of all the models obtained from the repeated data sampling with 20 runs are summarized in Table 3 which reports the mean and the standard deviation (Std) of the model performance. Observably, the MO-SVM-PCD has attained the most desired predictive accuracy in terms of CAR, followed by BPANN, LSSVM, CNN, and CTree. The proposed pipe corrosion approach also achieves the highest values of PPV, recall, NPV, and F1 score. The comparison of model performance is graphically displayed in Figure 8.

In addition, the Wilcoxon signed-rank test [60] is utilized in this section to better confirm the statistical significance of the differences in the model performances. This is a nonparametric statistical test commonly employed for model comparison [61]. With the significance level of the test = 0.05, if the value computed from the Wilcoxon signed-rank test is lower than this significance level, it is able to reject the null hypothesis of insignificant difference in prediction outcomes of the two predictors. Hence, it is confident to conclude that the predictive results of the two pipe corrosion detection models are statistically different. Using the CAR values, the outcome of the Wilcoxon signed-rank tests is reported in Table 4. This test points out that the MO-SVM-PCD is statistically better than the LSSVM, CTree, BPANN, and CNN with values < 0.05. Based on this statistical test, it is able to state that the proposed method is the most suited method for the task of interest.

4. Conclusion

Corrosion is a commonly observed type of pipe defects. Timely detection of corrosion is very crucial to ensure the integrity of the water supply system and avoid water contamination. In addition, information regarding corroded pipe sections obtained during periodic building surveys can significantly help to establish cost-effective maintenance strategies for building owners. This study puts forward an automatic method based on image processing and machine learning for pipe corrosion recognition. Image processing techniques have been employed to extract useful features from images of pipe surface to characterize the corrosion status. In total, 78 features are extracted using three texture descriptors of the statistical properties of image color, GLCM, and GLRL.

The SVM machine learning method integrated with the DFP metaheuristic is utilized to construct a decision boundary used for classifying pipe surface images into two categories of noncorrosion and corrosion. A dataset consisting of 2000 image samples has been used to train and validate the proposed hybrid model of the MO-SVM-PCD. Experimental results supported by the Wilcoxon signed-rank test point out that the newly developed method is superior to other benchmark approaches with an average CAR = 92.81%. Therefore, the newly developed model can be a useful tool for building maintenance agents to quickly evaluate the status of pipe systems. Further extensions of the current study may include the utilization of other advanced machine learning for data classification, employment of other metaheuristic for model optimization, employment of higher-order statistical features as input to machine learning based classifiers, enhancement of the detection accuracy for image samples located in the boundary of the corroded area, improvement of the computational efficiency of the current method by employing advanced image segmentation techniques, and collection of more image samples to enhance the generalization of the current MO-SVM-PCD model.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Supplementary Materials

The supplementary material of this study contains the dataset used to construct the machine learning-based model. The first 78 columns of the dataset are the extracted texture features. The last column is the class label (0 for noncorrosion and 1 for corrosion). (Supplementary Materials)

References

E. Fleming, Construction Technology: An Illustrated Introduction, Blackwell Publishing Ltd, Hoboken, NJ, USA, 2005.
F. Bonnin-Pascual and A. Ortiz, “Corrosion detection for automated visual inspection, developments in corrosion protection,” in Developments in Corrosion Protection, pp. 620–632, IntechOpen, London, UK, 2014.
View at: Publisher Site | Google Scholar
V. Bondada, D. K. Pratihar, and C. S. Kumar, “Detection and quantitative assessment of corrosion on pipelines through image analysis,” Procedia Computer Science, vol. 133, pp. 804–811, 2018.
View at: Publisher Site | Google Scholar
L. Liu, E. Tan, Y. Zhen, X. J. Yin, and Z. Q. Cai, “AI-facilitated coating corrosion assessment system for productivity enhancement,” in Proceedings of the 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA), pp. 606–610, Munich, Germany, May 2018.
View at: Publisher Site | Google Scholar
D. J. Atha and M. R. Jahanshahi, “Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection,” Structural Health Monitoring, vol. 17, no. 5, pp. 1110–1128, 2018.
View at: Publisher Site | Google Scholar
S. Dorafshan, R. J. Thomas, and M. Maguire, “Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete,” Construction and Building Materials, vol. 186, pp. 1031–1045, 2018.
View at: Publisher Site | Google Scholar
Y. Jung, H. Oh, and M. M. Jeong, “An approach to automated detection of structural failure using chronological image analysis in temporary structures,” International Journal of Construction Management, vol. 19, no. 2, pp. 178–185, 2019.
View at: Publisher Site | Google Scholar
J.-M. Maatta, J. Vanne, T. Hamalainen, and J. Nikkanen, “Generic software framework for a line-buffer-based image processing pipeline,” IEEE Transactions on Consumer Electronics, vol. 57, no. 3, pp. 1442–1449, 2011.
View at: Publisher Site | Google Scholar
D. Itzhak, I. Dinstein, and T. Zilberberg, “Pitting corrosion evaluation by computer image processing,” Corrosion Science, vol. 21, no. 1, pp. 17–22, 1981.
View at: Publisher Site | Google Scholar
K. Y. Choi and S. S. Kim, “Morphological analysis and classification of types of surface corrosion damage by digital image processing,” Corrosion Science, vol. 47, no. 1, pp. 1–15, 2005.
View at: Publisher Site | Google Scholar
F. N. S. Medeiros, G. L. B. Ramalho, M. P. Bento, and L. C. L. Medeiros, “On the evaluation of texture and color features for nondestructive corrosion detection,” EURASIP Journal on Advances in Signal Processing, vol. 2010, no. 1, Article ID 817473, 2010.
View at: Publisher Site | Google Scholar
G. Ji, Y. Zhu, and Y. Zhang, “The corroded defect rating system of coating material based on computer vision,” in Transactions on Edutainment VIII, Z. Pan, Ed., pp. 210–220, Springer, Berlin, Germany, 2012.
View at: Publisher Site | Google Scholar
S. A. Idris and F. A. Jafar, “Image enhancement based on software filter optimization for corrosion inspection,” in Proceedings of the 2014 5th International Conference on Intelligent Systems, Modelling and Simulation, vol. 27–29, pp. 345–350, Langkawi, Malaysia, January 2014.
View at: Publisher Site | Google Scholar
H. Son, N. Hwang, C. Kim, and C. Kim, “Rapid and automated determination of rusted surface areas of a steel bridge for robotic maintenance systems,” Automation in Construction, vol. 42, pp. 13–24, 2014.
View at: Publisher Site | Google Scholar
K.-W. Liao and Y.-T. Lee, “Detection of rust defects on steel bridge coatings via digital image recognition,” Automation in Construction, vol. 71, pp. 294–306, 2016.
View at: Publisher Site | Google Scholar
L. Petricca, T. Moss, G. Figueroa, and S. Broen, “Corrosion detection using A.I.: a comparison of standard computer vision techniques and deep learning model,” in Proceedings of the Sixth International Conference on Computer Science, Engineering and Information Technology, vol. 91–99, IEEE, Piscataway, NJ, USA, December 2016.
View at: Google Scholar
S. Safari and M. A. Shoorehdeli, “Detection and isolation of interior defects based on image processing and neural networks,” HDPE Pipeline Case Study Journal of Pipeline Systems Engineering and Practice, vol. 9, no. 2, Article ID 05018001, 2018.
View at: Publisher Site | Google Scholar
N. Cheriet, N. E. Bacha, and A. Skender, “Knowledge base system (KBS) applied on corrosion damage assessment on metallic structure pipes,” Heliyon, vol. 4, no. 10, Article ID e00865, 2018.
View at: Publisher Site | Google Scholar
T. Gibbons, G. Pierce, K. Worden, and I. Antoniadou, “A Gaussian mixture model for automated corrosion detection in remanufacturing,” in Advances in Manufacturing Technology XXXII, vol. 8, pp. 63–68, IOS Press, Amsterdam, Netherlands, 2018.
View at: Publisher Site | Google Scholar
S. K. Ahuja and M. K. Shukla, “A survey of computer vision based corrosion detection approaches,” in Proceedings of the Information and Communication Technology for Intelligent Systems (ICTIS 2017), vol. 2, pp. 55–63, Springer International Publishing, Cham, Switzerland, August 2018.
View at: Google Scholar
V. N. Vapnik, Statistical Learning Theory, John Wiley & Sons, Hoboken, NJ, USA, 1998, ISBN-10: 0471030031.
G. M. Hadjidemetriou, P. A. Vela, and S. E. Christodoulou, “Automated pavement patch detection and quantification using support vector machines,” Journal of Computing in Civil Engineering, vol. 32, no. 1, Article ID 04017073, 2018.
View at: Publisher Site | Google Scholar
M. Wang, Y. Wan, Z. Ye, and X. Lai, “Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm,” Information Sciences, vol. 402, pp. 50–68, 2017.
View at: Publisher Site | Google Scholar
Y. Zhou, W. Su, L. Ding, H. Luo, and P. E. D. Love, “Predicting safety risks in deep foundation pits in subway infrastructure projects: support vector machine approach,” Journal of Computing in Civil Engineering, vol. 31, no. 5, Article ID 04017052, 2017.
View at: Publisher Site | Google Scholar
S. Theodoridis and K. Koutroumbas, Pattern Recognition, Academic Press, , Cambridge, MA, USA, 2009, ISBN 978-1-59749-272-0.
R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1992, ISBN 0201569434.
M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis, and Machine Vision, Cengage Learning, Boston, MA, USA, 2013.
F. Tomita and S. Tsuji, Computer Analysis of Visual Textures, Springer, Berlin, Germany, 1990.
R. M. Haralick, K. Shanmugam, and I. H. Dinstein, “Textural features for image classification,” IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-3, no. 6, pp. 610–621, 1973.
View at: Publisher Site | Google Scholar
M. M. Galloway, “Texture analysis using gray level run lengths,” Computer Graphics and Image Processing, vol. 4, no. 2, pp. 172–179, 1975.
View at: Publisher Site | Google Scholar
B. Abraham and M. S. Nair, “Computer-aided classification of prostate cancer grade groups from MRI images using texture features and stacked sparse autoencoder,” Computerized Medical Imaging and Graphics, vol. 69, pp. 60–68, 2018.
View at: Publisher Site | Google Scholar
M. R. K. Mookiah, T. Baum, K. Mei et al., “Effect of radiation dose reduction on texture measures of trabecular bone microstructure: an in vitro study,” Journal of Bone and Mineral Metabolism, vol. 36, no. 3, pp. 323–335, 2018.
View at: Publisher Site | Google Scholar
T. Xiaoou, “Texture information in run-length matrices,” IEEE Transactions on Image Processing, vol. 7, no. 11, pp. 1602–1609, 1998.
View at: Publisher Site | Google Scholar
A. Chu, C. M. Sehgal, and J. F. Greenleaf, “Use of gray value distribution of run lengths for texture analysis,” Pattern Recognition Letters, vol. 11, no. 6, pp. 415–419, 1990.
View at: Publisher Site | Google Scholar
B. V. Dasarathy and E. B. Holder, “Image characterizations based on joint gray level—run length distributions,” Pattern Recognition Letters, vol. 12, no. 8, pp. 497–502, 1991.
View at: Publisher Site | Google Scholar
L. Hamel, Knowledge Discovery with Support Vector Machines, John Wiley & Sons, Hoboken, NJ, USA, 2009, ISBN: 978-0-470-37192-3.
M.-Y. Cheng and N.-D. Hoang, “Typhoon-induced slope collapse assessment using a novel bee colony optimized support vector classifier,” Natural Hazards, vol. 78, no. 3, pp. 1961–1978, 2015.
View at: Publisher Site | Google Scholar
D. Niu and S. Dai, “A short-term load forecasting model with a modified particle swarm optimization algorithm and least squares support vector machine based on the denoising method of empirical mode decomposition and grey relational analysis,” Energies, vol. 10, no. 3, p. 408, 2017.
View at: Publisher Site | Google Scholar
D. Prayogo and Y. T. T. Susanto, “Optimizing the prediction accuracy of friction capacity of driven piles in cohesive soil using a novel self-tuning least squares support vector machine,” Advances in Civil Engineering, vol. 2018, Article ID 6490169, 9 pages, 2018.
View at: Publisher Site | Google Scholar
T. Yi, H. Zheng, Y. Tian, and J.-p. Liu, “Intelligent prediction of transmission line project cost based on least squares support vector machine optimized by particle swarm optimization,” Mathematical Problems in Engineering, vol. 2018, Article ID 5458696, 11 pages, 2018.
View at: Publisher Site | Google Scholar
N.-D. Hoang, D. Tien Bui, and K.-W. Liao, “Groutability estimation of grouting processes with cement grouts using differential flower pollination optimized support vector machine,” Applied Soft Computing, vol. 45, pp. 173–186, 2016.
View at: Publisher Site | Google Scholar
R. Storn and K. Price, “Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces,” Journal of Global Optimization, vol. 11, no. 4, pp. 341–359, 1997.
View at: Publisher Site | Google Scholar
X.-S. Yang, “Flower pollination algorithm for global optimization,” in Unconventional Computation and Natural Computation, pp. 240–249, Springer, Berlin, Germany, 2012.
View at: Google Scholar
K. Price, R. M. Storn, and J. A. Lampinen, Differential Evolution—A Practical Approach to Global Optimization, Springer-Verlag, Berlin, Germany, 2005.
V.-H. Nhu, N.-D. Hoang, V.-B. Duong, H.-D. Vu, and D. Tien Bui, “A hybrid computational intelligence approach for predicting soil shear strength for urban housing construction: a case study at Vinhomes Imperia project, Hai Phong City (Vietnam),” Engineering with Computers, 2019.
View at: Publisher Site | Google Scholar
MathWork, Statistics and Machine Learning Toolbox User’s Guide, MathWork Inc., Natick, MA, USA, 2017, https://www.mathworks.com/help/pdf_doc/stats/stats.pdf.
Z. Guo, X. Shao, Y. Xu, H. Miyazaki, W. Ohira, and R. Shibasaki, “Identification of village building via Google earth images and supervised machine learning methods,” Remote Sensing, vol. 8, no. 4, p. 271, 2016.
View at: Publisher Site | Google Scholar
D. G. Altman and J. M. Bland, “Statistics notes: diagnostic tests 2: predictive values,” BMJ, vol. 309, no. 6947, p. 102, 1994.
View at: Publisher Site | Google Scholar
T. Kawasaki, T. Iwamoto, M. Matsumoto et al., “A method for detecting damage of traffic marks by half celestial camera attached to cars,” in Proceedings of the 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, Coimbra, Portugal, July2015.
View at: Google Scholar
N.-D. Hoang and Q.-L. Nguyen, “Metaheuristic optimized edge detection for recognition of concrete wall cracks: a comparative study on the performances of roberts, prewitt, canny, and sobel algorithms,” Advances in Civil Engineering, vol. 2018, Article ID 7163580, 16 pages, 2018.
View at: Publisher Site | Google Scholar
J. Suykens, J. V. Gestel, J. D. Brabanter, B. D. Moor, and J. Vandewalle, Least Squares Support Vector Machines, World Scientific Publishing Co. Pte. Ltd., Singapore, 2002, ISBN-13: 978-9812381514.
L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classifcation and Regression Trees, Wadsworth and Brooks, Montery, CA, USA, 1984, ISBN-13: 978-0412048418.
D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning representations by back-propagating errors,” Nature, vol. 323, no. 6088, pp. 533–536, 1986.
View at: Publisher Site | Google Scholar
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015.
View at: Publisher Site | Google Scholar
K. Khosravi, B. T. Pham, K. Chapi et al., “A comparative assessment of decision trees algorithms for flash flood susceptibility modeling at Haraz watershed, Northern Iran,” Science of the Total Environment, vol. 627, pp. 744–755, 2018.
View at: Publisher Site | Google Scholar
P.-T. Ngo, N.-D. Hoang, B. Pradhan et al., “A novel hybrid swarm optimized multilayer neural network for spatial prediction of flash floods in tropical areas using sentinel-1 SAR imagery and geospatial data,” Sensors, vol. 18, no. 11, p. 3704, 2018.
View at: Publisher Site | Google Scholar
Z. Tong, J. Gao, A. Sha, L. Hu, and S. Li, “Convolutional neural network for asphalt pavement surface texture analysis,” Computer-Aided Civil and Infrastructure Engineering, vol. 33, no. 12, pp. 1056–1072, 2018.
View at: Publisher Site | Google Scholar
J. Heaton, Introduction to Neural Networks for C#, Heaton Research, Inc., St. Louis, MO, USA, 2008.
MathWorks, Image Processing Toolbox User’s Guide, MathWork Inc., Natick, MA, USA, 2016, https://www.mathworks.com/help/pdf_doc/images/images_tb.pdf.
S. Sidney, Non-Parametric Statistics for the Behavioral Sciences, McGraw-Hill, New York, NY, USA, 1988, ISBN 0070573573.
N.-D. Hoang and D. T. Bui, “Predicting earthquake-induced soil liquefaction based on a hybridization of kernel Fisher discriminant analysis and a least squares support vector machine: a multi-dataset study,” Bulletin of Engineering Geology and the Environment, vol. 77, no. 1, pp. 191–204, 2018.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2019 Nhat-Duc Hoang and Van-Duc Tran. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

10827

Downloads

3350

Citations