Advances in Recent NatureInspired Algorithms for Neural Engineering
View this Special IssueResearch Article  Open Access
NhatDuc Hoang, VanDuc Tran, "Image ProcessingBased Detection of Pipe Corrosion Using Texture Analysis and MetaheuristicOptimized Machine Learning Approach", Computational Intelligence and Neuroscience, vol. 2019, Article ID 8097213, 13 pages, 2019. https://doi.org/10.1155/2019/8097213
Image ProcessingBased Detection of Pipe Corrosion Using Texture Analysis and MetaheuristicOptimized Machine Learning Approach
Abstract
To maintain the serviceability of buildings, the owners need to be informed about the current condition of the water supply and waste disposal systems. Therefore, timely and accurate detection of corrosion on pipe surface is a crucial task. The conventional manual surveying process performed by human inspectors is notoriously time consuming and labor intensive. Hence, this study proposes an image processingbased method for automating the task of pipe corrosion detection. Image texture including statistical measurement of image colors, graylevel cooccurrence matrix, and graylevel run length is employed to extract features of pipe surface. Support vector machine optimized by differential flower pollination is then used to construct a decision boundary that can recognize corroded and intact pipe surfaces. A dataset consisting of 2000 image samples has been collected and utilized to train and test the proposed hybrid model. Experimental results supported by the Wilcoxon signedrank test confirm that the proposed method is highly suitable for the task of interest with an accuracy rate of 92.81%. Thus, the model proposed in this study can be a promising tool to assist building maintenance agents during the phase of pipe system survey.
1. Introduction
In highrise building maintenance, an important objective is concerned with the integrity of the water supply system and prevention of water contamination. Cast iron is widely used in water supply and waste disposal systems due to the advantage of high strength. Since stainless steel pipes often fall out of favor in domestic pipework because of their high expenses [1], corrosion is a widely observed type of structural damage.
Corrosion (see Figure 1) can be defined as a chemical process caused by chemical and electrochemical reactions. This phenomenon is typically observed in environmental conditions featuring a high level of moisture. There are different kinds of corrosion such as general corrosion which occurs as uniformly distributed nonprotective flakes of rust and pitting which is a localized point of corrosive attack [2]. Corrosion brings about the destruction of metal pipework surface and consequently leads to reduction in pipe service life and increase in building maintenance cost [3]. In certain case, this defect may strongly affect the health of building occupants due to deterioration of water quality. Thus, corrosion should be identified timely by means of periodic surveys to ensure the integrity of pipe systems and establish costeffective maintenance strategies.
(a)
(b)
(c)
(d)
In Vietnam as well as in many other countries, manual methods performed by human inspectors are commonly employed for condition assessment of water supply/waste disposal systems. As clearly pointed out by Liu et al. [4] and Atha and Jahanshahi [5], these manual approaches are labor intensive and time consuming. Corroded regions can be neglected in positions of pipe system that are difficult to reach and observe visually. Moreover, the processes of data processing and reporting are also very tedious for human technicians. Therefore, there is a practical need to come up with a more productive and accurate method of pipe condition survey.
Although there is a wide range of existing pipe inspection approaches (such as magnetic flux leakage, ultrasonic testing, and external corrosion direct assessment), all of these methods have limitations including high equipment cost, restricted range of inspection, and incapability of detecting small pitting regions [3]. Considering the large amount of pipe systems needed to be surveyed and the limited access to sophisticated equipment in developing countries, there is an urgent need for a productive and lowcost solution for periodic surveys of pipe system condition. Recently, digital image processing has gained a great attention within the field of structural heath monitoring [6, 7].
Particularly, image processing techniques can be effectively employed to investigate the outer surface for detecting defects on pipes or other metal structures including corrosion and cracks [8]. Itzhak et al. [9] relied on statistic measurement of image pixels to quantify pitting corrosion. Choi and Kim [10] identified corrosion based on the morphology of the corroded surface; features of image color, texture, and shape are employed for corrosion recognition. A model for classifying corroded and noncorroded surfaces using texture descriptors obtained from gray level cooccurrence matrix and image color has been proposed in Medeiros et al. [11].
A method based on watershed segmentation has been employed in [12] for rating of corrosion defects; the percentage area of corroded region was used for determining the grade of defects. Idris and Jafar [13] used image filterbased image enhancement and neural network for corrosion inspection. Son et al. [14] proposed a model based on decision tree algorithm for identifying rusted surface area of steel bridge. A model based on image color analysis and Kmeans clustering for bridge rust identification has been constructed and verified by Liao and Lee [15].
Petricca et al. [16] compared standard computer vision techniques and deep neural network for rust and nonrust detection. Deep neural networks have also been employed for corrosion detection by Liu et al. [4] and Atha and Jahanshahi [5]. Safari and Shoorehdeli [17] applied artificial neural network, Gabor filter, and entropy filter for pipe defect detection. Cheriet et al. [18] incorporated expert knowledge and field data to construct a knowledgebased system for assessing corrosive damage on metallic pipe conduits. Gibbons et al. [19] relied on a Gaussian mixture model for probabilistic classification of corroded and noncorroded areas. Bondada et al. [3] detected and quantitatively assessed corrosion damages on pipelines by computing the mean of saturation value of image pixels; by image analysis, the corroded areas on pipelines can be segmented.
From the above literature, it can be seen that image processing and machine learning have been a feasible alternative for replacing the tedious process of manual survey. Based on a recent review work of Ahuja and Shukla [20], there is an increasing trend of applying computer vision techniques for corrosion detection. Moreover, due to the importance of the research theme, exploring other image processing and machine learning methods used for pipe corrosion detection can be highly meaningful in both academic and practical aspects.
As reported in the literature, although image texture analysis has been applied, few previous studies have employed a combination of image texture descriptors for pipe corrosion recognition. Hence, this study is an attempt to fill this gap in the literature by proposing a method used for analyzing texture of water pipe surface that integrates statistical measurement of color channels, graylevel cooccurrence matrix, and graylevel run length matrix. Based on the features extracted by the above texture descriptors, the support vector machine (SVM) [21] is employed to categorize image samples into two classes: noncorrosion (negative) and corrosion (positive). SVM is utilized in this study due to the fact that it has been confirmed to be a robust tool for pattern classification in various studies [22–24]. In addition, to optimize the training process of SVMbased corrosion detection model, differential flower pollination (DFP) metaheuristic is employed. A dataset consisting of 2000 image samples has been collected to train and verify the proposed method.
The rest of the study is organized as follows. Section 2 reviews the research material and methods used to construct the water pipe corrosion detection approach. Section 3 reports experimental results and discussions. Section 4 provides several concluding remarks of this study.
2. Material and Methods
2.1. Image Texture Analysis
Identifying corroded areas based on twodimensional image samples is a challenging task due to the complex and deceptive features of pipe surfaces containing various irregular objects such as dirt and paints. Therefore, using information provided by one pixel is definitely not sufficient for corrosion detection. It is because a pixel having similar color values can belong to both categories of noncorrosion and corrosion. Hence, texture information extracted from a certain region of pipe surface can be used for recognizing the defect of interest. This section of the study describes the employed texture descriptors used for computing the features of water pipe surface.
2.1.1. Statistical Properties of Color Channels
Herein, the statistical properties of three color channels (red, green, and blue) of an image sample can be employed to represent image texture. Thus, an image is described in a RGB color space. It is noted that besides RGB, there are other color spaces such as HSV which can also be useful in the task of corrosion detection. However, in this study, we rely on the original RGB color model obtained from the employed digital camera. Let I be a variable representing the color levels of an image sample. The firstorder histogram P(I) is calculated as follows [25]:where c denotes a color channel, N_{I,c} is the number of pixels with intensity value I of the channel c, and H and W represent the height and width of an image sample, respectively.
Thus, the mean (), standard deviation (), skewness (), kurtosis (), entropy (), and range () of color value are calculated as follows:where NL = 256 denotes the number of discrete color values.
2.1.2. GrayLevel CoOccurrence Matrix (GLCM)
The GLCM [26] is also a commonly used texture descriptor. To employ this technique, a color image must first be converted to a gray scale one. The GLCM discriminates different image textures based on the repeated occurrence of some graylevel patterns existing in the texture [27]. Let be a vector in the polar coordinates of an image sample. For each , the joint probability of the pairs of gray levels that occur at the two points separated by the relationship is computed [28]. This joint probability is compactly displayed in a GLCM within which represents the probability of the two gray levels of i and j occurring according to . The original is often normalized via the following equation:where denotes the normalized GLCM and S_{P} is the number of pixels.
Based on the suggestion of Haralick et al. [29], four GLCMs with r = 1 and = 0°, 45°, 90°, and 135° can be established. Accordingly, angular second moment (AM), contrast (CO), correlation (CR), and entropy (ET) for each matrix can be computed to serve as texture descriptors as follows [28, 29]:where N_{g} is the number of graylevel values and , and are the means and standard deviations of the marginal distribution associated with a normalized GLCM [29].
2.1.3. GrayLevel Run Lengths (GLRL)
GLRL is a texture description method proposed by Galloway [30]. This method is highly effective in discriminating textures featuring different fineness and has been successfully applied in various fields of study [31, 32]. It is because GLRL is constructed based on the fact that relatively long graylevel runs are observed more frequently in a coarse texture and a fine texture typically has more short runs [33]. A runlength matrix p( i · j ) in a certain direction is defined as the number of times that a run length j of gray level i is observed [30].
Using this matrix, the short run emphasis (SRE), long run emphasis (LRE), graylevel nonuniformity (GLN), run length nonuniformity (RLN), and run percentage (RP) [30, 33] can be computed. Additionally, Chu et al. [34] put forward the indices of low graylevel run emphasis (LGRE) and high graylevel run emphasis (HGRE). Dasarathy and Holder [35] proposed to compute the short run low graylevel emphasis (SRLGE), short run high graylevel emphasis (SRHGE), long run low graylevel emphasis (LRLGE), and long run high graylevel emphasis (LRHGE). The above indices are summarized in Table 1. It is noted that one run length matrix is computed for each of direction in the set of and each matrix results in 11 GLRLbased features. Therefore, the total number of features obtained from GLRL matrices is 11 × 4 = 44.
 
Note. M and N are the number of gray levels and the maximum run length, respectively. Let N_{r} and N_{p} be the total number of runs and the number of pixels in the image, respectively. 
2.2. Computational Intelligence Methods
2.2.1. Support Vector Machine (SVM)
SVM, described in [21], is a robust pattern recognition method established on the theory of statistical learning. Given the task at hand is to classify a set of input feature x_{k} into two categories of y_{k} = −1 (noncorrosion) and y_{k} = +1 (corrosion), a SVM model constructs a decision surface that separates the input space into two distinctive regions characterizing the two different two categories. The SVM algorithm aims at identifying a decision boundary so that the gap between classes is as large as possible [36]. In addition, SVM employs the kernel trick to convert a nonlinear classification task into a linear one. A SVM model first maps the input data from the original space to a highdimensional feature space within which the data can be separated by a hyperplane (see Figure 2).
The SVM training process can be formulated as the following constrained optimization problem [36]:where R^{n} is a normal vector to the classification hyperplane and b R is the model bias; e_{k} ≥ 0 is called a slack variable; c denotes a penalty constant; and is a nonlinear mapping from the input space to the highdimensional feature space.
During the construction of a SVM model, it is not required to obtain the explicit form of . Instead of that, only the dot product of in the input space is required and expressed via a kernel function shown as follows:
The radial basis function (RBF) kernel function [37] is often employed for data classification; its functional form is given below:where is a free parameter.
Accordingly, a SVM model used for data classification is given compactly as follows:where denotes the solution of the dual form of the aforementioned constrained optimization. SV is the number of support vectors which is the number of .
2.2.2. Differential Flower Pollination (DFP)
As shown in the previous section, the model training and prediction phases of a SVM model depend on a proper selection of its hyperparameters including the penalty coefficient (c) and the kernel function parameter (). The first hyperparameter affects the penalty imposed on data samples deviating from the established decision surface; the later hyperparameter specifies the smoothness of the decision surface. Since this problem of hyperparameter selection can be formulated as an optimization problem [38–40], this study employs the DFP metaheuristic to optimize the model training phase of SVM.
DFP, proposed in [41], is a populationbased metaheuristic that combines the advantages of the standard algorithms of differential evolution (DE) [42] and flower pollination algorithm (FPA) [43]. The employed hybrid metaheuristic consists of three main steps: initialization of population members, alteration of member locations, and cost function evaluation. Each member of the DFP metaheuristic is presented as a numerical vector consisting of the two SVM hyperparameters. In the first step, all population members are randomly generated within the feasible domain. In the second step, the location of population members is altered by local and global search phases. In the next step, the cost function of each member is computed and a greedy selection operator is performed to update the location of the DFP’s population.
The second step of the DFP includes the FPAbased global pollination operator and the DEbased local pollination operator. A switching probability is used to govern the frequencies of these two operators [43]. The FPAbased global pollination and the DEbased local pollination operators are presented as follows:(i)The FPAbased global pollination:where g is the index of the current generation, is a trial solution, denotes a solution of the current population, represents the best solution, and L denotes a random number generated from the Lévy distribution [43].(ii)The DEbased local pollination modifies the current member by creating a mutated flower and a crossed flower according to the following equations:(a)Creating a mutated flower:where r1, r2, and r3 are three random integers and F denotes a mutation scale factor which is drawn from a Gaussian distribution with the mean = 0.5 and the standard deviation = 0.15 [41].(b)Creating a crossed flower:where Cr = 0.8 is the crossover probability [44].
2.3. Collected Image Samples
Because SVM is a supervised machine learning algorithm, a dataset consisting of 2000 image samples of pipe surface with the ground truth label has been collected to construct the SVMbased corrosion detection model. It is proper to note that the numbers of image samples in the two labels of noncorrosion (negative class) and corrosion (positive class) are both 1000. The digital image samples have been collected during surveys of several highrise buildings in Danang city (Vietnam). The used digital camera is the 18megapixel resolution Canon EOS M10, and the images were manually acquired by human inspectors.
Accordingly, image samples of the two labels of noncorrosion (label = −1) and corrosion (label = +1) have been prepared for SVMbased classification process. In order to accelerate the texture computation process, the size of image samples has been set to be 50 × 50 pixels. Hence, image cropping operation is performed to generate the image samples used to train the SVM model. The collected image set is illustrated in Figure 3.
(a)
(b)
2.4. Proposed Hybridization of Image Processing and MetaheuristicOptimized SVM for Pipe Corrosion Detection
This section of the study describes the structure of the newly developed hybrid model of image processing and metaheuristicoptimized SVM for pipe corrosion detection. The proposed model, named as MOSVMPCD, is a combination of image texture analysis and a metaheuristicoptimized machine learning approach. As mentioned earlier, the statistical measurements of color channels, GLCM, and GLRL are used to extract texturebased features from image samples. The hybrid model relies on SVM to classify data samples into the categories of noncorrosion and corrosion. In addition, the DFP metaheuristic is employed to optimize the SVMbased training and prediction phases. The overall structure of the MOSVMPCD model is shown in Figure 4. The model structure can be divided into two separated modules: computation of image texture and data classification based on SVM. The first module is constructed in Visual C#.NET; the second module is developed in MATLAB.
Within the first module, the image texture descriptors based on statistical analysis of color channels, GLCM, and GLRL compute numerical features from image samples. For each of the three color channels (red, green, and blue), six statistical measurements of mean, standard deviation, skewness, kurtosis, entropy, and range are calculated. Hence, the total number of numerical features extracted from the aforementioned statistical indices of an image sample is 6 × 3 = 18. Subsequently, the group of features extracted from the four cooccurrence matrices corresponding to the directions of 0°, 45°, 90°, and 135° is computed. Because four indices of the angular second moment, contrast, correlation, entropy are acquired from one cooccurrence matrix, the total number of GLCMbased features is 4 × 4 = 16.
In addition, each GLRL matrix yields 11 properties of SRE, LRE, GLN, RLN, RP, LGRE, HGRE, SRLGE, SRHGE, LRLGE, and LRHGE. Thus, as stated earlier, the number of GLRLbased features is 4 × 11 = 44. Accordingly, each image sample is characterized by a feature vector having 18 + 16 + 44 = 78 elements. This module can compute texture of one image for illustration purpose and can extract features from a batch of image samples to construct the training and testing numerical datasets.
When the module of feature computation is accomplished, a dataset consisting of 2000 data samples and 78 input features is ready for further analysis. This dataset has two class outputs: −1 meaning noncorrosion (negative class) and +1 meaning corrosion (positive class). In addition, for standardizing the data ranges and enhancing the data modeling process, the numerical dataset is preprocessed by the Zscore data normalization [45]. The equation of the Zscore data normalization is given as follows:where X_{o} and X_{ZN} represent an original and a normalized input variable, respectively, and m_{X} and s_{X} denote the mean and the standard deviation of the original input variable, respectively.
Subsequently, the normalized dataset is randomly divided into two subsets: a training set (70%) and a testing set (30%). The first data subset is employed for model training; the later data subset is reserved for model testing. The training dataset is employed by the SVMbased data classification module to generalize a corrosion recognition model. In addition, DFP is utilized to finetune the SVM model hyperparameters including the penalty coefficient and the RBF kernel parameter. It is worth mentioning that the SVM model operates via the help of the MATLAB’s Statistics and Machine Learning Toolbox [46]; in addition, the DFP and the hybridization of DFP and SVM model have been constructed in MATLAB by the authors.
As shown in Figure 4, the two SVM hyperparameters are randomly initialized at the first generation (). Using the local and global pollination operators, the DFP algorithm gradually guides the population of SVM hyperparameters to explore the search space and identify better solutions. Based on the guidance of parameter setting in previous studies [44, 47], the population size and the number of DFP searching generations are selected to be 12 and 100. The feasible domain of the SVM’s penalty coefficient and kernel parameter is [1, 100] and [0.1, 100], respectively. In the phase of solution evaluation, the quality of each member in the population is appraised via the following cost function:where K = 5 denotes the number of data folds and PPV and NPV are the positive predictive value and the negative predictive value. PPV and NPV are employed to express the model performance associated with a set of SVM hyperparameters.
PPV and NPV are computed according to the following equations [48]:where TP, TN, FP, and FN are the true positive, true negative, false positive, and false negative values, respectively.
It is noted that to compute the model’s cost function, a Kfold cross validation process with K = 5 is employed. Using this cross fold validation, the original dataset is separated into 5 mutually exclusive subsets. Accordingly, the SVM model training and evaluation is repeated 5 times. In each time, 4 subsets are utilized for model training and one subset is used for model validation. The overall model performance is obtained via averaging predictive outcomes of the 5 data folds. This process has been proved to be a robust method for model hyperparameter selection [49]. Notably, in each generation, based on the computed cost function, the location of population members is updated and the stopping criterion is checked to verify whether the current generation number exceeds the allowable value. If the stopping criterion is met, the DFPbased optimization process terminates and the optimized SVM model is ready to predict corrosion status for novel image samples.
3. Experimental Results and Discussion
As stated earlier, the dataset featuring 2000 samples and 78 image texture variables has been separated into the training and testing subset. The training and testing subsets occupy 70% and 30% of the original dataset, respectively. The first subset is used for model training. The second subset is employed for testing the model predictive capability when it predicts corrosion status of novel image samples which has not been encountered in the training subset. Moreover, to reliably assess the model performance and to diminish the randomness caused by the data sampling process, this research work has conducted a random subsampling of the original dataset consisting of 20 runs. In each run, 30% of the data is randomly extracted to constitute the testing subset; the rest of the data is used for model training. Accordingly, the overall model performance is reliably evaluated by averaging prediction results obtained from the repeated data sampling.
In addition to the aforementioned PPV and NPV, the classification accuracy rate (CAR), recall, and F1 score are also used for expressing the model’s predictive accuracy. These indices are computed as follows [50]:where TP, TN, FP, and FN are the true positive, true negative, false positive, and false negative values.
Demonstration of the feature extraction phase which computes image sample texture is provided in Figure 5. Herein, for each image sample, 78 features representing the statistical measurements of image colors, GLCM, and GLRL are attained and used for data classification purpose. In addition, the evolutionary process of the DFP metaheuristicbased SVM model optimization is illustrated in Figure 6 which shows the best and the average cost function values in each generation. The optimal values of the penalty coefficient and the RBF kernel function parameter are found to be 4.30 and 8.86 with the best cost function = 1.08.
(a)
(b)
The performance of the MOSVMPCD in the training and testing phases is reported in Table 2. As shown in this table, the proposed model has attained good predictive accuracy in both phases with CAR >90%. In detail, the MOSVMPCD has achieved CAR = 91.17%, PPV = 0.91, recall = 0.92, NPV = 0.92, and F1 score = 0.91 in the testing phase. There is a focus on the MOSVMPCD performance in the testing phase because this reflects the generalization capability of the model.

In addition, corrosion detection based on the MOSVMPCD for a largesized image samples can be achieved via a blockwise image separation process. This image separation process is illustrated in Figure 7(a). In this figure, each block corresponds to a sample having the size of 50 × 50. The classification result for the entire image is carried out by combining the MOSVMPCDbased corrosion detection for each image block (see Figure 7(b)). The computational time required to classify one image block is about 4 seconds; therefore, the corrosion detection of the whole largesized image (800 × 600 pixels) requires about 768 seconds. It is noted that the detected positive class (corrosion class) samples are highlighted by red squares. As can be seen from this figure, the proposed approach can achieved relatively good classification result. Nevertheless, several positive samples located in the boundary of the corroded area have not been identified correctly.
(a)
(b)
Furthermore, to better demonstrate the prediction capability of the newly constructed MOSVMPCD employed for detecting metal pipe corrosion, its performance has been compared to that of the least squares support vector machine (LSSVM) [51], classification tree (CTree) [52], backpropagation artificial neural network (BPANN) [53], and convolutional neural network (CNN) [54]. The reason for the selection of these benchmark models is that they have been confirmed to be capable methods for pattern classification by previous studies [5, 40, 55–57].
The LSSVM model is programmed in MATLAB by the authors; its tuning parameters including the regularization coefficient and kernel function parameter are also automatically identified by the DFP metaheuristic. The CTree is developed by the builtin functions provided in the MATLAB Statistics and Machine Learning Toolbox [46]. The BPANN model is programmed in MATLAB environment by the authors. Via experiment, the suitable parameter of minimum leaf size of the employed CTree model has been found to be 2. Based on the suggestions of Heaton [58] and several trialanderror runs, the number of neuron in the hidden layer of the BPANN model is selected to be 2 × N_{I}/3 + N_{O} = 54, where N_{I} = 78 is the number of input features and N_{O} = 2 is the number of class labels. Moreover, the learning rate and the number of training epochs of the neural network are set to be 0.1 and 1000, respectively.
In addition, the CNN model employed for corrosion detection is constructed by the MATLAB image processing toolbox [59]; the stochastic gradient descent with momentum (SGDM) and minibatch mode are used in the model training phase. Via experimental runs, the appropriate configuration of the deep learning method is as follows: input image size is 50 × 50 pixels. The number of convolution layers is 4. The sizes of the filters are 20 × 20, 16 × 16, 8 × 8, and 4 × 4 in the 1^{st}, 2^{nd}, 3^{rd}, and 4^{th} convolution layer, respectively. The number of filters in each layer is 36. The batch size is 20% of the training data. In addition, the CNN model has been trained in 1000 epochs. In CNN, the feature extraction phase is automatically performed by convolution layers; therefore, the CNN model does not requires the feature computation done by the three employed image texture descriptors.
The prediction results of all the models obtained from the repeated data sampling with 20 runs are summarized in Table 3 which reports the mean and the standard deviation (Std) of the model performance. Observably, the MOSVMPCD has attained the most desired predictive accuracy in terms of CAR, followed by BPANN, LSSVM, CNN, and CTree. The proposed pipe corrosion approach also achieves the highest values of PPV, recall, NPV, and F1 score. The comparison of model performance is graphically displayed in Figure 8.

In addition, the Wilcoxon signedrank test [60] is utilized in this section to better confirm the statistical significance of the differences in the model performances. This is a nonparametric statistical test commonly employed for model comparison [61]. With the significance level of the test = 0.05, if the value computed from the Wilcoxon signedrank test is lower than this significance level, it is able to reject the null hypothesis of insignificant difference in prediction outcomes of the two predictors. Hence, it is confident to conclude that the predictive results of the two pipe corrosion detection models are statistically different. Using the CAR values, the outcome of the Wilcoxon signedrank tests is reported in Table 4. This test points out that the MOSVMPCD is statistically better than the LSSVM, CTree, BPANN, and CNN with values < 0.05. Based on this statistical test, it is able to state that the proposed method is the most suited method for the task of interest.

4. Conclusion
Corrosion is a commonly observed type of pipe defects. Timely detection of corrosion is very crucial to ensure the integrity of the water supply system and avoid water contamination. In addition, information regarding corroded pipe sections obtained during periodic building surveys can significantly help to establish costeffective maintenance strategies for building owners. This study puts forward an automatic method based on image processing and machine learning for pipe corrosion recognition. Image processing techniques have been employed to extract useful features from images of pipe surface to characterize the corrosion status. In total, 78 features are extracted using three texture descriptors of the statistical properties of image color, GLCM, and GLRL.
The SVM machine learning method integrated with the DFP metaheuristic is utilized to construct a decision boundary used for classifying pipe surface images into two categories of noncorrosion and corrosion. A dataset consisting of 2000 image samples has been used to train and validate the proposed hybrid model of the MOSVMPCD. Experimental results supported by the Wilcoxon signedrank test point out that the newly developed method is superior to other benchmark approaches with an average CAR = 92.81%. Therefore, the newly developed model can be a useful tool for building maintenance agents to quickly evaluate the status of pipe systems. Further extensions of the current study may include the utilization of other advanced machine learning for data classification, employment of other metaheuristic for model optimization, employment of higherorder statistical features as input to machine learning based classifiers, enhancement of the detection accuracy for image samples located in the boundary of the corroded area, improvement of the computational efficiency of the current method by employing advanced image segmentation techniques, and collection of more image samples to enhance the generalization of the current MOSVMPCD model.
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
Supplementary Materials
The supplementary material of this study contains the dataset used to construct the machine learningbased model. The first 78 columns of the dataset are the extracted texture features. The last column is the class label (0 for noncorrosion and 1 for corrosion). (Supplementary Materials)
References
 E. Fleming, Construction Technology: An Illustrated Introduction, Blackwell Publishing Ltd, Hoboken, NJ, USA, 2005.
 F. BonninPascual and A. Ortiz, “Corrosion detection for automated visual inspection, developments in corrosion protection,” in Developments in Corrosion Protection, pp. 620–632, IntechOpen, London, UK, 2014. View at: Publisher Site  Google Scholar
 V. Bondada, D. K. Pratihar, and C. S. Kumar, “Detection and quantitative assessment of corrosion on pipelines through image analysis,” Procedia Computer Science, vol. 133, pp. 804–811, 2018. View at: Publisher Site  Google Scholar
 L. Liu, E. Tan, Y. Zhen, X. J. Yin, and Z. Q. Cai, “AIfacilitated coating corrosion assessment system for productivity enhancement,” in Proceedings of the 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA), pp. 606–610, Munich, Germany, May 2018. View at: Publisher Site  Google Scholar
 D. J. Atha and M. R. Jahanshahi, “Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection,” Structural Health Monitoring, vol. 17, no. 5, pp. 1110–1128, 2018. View at: Publisher Site  Google Scholar
 S. Dorafshan, R. J. Thomas, and M. Maguire, “Comparison of deep convolutional neural networks and edge detectors for imagebased crack detection in concrete,” Construction and Building Materials, vol. 186, pp. 1031–1045, 2018. View at: Publisher Site  Google Scholar
 Y. Jung, H. Oh, and M. M. Jeong, “An approach to automated detection of structural failure using chronological image analysis in temporary structures,” International Journal of Construction Management, vol. 19, no. 2, pp. 178–185, 2019. View at: Publisher Site  Google Scholar
 J.M. Maatta, J. Vanne, T. Hamalainen, and J. Nikkanen, “Generic software framework for a linebufferbased image processing pipeline,” IEEE Transactions on Consumer Electronics, vol. 57, no. 3, pp. 1442–1449, 2011. View at: Publisher Site  Google Scholar
 D. Itzhak, I. Dinstein, and T. Zilberberg, “Pitting corrosion evaluation by computer image processing,” Corrosion Science, vol. 21, no. 1, pp. 17–22, 1981. View at: Publisher Site  Google Scholar
 K. Y. Choi and S. S. Kim, “Morphological analysis and classification of types of surface corrosion damage by digital image processing,” Corrosion Science, vol. 47, no. 1, pp. 1–15, 2005. View at: Publisher Site  Google Scholar
 F. N. S. Medeiros, G. L. B. Ramalho, M. P. Bento, and L. C. L. Medeiros, “On the evaluation of texture and color features for nondestructive corrosion detection,” EURASIP Journal on Advances in Signal Processing, vol. 2010, no. 1, Article ID 817473, 2010. View at: Publisher Site  Google Scholar
 G. Ji, Y. Zhu, and Y. Zhang, “The corroded defect rating system of coating material based on computer vision,” in Transactions on Edutainment VIII, Z. Pan, Ed., pp. 210–220, Springer, Berlin, Germany, 2012. View at: Publisher Site  Google Scholar
 S. A. Idris and F. A. Jafar, “Image enhancement based on software filter optimization for corrosion inspection,” in Proceedings of the 2014 5th International Conference on Intelligent Systems, Modelling and Simulation, vol. 27–29, pp. 345–350, Langkawi, Malaysia, January 2014. View at: Publisher Site  Google Scholar
 H. Son, N. Hwang, C. Kim, and C. Kim, “Rapid and automated determination of rusted surface areas of a steel bridge for robotic maintenance systems,” Automation in Construction, vol. 42, pp. 13–24, 2014. View at: Publisher Site  Google Scholar
 K.W. Liao and Y.T. Lee, “Detection of rust defects on steel bridge coatings via digital image recognition,” Automation in Construction, vol. 71, pp. 294–306, 2016. View at: Publisher Site  Google Scholar
 L. Petricca, T. Moss, G. Figueroa, and S. Broen, “Corrosion detection using A.I.: a comparison of standard computer vision techniques and deep learning model,” in Proceedings of the Sixth International Conference on Computer Science, Engineering and Information Technology, vol. 91–99, IEEE, Piscataway, NJ, USA, December 2016. View at: Google Scholar
 S. Safari and M. A. Shoorehdeli, “Detection and isolation of interior defects based on image processing and neural networks,” HDPE Pipeline Case Study Journal of Pipeline Systems Engineering and Practice, vol. 9, no. 2, Article ID 05018001, 2018. View at: Publisher Site  Google Scholar
 N. Cheriet, N. E. Bacha, and A. Skender, “Knowledge base system (KBS) applied on corrosion damage assessment on metallic structure pipes,” Heliyon, vol. 4, no. 10, Article ID e00865, 2018. View at: Publisher Site  Google Scholar
 T. Gibbons, G. Pierce, K. Worden, and I. Antoniadou, “A Gaussian mixture model for automated corrosion detection in remanufacturing,” in Advances in Manufacturing Technology XXXII, vol. 8, pp. 63–68, IOS Press, Amsterdam, Netherlands, 2018. View at: Publisher Site  Google Scholar
 S. K. Ahuja and M. K. Shukla, “A survey of computer vision based corrosion detection approaches,” in Proceedings of the Information and Communication Technology for Intelligent Systems (ICTIS 2017), vol. 2, pp. 55–63, Springer International Publishing, Cham, Switzerland, August 2018. View at: Google Scholar
 V. N. Vapnik, Statistical Learning Theory, John Wiley & Sons, Hoboken, NJ, USA, 1998, ISBN10: 0471030031.
 G. M. Hadjidemetriou, P. A. Vela, and S. E. Christodoulou, “Automated pavement patch detection and quantification using support vector machines,” Journal of Computing in Civil Engineering, vol. 32, no. 1, Article ID 04017073, 2018. View at: Publisher Site  Google Scholar
 M. Wang, Y. Wan, Z. Ye, and X. Lai, “Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm,” Information Sciences, vol. 402, pp. 50–68, 2017. View at: Publisher Site  Google Scholar
 Y. Zhou, W. Su, L. Ding, H. Luo, and P. E. D. Love, “Predicting safety risks in deep foundation pits in subway infrastructure projects: support vector machine approach,” Journal of Computing in Civil Engineering, vol. 31, no. 5, Article ID 04017052, 2017. View at: Publisher Site  Google Scholar
 S. Theodoridis and K. Koutroumbas, Pattern Recognition, Academic Press, , Cambridge, MA, USA, 2009, ISBN 9781597492720.
 R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, AddisonWesley Longman Publishing Co., Inc., Boston, MA, USA, 1992, ISBN 0201569434.
 M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis, and Machine Vision, Cengage Learning, Boston, MA, USA, 2013.
 F. Tomita and S. Tsuji, Computer Analysis of Visual Textures, Springer, Berlin, Germany, 1990.
 R. M. Haralick, K. Shanmugam, and I. H. Dinstein, “Textural features for image classification,” IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC3, no. 6, pp. 610–621, 1973. View at: Publisher Site  Google Scholar
 M. M. Galloway, “Texture analysis using gray level run lengths,” Computer Graphics and Image Processing, vol. 4, no. 2, pp. 172–179, 1975. View at: Publisher Site  Google Scholar
 B. Abraham and M. S. Nair, “Computeraided classification of prostate cancer grade groups from MRI images using texture features and stacked sparse autoencoder,” Computerized Medical Imaging and Graphics, vol. 69, pp. 60–68, 2018. View at: Publisher Site  Google Scholar
 M. R. K. Mookiah, T. Baum, K. Mei et al., “Effect of radiation dose reduction on texture measures of trabecular bone microstructure: an in vitro study,” Journal of Bone and Mineral Metabolism, vol. 36, no. 3, pp. 323–335, 2018. View at: Publisher Site  Google Scholar
 T. Xiaoou, “Texture information in runlength matrices,” IEEE Transactions on Image Processing, vol. 7, no. 11, pp. 1602–1609, 1998. View at: Publisher Site  Google Scholar
 A. Chu, C. M. Sehgal, and J. F. Greenleaf, “Use of gray value distribution of run lengths for texture analysis,” Pattern Recognition Letters, vol. 11, no. 6, pp. 415–419, 1990. View at: Publisher Site  Google Scholar
 B. V. Dasarathy and E. B. Holder, “Image characterizations based on joint gray level—run length distributions,” Pattern Recognition Letters, vol. 12, no. 8, pp. 497–502, 1991. View at: Publisher Site  Google Scholar
 L. Hamel, Knowledge Discovery with Support Vector Machines, John Wiley & Sons, Hoboken, NJ, USA, 2009, ISBN: 9780470371923.
 M.Y. Cheng and N.D. Hoang, “Typhooninduced slope collapse assessment using a novel bee colony optimized support vector classifier,” Natural Hazards, vol. 78, no. 3, pp. 1961–1978, 2015. View at: Publisher Site  Google Scholar
 D. Niu and S. Dai, “A shortterm load forecasting model with a modified particle swarm optimization algorithm and least squares support vector machine based on the denoising method of empirical mode decomposition and grey relational analysis,” Energies, vol. 10, no. 3, p. 408, 2017. View at: Publisher Site  Google Scholar
 D. Prayogo and Y. T. T. Susanto, “Optimizing the prediction accuracy of friction capacity of driven piles in cohesive soil using a novel selftuning least squares support vector machine,” Advances in Civil Engineering, vol. 2018, Article ID 6490169, 9 pages, 2018. View at: Publisher Site  Google Scholar
 T. Yi, H. Zheng, Y. Tian, and J.p. Liu, “Intelligent prediction of transmission line project cost based on least squares support vector machine optimized by particle swarm optimization,” Mathematical Problems in Engineering, vol. 2018, Article ID 5458696, 11 pages, 2018. View at: Publisher Site  Google Scholar
 N.D. Hoang, D. Tien Bui, and K.W. Liao, “Groutability estimation of grouting processes with cement grouts using differential flower pollination optimized support vector machine,” Applied Soft Computing, vol. 45, pp. 173–186, 2016. View at: Publisher Site  Google Scholar
 R. Storn and K. Price, “Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces,” Journal of Global Optimization, vol. 11, no. 4, pp. 341–359, 1997. View at: Publisher Site  Google Scholar
 X.S. Yang, “Flower pollination algorithm for global optimization,” in Unconventional Computation and Natural Computation, pp. 240–249, Springer, Berlin, Germany, 2012. View at: Google Scholar
 K. Price, R. M. Storn, and J. A. Lampinen, Differential Evolution—A Practical Approach to Global Optimization, SpringerVerlag, Berlin, Germany, 2005.
 V.H. Nhu, N.D. Hoang, V.B. Duong, H.D. Vu, and D. Tien Bui, “A hybrid computational intelligence approach for predicting soil shear strength for urban housing construction: a case study at Vinhomes Imperia project, Hai Phong City (Vietnam),” Engineering with Computers, 2019. View at: Publisher Site  Google Scholar
 MathWork, Statistics and Machine Learning Toolbox User’s Guide, MathWork Inc., Natick, MA, USA, 2017, https://www.mathworks.com/help/pdf_doc/stats/stats.pdf.
 Z. Guo, X. Shao, Y. Xu, H. Miyazaki, W. Ohira, and R. Shibasaki, “Identification of village building via Google earth images and supervised machine learning methods,” Remote Sensing, vol. 8, no. 4, p. 271, 2016. View at: Publisher Site  Google Scholar
 D. G. Altman and J. M. Bland, “Statistics notes: diagnostic tests 2: predictive values,” BMJ, vol. 309, no. 6947, p. 102, 1994. View at: Publisher Site  Google Scholar
 T. Kawasaki, T. Iwamoto, M. Matsumoto et al., “A method for detecting damage of traffic marks by half celestial camera attached to cars,” in Proceedings of the 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, Coimbra, Portugal, July2015. View at: Google Scholar
 N.D. Hoang and Q.L. Nguyen, “Metaheuristic optimized edge detection for recognition of concrete wall cracks: a comparative study on the performances of roberts, prewitt, canny, and sobel algorithms,” Advances in Civil Engineering, vol. 2018, Article ID 7163580, 16 pages, 2018. View at: Publisher Site  Google Scholar
 J. Suykens, J. V. Gestel, J. D. Brabanter, B. D. Moor, and J. Vandewalle, Least Squares Support Vector Machines, World Scientific Publishing Co. Pte. Ltd., Singapore, 2002, ISBN13: 9789812381514.
 L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classifcation and Regression Trees, Wadsworth and Brooks, Montery, CA, USA, 1984, ISBN13: 9780412048418.
 D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning representations by backpropagating errors,” Nature, vol. 323, no. 6088, pp. 533–536, 1986. View at: Publisher Site  Google Scholar
 Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015. View at: Publisher Site  Google Scholar
 K. Khosravi, B. T. Pham, K. Chapi et al., “A comparative assessment of decision trees algorithms for flash flood susceptibility modeling at Haraz watershed, Northern Iran,” Science of the Total Environment, vol. 627, pp. 744–755, 2018. View at: Publisher Site  Google Scholar
 P.T. Ngo, N.D. Hoang, B. Pradhan et al., “A novel hybrid swarm optimized multilayer neural network for spatial prediction of flash floods in tropical areas using sentinel1 SAR imagery and geospatial data,” Sensors, vol. 18, no. 11, p. 3704, 2018. View at: Publisher Site  Google Scholar
 Z. Tong, J. Gao, A. Sha, L. Hu, and S. Li, “Convolutional neural network for asphalt pavement surface texture analysis,” ComputerAided Civil and Infrastructure Engineering, vol. 33, no. 12, pp. 1056–1072, 2018. View at: Publisher Site  Google Scholar
 J. Heaton, Introduction to Neural Networks for C#, Heaton Research, Inc., St. Louis, MO, USA, 2008.
 MathWorks, Image Processing Toolbox User’s Guide, MathWork Inc., Natick, MA, USA, 2016, https://www.mathworks.com/help/pdf_doc/images/images_tb.pdf.
 S. Sidney, NonParametric Statistics for the Behavioral Sciences, McGrawHill, New York, NY, USA, 1988, ISBN 0070573573.
 N.D. Hoang and D. T. Bui, “Predicting earthquakeinduced soil liquefaction based on a hybridization of kernel Fisher discriminant analysis and a least squares support vector machine: a multidataset study,” Bulletin of Engineering Geology and the Environment, vol. 77, no. 1, pp. 191–204, 2018. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2019 NhatDuc Hoang and VanDuc Tran. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.