Marine Engineering and ApplicationsView this Special Issue
Research Article | Open Access
Chan-Yun Yang, Liou-Chun Chang, Hooman Samani, Ryohei Nakatsu, "Ameliorated Austenite Carbon Content Control in Austempered Ductile Irons by Support Vector Regression", Mathematical Problems in Engineering, vol. 2013, Article ID 362601, 9 pages, 2013. https://doi.org/10.1155/2013/362601
Ameliorated Austenite Carbon Content Control in Austempered Ductile Irons by Support Vector Regression
Austempered ductile iron has emerged as a notable material in several engineering fields, including marine applications. The initial austenite carbon content after austenization transform but before austempering process for generating bainite matrix proved critical in controlling the resulted microstructure and thus mechanical properties. In this paper, support vector regression is employed in order to establish a relationship between the initial carbon concentration in the austenite with austenization temperature and alloy contents, thereby exercising improved control in the mechanical properties of the austempered ductile irons. Particularly, the paper emphasizes a methodology tailored to deal with a limited amount of available data with intrinsically contracted and skewed distribution. The collected information from a variety of data sources presents another challenge of highly uncertain variance. The authors present a hybrid model consisting of a procedure of a histogram equalizer and a procedure of a support-vector-machine (SVM-) based regression to gain a more robust relationship to respond to the challenges. The results show greatly improved accuracy of the proposed model in comparison to two former established methodologies. The sum squared error of the present model is less than one fifth of that of the two previous models.
Austempered ductile iron (ADI) is a specialty heat-treated material that takes advantage of the near-net shape technology and low-cost manufacturability of ductile iron castings to make a high-strength, low-cost, and excellent abrasion-resistant material. ADI has become an established alternative in many applications that were previously the exclusive domain of steel castings, forgings, weldments, powdered metals, and aluminum forgings and castings [1–6]. This material has been also proven to perform very well under different wear mechanisms such as rolling contact fatigue, adhesion, and abrasion [7, 8]. Considering the low-cost, design flexibility, flexible machinability, high strength-to-weight ratio and good toughness, wear resistance, and fatigue strength of ADI, its usage now is extended into marine application with increasing interest in the study of corrosion and coating of ADI [5, 9–12].
ADI is obtained by heat treating process of ductile irons to have bainite as matrix, which consists of strong bainitic ferrite platelets and tough high-carbon retained austenite, along with spheroidal graphite nodules [1–3]. The typical microstructure of ductile irons, shown in Figure 1(a), includes spheroidal graphite nodules and matrix surrounding them. The bainitic matrix of an austempered ductile iron  is illustrated in Figure 1(b). A significant amount of retained austenite is presented as the shape of films and blocks in the matrix.
The heat treatment for developing bainite matrix includes two steps. First, ductile irons are heated to austenization temperature () around 1550–1750°F to change the original matrix into austenite and then quenched down to the bainite formation temperature range (450–750°F) for one to three hours when bainitic ferrite grows isothermally at the expense of austenite before cooling down to ambient temperature [1–3, 13, 14]. The austenization reverses the matrix structure to high temperature austenite phase and in the meantime determines the initial carbon concentration in austenite () before austempering process, since the graphite modules in ductile irons are both a sink and source for carbon atoms. During the isothermal formation of bainite, termed as austempering process, bainitic ferrite forms in a displacive manner at the expense of austenite and partitions excessive carbon into surrounding austenite, which is gradually enriched during the process. The transformation process stops when the carbon content of austenite reaches a certain level which is impossible for the transformation to proceed further thermodynamically, before all austenite is consumed [14–16].
2. Role of Austenization Temperature
The mechanical properties of ADI obtained from a given ductile iron are closely related to the microstructure, which can be controlled by manipulating austenization and austempering temperatures [1–5]. The initial carbon content in austenite (), which is dictated by austenization temperature (), has two significant consequences for the final microstructure of ADI. Firstly, affects the choice of austempering temperature since the temperature range for bainite formation is a strong function of carbon and, to a lesser extent, other alloy elements [13, 14, 17]. Furthermore, the austempering temperature is the most important aspect for controlling ADI’s mechanical properties since the nature of the bainitic ferrite formed at different temperatures is variable. Additionally, at a given austempering temperature, higher will result in a lower volume fraction of bainite which can be formed during the austempering process [18, 19]. Less bainite formation would lead to more retained austenite in the final microstructure as well as less carbon enrichment in retained austenite, resulting in more blocky shape of retained austenite, which is mechanically unstable and thus detrimental to mechanical properties .
There are two established empirical formulas for estimating . First one involves only austenization temperature and silicon content  as follows: where is in °C, and %Si denotes the weight percentage of the silicon content. The other one includes other common alloy contents  as follows: where %Mn, %Si, %Ni, %Cu, and %Mo denote the weight percentages of manganese, silicon, nickel, copper, and molybdenum contents, respectively. It has been indicated that both formulas can only achieve limited accuracy compared to experimental results . The unsatisfactory results of the models are not unexpected due to not only the rarity of available data but also their unspecified variance resulted from the different instruments and measuring methods employed in the respective sources of generating the data. It is clear, nonetheless, that the formulas employing merely linear multivariate regression are incapable of producing an accurate model. Moreover, an examination of the data points shows that the distributions of the corresponding features are seriously contracted and skewed. To gain a more reliable accuracy, an inversed lognormal histogram equalizer and a support-vector-machine-(SVM-) based regression are introduced to manipulate the data points. The histogram equalizer, as a preprocessor, is used to reduce the irregularity and enhance the contrast in the distribution of the data points. After equalizing the attribute contrast, an SVM-based regression is employed to fit the input with highly uncertain variance for a noise-tolerable relationship between the austenization temperature, , and the alloy content with the initial carbon concentration, . To introduce the model, the procedure of an inverse lognormal histogram equalizer for manipulating input data is outlined first, followed by the procedure of an SVM-based regression model. Finally, the established model and its prediction results are presented and compared with the previous models.
3. Regression Modeling
3.1. Histogram Equalization Preprocessor
In this study, the histogram equalizer is employed in order to derive a balanced contrast of the regression input attributes. Histogram equalizer is often utilized to increase the global contrast of two-dimensional digital images. Through a mapping operation, the corresponding intensities of an image can be distributed expansively on the corresponding histogram, and thus the discrimination of the details could increase. The characteristics of the enhanced expansiveness are therefore conducive to the applications in the areas such as X-ray, thermogram, and face detection images [21, 22]. The present study adopted the two-dimensional mapping to be one-dimensional case to influence the input attributes separately which are chemical compositions and . By taking the input attributes inspection in advance, the attributes show more or less imbalanced tendency in their distributed histogram. Due to a general assertion that skewed data distributions in nature favor a lognormal distribution , a lognormal distribution is asserted for fitting the attributes. An ideal histogram equalizer is designated to generate a uniform distributed histogram after the equalization. An inversed lognormal histogram equalizer, mapping the attributes from lognormal to uniform distribution, is, hence, employed to deal with the attributes’ imbalanced tendency.
The lognormal distribution definition is as follows: where and are the natural logarithms of average and variance of corresponding , respectively. The inversed lognormal histogram equalizer can be given as The mapping is a conversion from lognormal distributed to uniform distributed by the inversed function . The uniform distributed is seeking wider and more balanced global contrast which is advantageous to the generation of the fitted function.
To compose a set of input features which contribute equivalently in the subsequent regression, the attributes should furthermore be normalized as follows:
3.2. Support Vector Regression
The SVM-based regression, known to deal with the generalized model of complex uncertain relationships, has been gaining popularity and has shown much improved results [24–26], albeit only few experimental data points, also called observations here, are available. The present study is aimed to employ the support vector regression (SVR) to obtain a more accurate relationship model between the initial carbon concentration in austenite with austenization temperature and alloy contents. Advantageous of the structural risk minimization [27, 28], the SVM-based method for regression [29–32], similar to that for classification [33, 34], simultaneously minimizes both the model complexity and empirical errors, and in turn creates a predictor with a wide margin. In classification, the wide margin represents a high generalization capability for separating unlabeled samples. On the other hand, the wide margin in regression represents a smooth approximation function in which variance from noises will be rejected as much as possible. In contrast to traditional statistical or ANN regression model which derives the approximation function by minimizing the training error between observed and corresponding predicted responses, the SVR attempts to minimize a generalization error which combines the training error and a regularization term to control the model complexity. The generalization error mainly rejects the highly variant noises and achieves a rigid regression.
The SVR is intrinsically a kernel-based method . With a given learning set , an approximated function can be established for further prediction. In , denotes the -dimensional input vector,, , and denotes the corresponding target value of input , . By using the -insensitive loss function (Figure 2(a)) to regularize the degree of rigidness, the optimized can include all input within the boundary of deviation while keeping the boundary (a tube in space) as straight as possible (Figure 2(b)). The essentially regularized rigidness is beneficial to SVR in finding an optimized generalization for the regression. By introducing the kernel trick [34, 35], the regression function can be described as , where denotes a weight vector, , , denotes the bias term, and denotes a kernel function. Here, the kernel function is adopted to deal with the nonlinearity of the regression. Putting the elementary features together, the fitting of SVR can then be formally expressed as a primal convex optimization problem as follows: subject to where denotes the regularization factor, and slack variables and are introduced for allowing errors to cope with some infeasible constraints in the optimization and form a soft margin. Parameter associated with the -insensitive loss function, , controls error tolerance of the regression. The loss function defines the -tube which carries out the rigidness of the approximated function. So, the parameter affects the smoothness of the induced regression and the number of support vectors as well. On the other hand, the parameter controls the tradeoff between keeping the straightness of subsequent and limiting the deviations to be less than . Let and be the Lagrange multiplier vectors for the first two sets of constraints in (7), and take Lagrange of the primal problem of (6)-(7). The Wolfe dual  can be obtained by differentiating the Lagrange with respect to , as follows: subject to The functions in (8) and (9) become a quadratic optimization problem. The optimized and can therefore be obtained after the optimization procedure. To take advantage of the sparseness of support vectors [32, 35], only those ’s with nonzero ’s, called support vectors (SVs), are taken into account to form the consequent . With the SV, weight vector can be computed by , and therefore Several kernel functions have been introduced for SVR, including linear, polynomial, and Gaussian kernel [32, 35]. A straightforward way of selecting kernel function is to select the one which can reflect the natural tendency of the distributed data. In the study, a Gaussian kernel where denotes the width parameter of its corresponding basis function and was employed to adapt the nonlinearity of the present problem.
3.3. Flowchart of Proposed Model
Following the steps mentioned earlier, a flowchart for the whole proposed model is illustrated in Figure 3. Two steps, “data preparation” and “function approximation,” are enclosed mainly in the model. With the gathered input raw data, the model can generate an approximated function for estimating automatically.
4. Results and Discussions
Forty-two experimental data points of were collected from the literature [2, 37–44] for the study. The data points containing six original attributes, including (), (%Si), (%Mn), (%Mo), (%Ni), and (%Cu), were recorded to establish the relationship for prediction. The corresponding metrics of mean, variance, and skewness of the original attributes were determined, as listed in Table 1. The variance and skewness found are surprisingly undesirable, given the fact that these data points are collected from different sources, in which different instruments and measuring methods were employed.
To enhance the discriminative information contained in the attributes and to ensure their satisfactory global contrast, the inversed lognormal histogram equalizer was applied, mapping original attributes to equalized attributes . Figure 4 shows the normalized histograms of the attributes before and after the equalization. Corresponding metrics of the equalized attributes compared to those of the original attributes are also included in Table 1. This table illustrates that the skewness of the attributes, except for , are significantly reduced. With their values close to zero, the remapped attributes are less skewed and more evenly distributed in Figure 4. Moreover, the histogram examination of the attributes’ global contrast is followed by reviewing the panels in Figure 4. Compared with the equalized attributes , , and , the original attributes , , and are more widely spread in the global contrast. The unexpected spread may be due to the overequalization. To fulfill the objective of the study, a combination of the original and the equalized attributes with wider spread contrast was selected to make up the SVR input. Consequently, three original attributes , , and , together with three equalized attributes , , and , were chosen for further regression.
The attributes, consisting of the equalized and those original sets , , and , were then normalized into the range for consistent contribution to the learning process and form the input vector .
There are three adjustable parameters , , and during the SVR learning phase. To calibrate the parameters for an optimized model, the method of cross-validation (CV) has been undertaken. Following the cross-validation, the dataset was randomly partitioned into three groups, including 21 data points for training set, 11 data points for validation set, and 10 data points for test set. By the independence of the training and validation datasets, the cross-validation was taken through to pursuit the lowest generalization error and obtain the corresponding optimized parameters, namely, , , and . The model parameterized by , , and is the most generalized model for the prediction of . As presented in the previous section, the generalized model is resistant to the input noises. To select the most generalized model, the sum squared error and mean squared error are adopted to evaluate the errors in the cross-validation, where denotes the set-length of the chosen set, and and denote observed and corresponding predicted output responses, respectively.
Since there are three parameters for tuning, adaptively searching the whole parameter-space is inefficient and may converge in a slower rate. In this study, a grid-search method incorporated with priority steps was adopted to speed up the searching for the optimal solution. The width parameter, , for the basis function determines the nonlinear transformation of the input data. In general, the larger the width is, the more linearity the induced model will be. The parameter is a regularization factor for controlling the tradeoff between the training error and complexity of the induced model. A larger produces more penalties on the training error and induces a higher complexity for the model . These two parameters, and , are dominant parameters in SV machine and are designated to be determined first in the study. The ranges for of 5–25 and of 103–107 were selected for the grid-searching of () after some preliminary tests. With the and being determined, the cross-validation then seeks the optimal to achieve the most generalized model. In this study, a relative small value, ranging between–, was specified for seeking .
Figure 5 shows the cross-validated SSEs corresponding to the changes of , , and . From the panels, , , and were chosen as 107, 20, and 5 × 10-3, respectively, with the minimal SSE of 4.55 × 10-2. With these optimized parameters, the SVR model was then taken to certify the prediction capability by the standalone test dataset.
As indicated by the unit-slope graphs in Figure 6, which illustrates the discrepancies between predicted and experimental data, the SVR model established with the chosen parameters shows much improved accuracy compared with the two previous models shown in (1) and (2). The MSEs of the three models, not only with the validation dataset but also with the test dataset, are also detailed in Table 2. For example, the error of the test dataset for the present SVR model is only about one third to one fifth of the two previous models.
The present model illustrates a more accurate prediction of the initial carbon concentration in austenite after austenization but before austempering for heat treating ductile iron into ADI. With more accurate control of initial austenite carbon concentration, the austempering temperature can be appropriately selected to produce desired ADI microstructure after austempering and ultimately to meet target mechanical properties.
In the presented paper, support vector machine for regression was used to establish a relationship between the initial carbon concentration of austempered ductile irons after austenization () with (austenization temperature) and alloy contents in austempering processes. The results indicate that SVM regression greatly improved the accuracy of prediction in comparison to two established equations using linear regression. Overall accuracy (sum squared error) of the present method is five and eight times of those of the two previous models, respectively. A better control of has been proven to be critical in achieving desired microstructures and mechanical properties for ADI, which has been applied, among numerous fields, for many marine applications.
The present study also demonstrates the possibility of employing a similar procedure to deal with contracted and skewed observations with highly uncertain variance. SVR, characterized by highly noise resistant as well as flexible in compromising between accuracy and complexity, is one of the suitable algorithms to deal with observations collected from multiple sources, in which instruments and measurements vary wildly.
This work was supported by the grants from National Science Council of Taiwan, under Contracts NSC 100-2218-E-149-002 and NSC 99-2221-E-149-009. The authors would like to thank Hsin-Liang Tai for his great contribution to the paper, Professors Jui-Jen Chou and Daw-Kwei Leu for their useful comments for the studys, and Mohammad Arif for his help in formatting this paper.
- K. B. Rundman, D. J. Moore, K. L. Hayrynen, W. J. Dubensky, and T. N. Rouns, “The microstructure and mechanical properties of austempered ductile iron,” Journal of Heat Treating, vol. 5, no. 2, pp. 79–95, 1988.
- M. M. Shea and E. F. Ryntz, “Austempering nodular iron for optimum toughness,” AFS Transactions, vol. 94, pp. 683–688, 1986.
- R. C. Voigt and C. R. Loper, “Austempered ductile iron-process control and quality assurance,” Journal of Heat Treating, vol. 3, no. 4, pp. 291–309, 1984.
- K. L. Hayrynen, K. R. Brandenberg, and J. R. Keough, “Applications of austempered cast irons,” Transaction-American Foundrymens Society, vol. 2, pp. 929–938, 2002.
- T. R. Uma, J. B. Simha, and K. N. Murthy, “Influence of nickel on mechanical and slurry erosive wear behaviour of permanent moulded toughened austempered ductile iron,” Wear, vol. 271, no. 9-10, pp. 1378–1384, 2011.
- Y. Sahin, M. Erdogan, and V. Kilicli, “Wear behavior of austempered ductile irons with dual matrix structures,” Materials Science and Engineering A, vol. 444, no. 1-2, pp. 31–38, 2007.
- S. Laino, J. A. Sikora, and R. C. Dommarco, “Development of wear resistant carbidic austempered ductile iron (CADI),” Wear, vol. 265, no. 1-2, pp. 1–7, 2008.
- L. C. Chang, I. C. Hsui, L. H. Chen, and T. S. Lui, “A study on particle erosion behavior of ductile irons,” Scripta Materialia, vol. 52, no. 7, pp. 609–613, 2005.
- R. Venkatesan, M. A. Venkatasamy, T. A. Bhaskaran, E. S. Dwarakadasa, and M. Ravindran, “Corrosion of ferrous alloys in deep sea environments,” British Corrosion Journal, vol. 37, no. 4, pp. 257–266, 2002.
- J. Hemanth, “Solidification and corrosion behaviour of austempered chilled ductile iron,” Journal of Materials Processing Technology, vol. 101, no. 1, pp. 159–166, 2000.
- C. H. Hsu, J. K. Lu, and R. J. Tsai, “Characteristics of duplex surface coatings on austempered ductile iron substrates,” Surface and Coatings Technology, vol. 200, no. 20-21, pp. 5725–5732, 2006.
- H. Krawiec, B. Stypuła, J. Stoch, and M. Mikołajczyk, “Corrosion behaviour and structure of the surface layer formed on austempered ductile iron in concentrated sulphuric acid,” Corrosion Science, vol. 48, no. 3, pp. 595–607, 2006.
- T. N. Rouns, K. B. Rundman, and D. M. Moore, “On structure and properties of austempered ductile cast iron,” AFS Transactions, vol. 92, pp. 815–840, 1984.
- L. C. Chang, “An analysis of retained austenite in austempered ductile iron,” Metallurgical and Materials Transactions A, vol. 34, no. 2, pp. 211–217, 2003.
- L. C. Chang, “Carbon content of austenite in austempered ductile iron,” Scripta Materialia, vol. 39, no. 1, pp. 35–38, 1998.
- H. K. D. H. Bhadeshia and D. V. Edmonds, “The mechanism of bainite formation in steels,” Acta Metallurgica, vol. 28, no. 9, pp. 1265–1273, 1980.
- L. C. Chang, I. C. Hsui, L. H. Chen, and S. T. Lui, “Influence of austenization temperature on the erosion behavior of austempered ductile irons,” Journal of University of Science and Technology Beijing, vol. 15, no. 1, pp. 29–33, 2008.
- S. K. Putatunda and P. K. Gadicherla, “Influence of austenitizing temperature on fracture toughness of a low manganese austempered ductile iron (ADI) with ferritic as cast structure,” Materials Science and Engineering A, vol. 268, no. 1-2, pp. 15–31, 1999.
- N. Darwish and R. Elliott, “Austempering of low manganese ductile iron, part II influence of austenitising temperature,” Materials Science and Technology, vol. 9, pp. 586–602, 1993.
- F. Neumann, Research in Cast Iron, Gordon & Breach, London, UK, 1965, Edited by H. D. Merchant.
- R. C. Gonzalez and R. E. Woods, Digital Image Processing, Prentice-Hall, Upper Saddle River, NJ, USA, 2002.
- V. Štruc, J. Žibert, and N. Pavešić, “Histogram remapping as a preprocessing step for robust face recognition,” WSEAS Transactions on Information Science and Applications, vol. 6, no. 3, pp. 520–529, 2009.
- E. Limpert, W. A. Stahel, and M. Abbt, “Log-normal distributions across the sciences: keys and clues,” BioScience, vol. 51, no. 5, pp. 341–352, 2001.
- Y. B. Gong and S. F. Chen, “Gray cast iron strength prediction model based on support vector machine,” Zhuzao/Foundry, vol. 55, no. 7, pp. 711–714, 2006.
- X. Tang, L. Zhuang, and C. Jiang, “Prediction of silicon content in hot metal using support vector regression based on chaos particle swarm optimization,” Expert Systems with Applications, vol. 36, no. 9, pp. 11853–11857, 2009.
- Y. Liu, H. Yu, Z. Gao, and P. Li, “Improved online prediction of silicon content in iron making process using support vector regression with novel outlier detection,” Advanced Materials Research, vol. 154-155, pp. 251–255, 2011.
- V. N. Vapnik, Statistical Learning Theory, John Wiley & Sons, New York, NY, USA, 1998.
- V. N. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, NY, USA, 1995.
- V. Vapnik, S. E. Golowich, and A. J. Smola, “Support vector method for function approximation, regression estimation, and signal processing,” in Advances in Neural Information Processing Systems, M. Mozer, M. Jordan, and T. Petsche, Eds., vol. 9, pp. 281–287, MIT Press, Cambridge, Mass, USA, 1997.
- H. Drucker, C. J. C. Burges, and L. Kaufman, “Support vector regression machines,” in Advances in Neural Information Processing System, M. Mozer, M. Jordan, and T. Petsche, Eds., vol. 9, pp. 155–161, MIT Press, Cambridge, Mass, USA, 1997.
- B. Schölkopf, P. L. Bartlett, A. Smola, and R. Williamson, “Support vector regression with automatic accuracy control,” in Proceedings of the 8th International Conference on Artificial Neural Networks, pp. 111–116, 1998.
- A. J. Smola and B. Schölkopf, “A tutorial on support vector regression,” Tech. Rep. NeuroCOLT, NC-TR-98-030, University of London, London, UK, 1998.
- C. Cortes and V. Vapnik, “Support-vector networks,” Machine Learning, vol. 20, no. 3, pp. 273–297, 1995.
- C. J. C. Burges, “A tutorial on support vector machines for pattern recognition,” Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121–167, 1998.
- B. Schölkopf and A. J. Smola, Learning with Kernels, MIT Press, Cambridge, Mass, USA, 2002.
- R. Fletcher, Practical Methods of Optimization, A Wiley-Interscience Publication, John Wiley & Sons, Chichester, UK, 2nd edition, 1987.
- T. N. Rouns and K. B. Rundman, “Constitution of austempered ductile iron and kinetics of austempering,” AFS Transactions, vol. 95, pp. 851–874, 1987.
- K. B. Rundman and R. C. Klug, “An X-ray and metallographic study of an austempered ductile cast iron,” AFS Transactions, vol. 90, pp. 499–508, 1982.
- J. D. Verhoeven, A. EI Nagar, B. EI Sarnagawa, and D. P. Cornwell, “A study of austempered ductile cast iron,” in Proceedings of the Physical Metallurgy of Cast Iron, Materials Research Society Symposium, H. Fredriksson and M. Hillert, Eds., vol. 34, p. 387, 1985.
- G. Grech and J. M. Young, “Effect of Austenitising temperature on tensile properties of Cu-Ni austempered ductile iron,” Materials Science and Technology, vol. 6, pp. 415–421, 1990.
- N. Darwish and R. Elliott, “Austempering of low manganese ductile irons—part 1: processing window,” Materials Science and Technology, vol. 9, pp. 572–586, 1993.
- H. Nieswaag and J. W. Nijhof, “Influence of silicon on bainite transformation in ductile iron, relation to mechanical properties,” in Proceedings of the Physical Metallurgy of Cast Iron, Materials Research Society Symposium, H. Fredriksson and M. Hillert, Eds., vol. 34, pp. 411–415, 1985.
- E. Dorazil, High Strength Austempered Ductile Cast Iron, E. Horwood, New York, NY, USA, 1991.
- J. Aranzabal, I. Gutierrez, J. M. Rodriguez-Ibabe, and J. J. Urcola, “Influence of heat treatments on microstructure and toughness of austempered ductile iron,” Materials Science and Technology, vol. 8, no. 3, pp. 263–273, 1992.
Copyright © 2013 Chan-Yun Yang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.