Advances in Remote Sensing to Understand Extreme Hydrological Events
View this Special IssueResearch Article  Open Access
Assessing the Applicability of Random Forest, Stochastic Gradient Boosted Model, and Extreme Learning Machine Methods to the Quantitative Precipitation Estimation of the Radar Data: A Case Study to Gwangdeoksan Radar, South Korea, in 2018
Abstract
Machine learning algorithms should be tested for use in quantitative precipitation estimation models of rain radar data in South Korea because such an application can provide a more accurate estimate of rainfall than the conventional ZR relationshipbased model. The applicability of random forest, stochastic gradient boosted model, and extreme learning machine methods to quantitative precipitation estimation models was investigated using case studies with polarization radar data from Gwangdeoksan radar station. Various combinations of input variable sets were tested, and results showed that machine learning algorithms can be applied to build the quantitative precipitation estimation model of the polarization radar data in South Korea. The machine learningbased quantitative precipitation estimation models led to better performances than ZR relationshipbased models, particularly for heavy rainfall events. The extreme learning machine is considered the best of the algorithms used based on evaluation criteria.
1. Introduction
Quantitative precipitation estimation (QPE) using remote sensing data has been widely used to investigate the spatial characteristics of precipitation events [1, 2]. This method can be used to obtain rainfall estimation at ungauged locations, cloud characteristics, and areal rainfall depth [3–6]. The spatial resolution of rain radar data is the finest of all these. While the spatial resolution of satellite images is greater than approximately 10 km, the spatial resolution of rain radar data is approximately 1 km [7–9]. Because of the spatial resolution of rain radar data, it is often applied into rainfallrunoff modeling, particularly in terms of flash flood and urban flood modeling [10, 11]. The accurate forecast of these extreme hydrological events can mitigate damages on the hydraulic infrastructure and prevent the crisis of waterrelated disaster on human life. The accurate QPE of radar data is the key for the accurate forecast of extreme hydrological events.
Reflectivity and rainfall rate (ZR) relationshipbased models have been used broadly for QPE models of rain radar data [12–14]. Because ZR relationship can be changed based on the characteristics of the rainfall event and the radar instrument used, various methodologies are applied to build ZR relationshipbased QPE models and correct their estimations [15–18]. However, the ZR relationshipbased model still has high uncertainty in a rainfall estimation [19–21].
Machine learning (ML) algorithms have been widely employed to create functional relationships for natural phenomena and data processing. Many ML algorithms were developed and employed to model a function in fields such as meteorology, hydrology, and agriculture. Applications of ML algorithms can provide accurate models of natural phenomena [22–25] and thus can be good candidates for QPE of rain radar data. Recently, random forest (RF), stochastic gradient boosted model (GBM), and extreme learning machine (ELM) have been actively employed as ML algorithms [26–28]. These advanced ML algorithms, which have been tested recently, would increase our capacity to build QPE model. Chiang et al. [29], proposed a QPE model using a recurrent neural network and threedimensional radar data. They reported that the MLbased model produced more accurate estimations than the ZR relationbased model. Yu et al. [30] attempted to develop quantitative precipitation forecast (QPF) models of rain radar data using RF and support vector regression. Their proposed methodology focused on QPF models for typhoons in Taiwan and performed well.
To the best of our knowledge, advanced ML algorithms, e.g., RF, GBM, and ELM, have not been employed for QPE of rain radar data in South Korea. This should be resolved because applying ML algorithms may provide more accurate rainfall estimation of rain radar data than the conventional ZR relationbased model. Therefore, this study investigated the applicability of the ML algorithms for QPE using Gwangdeoksan radar station, South Korea, as a case study in order to enhance performance of QPE in radar data. RF, GBM, and ELM are the ML algorithms used; their applicability is investigated using four rainfall events, and their performances for the QPE model are compared. This study can provide fundamental information on the development of QPE model using ML algorithms in South Korea. Particularly, the characteristics of ML algorithm for QPE model of radar data can be briefly investigated in the study. This result can enhance our capacity to understanding ML algorithms in the QPE of radar data. In addition, the most plausible candidate among the employed QPE models will be selected for MLbased QPE model of radar data in South Korea. The selected QPE model can lead to improvements in accuracy of QPE, particularly in extreme rainfall events that cause extreme hydrological events. The improvement in accuracy of QPE may help to mitigate impacts from extreme hydrological events on the destruction of property and human life.
This paper is organized as follows. In Section 2, the characteristics of the radar and ground gauge rainfall data are presented. Section 3 presents a description of the methods employed, e.g., ZR relationship and ML algorithms. The application methodology for the case studies is presented in Section 4. In Section 5, the results of tested QPE models for all events and each event are presented. Finally, the conclusions are presented in Section 6.
2. Data
2.1. Radar and Ground Rainfall Gauge
Gwangdeoksan weather radar station, which has a dualpolarization weather radar with an Sband, is located on the border of Gyeonggido and Gangwondo provinces close to Seoul (latitude 38°7′2.5″, longitude 127°26′1″, and elevation 1064 m), the capital of the Republic of Korea. The observation range of the Gwangdeoksan radar is 240 km, which is enough to cover the northern part of South Korea. Radar data within the effective observation range, 100 km, are applied to QPE. Considering the high elevation of this radar station, the relationship between the radar and ground rainfall gauge data is increased with the application of PPI0. PPI (planposition indicator) is an intensitymodulated display on which echo signals are shown in plan view with range and azimuth angle displayed in polar coordinates. PPI0 is volume scanned data when the azimuth angle is 0 which represents a condition that can be observed by minimizing blocking in a flat state. Data with a spatial resolution of 1 km × 1 km and stored at 10minute interval are applied to estimate radar rainfall.
The three main polarization parameters of the radar, i.e., reflectivity, differential reflectivity, and specific differential phases, are applied to QPE in this study. Radar reflectivity refers to the ratio between the transmitted and received energies. The differential reflectivity is the ratio between horizontal and vertical radar reflectivity; it can provide information on the sizes and shapes of raindrops. Specific differential phases are the rate of change of the range in pulse phases, because these are not affected by attenuation, partial beam blockage, or radar miscalibration; they are an attractive parameter to use in QPE [31].
Rainfall rate data from ground gauge stations in Seoul and Gyeonggido province within the radar umbrella are analyzed in this study. All stations obtain rainfall data every minute, but the QPE in this study uses rainfall rate data at 10min intervals. This is to compare the radar data and to minimize the fluctuation of ground gauge data. Figure 1 shows the ground gauges densely distributed across the Korean peninsula; of these, 20 gauges within the radar effective range are selected. The number of 20 stations is located in near Seoul and had severe storm damage in the past. The location of Gwangdeoksan radar and the selected rainfall gauges are described in the zoomed area in Figure 1, and information on each station is given in Table 1. The used data can be downloaded from the data base of Korea Ministration Administration (KMA) at data.kma.go.kr.

2.2. Rainfall Events
Rainfall events for which the depth of the observed daily rainfall exceeded 30 mm from August to November 2018 are used. Four events are selected as case studies. Two events (the first and second) occurred from August 28–29 (event #1) and on September 3 (event #2). The third event occurred from October 5–6 (event #3), and the fourth event happened on November 8 (event #4). Heavy precipitation was observed in Korea, brought on by a rainy front (the Changma front) for event #1 and by low pressure in the northern area for event #2. Event #3 occurred as part of Typhoon KONGREY, and event #4 was accompanied by the collision of a cold and a warm front.
Table 2 summarizes information on the total rainfall, mean rainfall rate, and standard deviation for each event at the station in Seoul (#108). The amount of rain that fell during event #1 was the largest (larger than 100 mm) in two days. Both events #1 and #4 show that the weather front greatly affected the increase in rainfall or cloud formation. The average rainfall is very large in the rainy season and typhoons, such as in events #1 and #3. The largest variance was observed in event #1. This heavy rainfall during the rainy season is representative of the summer monsoon climate in South Korea.

3. Methods
3.1. ZR Relationship
Radar rainfall can be defined by the relationship between radar parameters and rainfall gauge data. A variety of synthetic algorithms have been proposed to estimate quantitative radar rainfall based on the polarization parameters applied [32, 33]. The basic form of the equation, which is wellknown as ZR relationship, is given as follows:where is the ground gauge rainfall rate (mm/h), are radar polarization parameters such as reflectivity, differential reflectivity, and specific differential phase, and are the parameters of the ZR relationship. The main radar polarization parameters are defined as the following equations:where is the radar reflectivity, (changed from mm^{6}m^{−3} to dBZ); and are horizontal and vertical reflectivity; DR is differential reflectivity (dB); KD is specific differential phase (deg km^{−1}); and and are phases of the radar beam pulse and given range, respectively. Because the ZR relationship stands on the physical phenomena, the results of ZR relationship can be used to interpret characteristics of precipitation events, unlike the ML algorithms. The ML algorithms used in this study are the predictive models. Though they can be used to predict rain rate, extracting physical meaning from the results is difficult. For example, the parameters of ZR relationship can be used to identify type of cloud, type of precipitation, and type of storm events. In the case of the ML algorithms, prediction models for each variable of interest such as type of cloud, type of precipitation, and type of storm events have to be individually built.
3.2. Machine Learning (ML) Algorithms
3.2.1. Random Forest
RF has been widely applied in regression and forecasting problems [34–37]. It was proposed by Breiman [38] and uses bagging (called bootstrapping in statistics) to build a number of decision trees with a controlled variance. Each decision tree in the RF is grown using randomly selected samples. Subsequently, the nodes in each tree use randomly selected features (called input variables). The RF has two major steps: (1) randomness and (2) ensemble learning. The randomness in the RF comes from random sampling of the entire data set, and the selection of features with which every classification and regression tree (CART) is built. The data set is randomly sampled with replacement to create a subset with which to train one CART. At each node, optimal split rule is determined by using the one of the randomly selected features from the employed features.
The ensemble learning method in the RF means that all individual decision trees in a collection of decision trees (called an ensemble) contribute to a final prediction. A training subset is created after the random selection step. The CART without pruning is used to construct a single decision tree. To grow K trees in the ensemble, this process (resampling a subset and training an individual tree) is repeated K times. The final predicted value comes from averaging the results of all the individual trees. The ranger library in r package is used to construct the RF model in the current study [39].
3.2.2. Stochastic Gradient Boosted Model
GBM is a method widely used in classification and regression problems; it was proposed by Friedman [40]. Decision stumps or regression trees are used widely as weak classifiers in the GBM [40–42]. In the GBM, weak learners are trained to decrease loss functions, e.g., mean square errors. Residuals in the former weak learners are used to train the current weak learners. Therefore, the value of the loss function in the current weak learners decreases. The bagging method is employed to reduce correlation between weak learners, and each weak learner is trained with subsets sampled without replacement from the entire data set. The final prediction is obtained by combining predictions by a set of weak learners.
The GBM and RF adapted ensemble learning with a decision tree model (the weak learner). Both models produce one prediction based on a combination of predictions from a set of weak learners. Though the methods seem to be similar, they are based on different concepts. The major difference between the GBM and RF is that the tree in the GBM is fit on the residual of a subset of the former trees while the RF trains a set of weak learners using a number of subsets. Therefore, the GBM can reduce bias of prediction while the RF method can reduce variance of prediction. Therefore, the RF can be trained in parallel computing, whereas the GBM cannot. The gbm library in r package (https://github.com/gbmdevelopers/gbm) is used to construct a GBM in the current study.
3.2.3. Regularized Extreme Learning Machine
ELM was originally developed and then extended to generalized singlehidden layer feedforward networks in which the hidden layer need not to be neuron alike. ELM is a singlelayer network in which the weights and biases between input and hidden layers are randomly generated [43]. Unlike traditional iterative learning algorithms, the randomly initiated input weights and biases of ELM remain fixed without need to iteratively tuned, and the output weights are determined analytically. Hence, the model can be trained in a single iteration which significantly reduces the training time of ELM and makes ELM efficient for online and realtime applications. The ELM can be formulized using the following equations:where , , and are the outputs, weight matrix between hidden and output layers, and the output vector of the hidden layer (called nonlinear feature mapping), respectively, andwhere , , , and are the activation function, weight matrix between the input to hidden layer, bias, and inputs, respectively. In the current study, the sigmoid function () is used as the activation function in the ELM. Since the weights () and bias () are randomly generated and the activation function () is known in the ELM, represents the deterministic variables from a data set. Thus, only needs to be estimated in the ELM.
In the ELM, finding an appropriate weight set is to avoid overfitting. Tuning weights in the ELM can be considered a fitting linear regression model using the ordinary least square method. Ridge regression was employed to attenuate multicollinearity in the data set by adding the norm of the parameters to the parameter estimations in the regression model [44]. The ELM model also adapted this strategy for weight tuning. The ELM attempts to perform better generalization by achieving the smallest training error and the smallest output weight norm. This minimization problem can take the form of ridge regression or regularized least squares as follows [45]:where the first term of the objective function is l_{2}, the norm regularization term that controls the complexity of the model; the second term is the training error associated with the learned model; and is a tuning parameter. The ELM gradient equation can be solved analytically, and the closedform solution can be written as follows:where is an identity matrix. The ELM models used in this study are the regularized ELM model.
4. Application Methodology
To examine the applicability of the three ML algorithms, their input variables and hyperparameters should be defined. Z, DR, and KD in the polarization radar data have been widely employed as input variables for the QPE model. Therefore, these variables are used as input variable candidates in the ML algorithms. The tested models with input variable combinations are presented in Table 3.

Three ML algorithms use variables from both lagzero (L0) and lagone (L1) radar data for input variable while lagzero and lagone radar data, respectively, are used to construct ZR relationships. Since radar data measure the amount of cloud in the air, there is a short time difference between radar data and ground gauge observation. The time difference depends on the precipitation event conditions such as wind speed, cloud movements, and types of cloud. As the ZR relationship cannot account for time lag in its formula, QPE models based on the ZR relationship are constructed using different timelag data and their appropriateness are investigated.
The ML algorithms can use both lagzero and lagone radar data simultaneously. In addition, the number of variables from the radar data (three) is much smaller than the number of data points (greater than thousands). A larger number of input variables might improve the predictability of the ML algorithms employed. Additionally, since this input variable setting can take the time lag in modeling into account automatically, additional processes such as the ZR relationship are unnecessary in MLbased models.
To evaluate the performances of the models constructed, the data set should be grouped into training and test data sets. The data from stations #112, #201, #400, #546, and #571 are used as randomly selected test data. The data at the other stations are used for the training data set. For the case of all events, the numbers of training and test data are 3652 and 1209, respectively. The numbers of training data for event 1 to 4 are 1079, 319, 1173, and 1081, respectively. The numbers of test data for event 1 to 4 are 318, 107, 441 and 343, respectively. To build a regression model using ML algorithms, their hyperparameters should be tuned. The number of the trees is the most sensitive hyperparameter for the RF and GBM [30]; hence, the number of trees for the RF and GBM are optimized. The tuning parameter and the number of hidden nodes are the hyperparameters of the ELM. The relationship between the tuning parameter and the number of hidden nodes presents a tradeoff relationship such as the Pareto frontier. Thus, after one parameter is fixed, another will be optimized. In this study, the tuning parameter is fixed (), and the number of hidden nodes is optimized.
In the current study, leaveoneout crossvalidation (LOOCV) is employed to optimize the hyperparameters of the three ML algorithms. The rootmeansquare error (RMSE) between the estimates and observations is calculated for the ML algorithms trained by the data set that does not include any station among all those in the training set. The expected numbers of train and test data are 3227 (approximate 94%) and 233 (approximate 6%), respectively. The fifteen models were trained, and their performances were evaluated using the test data set. The RMSEs without each station are calculated, and average value of these RMSEs is the criterion for measuring appropriateness of the hyperparameters. The results of the LOOCV are presented in Figure 2. The optimal numbers of the tree for the RF and GBM are 380 and 4200, respectively; any numbers greater than these do not lead to significant improvements in increasing the performance of the RF and GBM. The optimal number of hidden nodes for the ELM is 950. These numbers are used for the hyperparameters of ML algorithms.
(a)
(b)
(c)
QPE models are built for five case studies. The first case study uses all data including the four precipitation events. The other case studies built QPE models for each of the precipitation events. The first case study was carried out to evaluate the overall performances of the QPE models constructed. The results of the other case studies may provide detailed examinations of the performance of the different rainfall events. The RMSE, Pearson correlation, mean absolute error (MAE), mean bias (Mbias), and relative rootmeansquare error (RRMSE) are employed as evaluation criteria. Equation (7) gives the equation of the RMSE:where , , and n are ith radar estimation, ith observed precipitation data point, and the number of data points, respectively. The correlation can be calculated using the following equation:where and are the means of the radar estimates and observed precipitation data, respectively. MAE, Mbias, and RRMSE equations are given in equations (9)–(11), respectively.
5. Results
5.1. Overall Performance of the QPE Models
The overall performances of the constructed QPE models are evaluated using rainfall and radar data for all the events. The training and test data sets are constructed from the data set that included all the rainfall events. Evaluation criteria for the constructed QPE models are applied to the test data set. Results of evaluation criteria are presented in Figure 3. The MLbased models lead to lower RMSEs than ZR relationshipbased models.
(a)
(b)
(c)
(d)
(e)
When the number of input variables increases, the RMSE becomes smaller. For the ZR relationshipbased models, RMSEs of ZRL1based models are smaller than those of ZRL0based models. The result means that usage of lagdata may provide more information onto QPE of the employed radar data. Models that include all the available input variables lead to lowest RMSE values. The second lowest RMSE is observed for models that use Z and DR as input variables. Models using DR and KD lead to the largest RMSE. Based on RMSE, the ELM5 (using Z, DR, and KD) is the best model for QPE of the radar data. Correlation results are similar to the results of the RMSE. The MLbased models give larger correlations than ZR relationshipbased models. For correlation, the cases using all input variables provide the largest correlation values. Based on MAE, models using Z and DR as input variables lead to the smallest MAE. The best model based on MAE is the ELM2 (using Z and DR). Based on MBias, ZRL0based models are the best models, with an MBias close to zero. Estimations by ZRL1based models have positive biases except for the ZR4L1, while those of MLbased models have negative biases. RRMSEs of all employed QPE models are larger than 100%. Based on the RRMSEs, the ELM is the best model for QPE of radar data. The second best model is the RF.
Estimationverse observation plots are presented in Figure 4. Rainfall rate estimations are underestimated for large amounts of rainfall rates (larger than 40 mm/h). These underestimations for large amount of rainfall rate are clearly observed in the results of ZRL0based models. Mbias of ZRL0based models is close to zero. To meet the value of Mbias estimate, rainfall rate estimations for small and medium amounts of rainfall rates are overestimated. Mbias of ZRL1based models have positive values, and estimations are underestimated for large amount of precipitation, which indicates that a large overestimation occurs for a small amount of precipitation. These overestimations also are observed in Figure 4. The ELM5 leads to the best estimation performance in Figure 4. Circles by the ELM5 are located closer to the diagonal line than other models, while ZR5L1 and GBM5 models seem to provide poor performances. The circle distribution for these models is Lshaped (orthogonal shape) in Figure 4.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
(k)
(l)
(m)
(n)
(o)
(p)
(q)
(r)
(s)
(t)
5.2. Performances of the Constructed QPE Models for SingleRainfall Events
Parameters of ZR relationship differ depending on rainfall events characteristics. The performances of the QPE model differ from the rainfall events. Hence, to obtain an accurate QPE, the QPE model should be built for every rainfall event. To investigate the applicability and performance of QPE models, all the tested QPE models are built using data from each precipitation event. RMSEs of the tested QPE models for singlerainfall events are presented in Table 4. MLbased models are selected for the best models based on RMSEs. For events #1 and #2, the ELM5 and ELM3 lead to the lowest RMSEs, respectively. Based on RMSEs, RF2 and RF5 lead to the best performance for events #3 and #4, respectively. Overall, RMSEs of the models using Z and KD data are lower than those in the models using other input variable sets for event #2. For event #3, RMSEs of the models using Z and DR data are lower than the models using other input variable sets. Differences between RMSEs of ML and ZR relationshipbased models are very small in event #4. Although RF5 is selected as the best model in the event #4 based on RMSEs, the difference between RMSEs of RF5 and ZR5L1 is 0.01. Practically, the performances of ZRL1based models are the best for event #4 based on RMSEs.
 
Italicized numbers indicate the smallest RMSEs among those calculated during the same rainfall events. 
Table 5 presents the correlations of the tested QPE models for singlerainfall events. The correlations of the QPE models for events #1 and #2 are much larger than those for events #3 and #4. While the RMSEs of events #1 and #2 are larger than events #3 and #4, their correlations are higher than those of events #3 and #4. Results indicate that the QPE models lead to good estimation performance for heavy rainfall events. The largest correlation values are observed in MLbased models. ELM2 and ELM3 lead to the largest correlations for events #1 and #2, respectively. RF2 and RF5 provide the largest correlations for events #3 and #4, respectively. Results of MAE are similar to the results of RMSE. Based on Mbias, ZRL1, ZRL0, GBM, and ELMbased models lead to the best performance for events #1 to #4, respectively. Detailed MAE and MBias results are not contained in the current manuscript.
 
Italicized numbers indicate the largest correlations among those calculated during the same rainfall events. 
Table 6 presents the RRMSEs of the tested QPE models for singlerainfall events. The correlations of the QPE models for events #3 and #4 are smaller than those for events #1 and #2, unlike the results of RMSE and correlation. The smallest RRMSEs for events #1 and #2 (heavy rainfall events) are 71.8% and 68.1%, respectively. For events #3 and #4 (light rainfall events), the smallest RRMSEs are 60.6% and 63.0%, respectively. Overall difference between the smallest RRMSEs of heavy and light rainfall events are approximately 10%. The difference between the smallest RMSE of heavy and light rainfall events is approximately 4.3 mm/hr. Because 4.3 mm/hr is larger than the smallest RMSE of event #3, the RRMSE difference is relatively smaller than RMSE difference. The result indicates that the QPE models provide similar performances for heavy and light rainfall events based on RRMSE measures.
 
Italicized numbers indicate the smallest RRMSEs among those calculated during the same rainfall events. 
To evaluate the tested QPE models for singlerainfall events, rainfall rate estimation versus observation plots for event #1 and #4 is presented in Figures 5 and 6, respectively. The tested models excluding ZRL0based models lead to good estimation performances for event #1. Of the tested models, ELM5 gives the best estimation performance. Some circles are aligned to approximately 80 mm/h based on observations in Figure 5. This is a recurrent issue in QPE of rain radar data. When the observed rainfall rates are the same but the observed parameters of radar data are different, this phenomenon occurs. This result indicates that all tested QPE models cannot solve this issue. For event #4 in Figure 6, all the tested QPE models lead to poor performances of rainfall rate estimation. In the observed small magnitude of rainfall rates, the QPE models tend to overestimate rainfall rates. On the other hand, the QPE models provide an underestimation for the observed large magnitude of rainfall rates. Five lines are observed at approximately 3 mm/h, 6 mm/h, 9 mm/h, 12 mm/h, and 15 mm/h based on observations in all the subfigures presented in Figure 6. The observed rainfall depths for these small rainfall rates are 0.5 mm, 1 mm, 1.5 mm, 2 mm, and 2.5 mm, and their duration is 10 minutes. Because event #4 is light, a large number of small rainfall rates are observed. The phenomena wherein parameters of radar are different for the same amount of observed rainfall rate occur frequently. Due to this phenomenon, the tested QPE models show poor performances in event #4.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
(k)
(l)
(m)
(n)
(o)
(p)
(q)
(r)
(s)
(t)
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
(k)
(l)
(m)
(n)
(o)
(p)
(q)
(r)
(s)
(t)
Radar rainfall rate fields for events #1 and #4 are illustrated to investigate the difference between ZR relation and MLbased models in Figures 7 and 8. Figure 7 presents radar rainfall rate fields of event #1 at 20 : 10, 28^{th} August 2018. The range of rainfall rates is from 0 to 100 mm/h for event #1. The MLbased QPE models provide larger magnitudes of rainfall rates for very small magnitudes of rainfall rates based on estimates by ZR2L1. For heavy magnitudes of rainfall rates, estimates of all QPE models are similar. The GBM leads to the largest magnitude of rainfall rate estimation in Figure 7. Rainfall rate estimates on ground gauge stations for the ZR2L1 are larger than those of MLbased models. Due to the high magnitude of rainfall rate at these points, the ZR2L1 overestimates rainfall rate in Figure 3. In areas where there are no ground gauge stations, the ZR2L1 estimates smaller rainfall rates than other models. Figure 8 presents radar rainfall rate fields of event #4 at 12 : 40, 8^{th} November 2018. Rainfall rates range from 0 to 15 mm/h for event #4. Overall results of rainfall rate estimates by the tested models are similar to the results shown in Figure 7. The ELM leads to the largest magnitude of rainfall rate estimation.
(a)
(b)
(c)
(d)
(a)
(b)
(c)
(d)
6. Discussion
The comparison results of the ZR relationship and MLbased models show that the application of ML algorithms can lead to an improvement in the QPE of radar data in the tested rainfall events. This result supports the notion that the ML algorithm could be used in the development of QPE models of radar data in South Korea. Increasing the number of variables for the input variables of the ZR relationshipbased models results in very small improvements. In some events, this increment does not improve performances of QPE models. It can be inferred that Z is the most critical variable for the ZR relationshipbased model. Additionally, the application of other variables is often an inefficient way to build the ZR relationshipbased model.
The performances of the MLbased models improve when Z and additional variables such as DR and KD are applied as input variables. In particular, a combination of Z and DR for input variables of the MLbased models leads to a good QPE performance. Studies have reported that this combination leads to the best performance among combinations of Z, DR, and KD for the ZR relationshipbased model [46, 47]. In many cases, application of DR, except for combinations of DR and KD, lead to a large improvement in the QPE using the MLbased model, unlike the ZR relationshipbased model. The results imply that the MLbased models could consider other variables in QPE. Because the MLbased model can extract a large amount of information from the input variables and use this information in QPE of rain radar data, performances of the MLbased models may be better than those of ZR relationshipbased models. Based on results of RMSE for individual events, the RF model with three variables provided the smallest RMSEs in events #2 and #4. Otherwise, RMSEs of other RF models were smaller than those of the RF model with three variables. In addition, there is a very small difference (0.06 mm/hr) between RSMEs of RF models with three variables and with Z and KD. The RF model with Z and KD is the best model when taking into consideration of parsimony for event #2. Hence, the RF model with three variables can be considered for suboptimal in events #1, #2, and #3.
Computation times to build QPE models differ depending on the ML algorithms employed. RF has the shortest computation time, and its computation time with the data sets of all events is approximately 1 minute. The computation times of the GBM and ELM are approximately 7 minutes and 3 minutes, respectively. As the measuring interval of rainfall data is 10 minutes, the computation time should be shorter than 5 minutes. The RF and ELMbased models proposed in the current study can be applied for QPE, but the GBM has to be modified before application.
Based on the results of this study, a comparison of the performances of the employed algorithms can be carried out. The ELM leads to the best performance for the case that includes all the events. For single events, the best algorithms are different. The ELM provides a good performance for heavy rainfall events, while the RF is considered a good algorithm for light rainfall events. The difference in performance between the RF and ELM is small in the light rainfall events. Hence, the best ML algorithm for case studies performed in the current study is the ELM. Each ML algorithm tested in this study uses popular setting. The comparison results of the ML algorithm for QPE models can be altered by adopted setting and used data. For example, in this study, the CART is used for the decision tree in the RF. Other decision tree models can be used in the RF such as inference dichotomiser 3 and chisquared automatic iteration detection. RF with other decision tree models can outperform to the ELM model for QPE in South Korea. Thus, the results in the current study should be restricted to these data sets and the ML algorithms with adopted setting.
Variation of neural network models like artificial neural, recurrent neural, and deep neural networks may have a high applicability building QPE models of radar data in South Korea, because the ELM is developed based on a neural network. Additionally, enhancing the precision of rainfall gauges may lead to improvements in the performance of QPE models for light rainfall events. Precision for some of the employed rainfall gauges is 3 mm/hr. Although this precision is good enough to measure rainfall rates for long duration or heavy rainfall events, it should be higher for estimating rainfall rates of light rainfall events. For example, when parameters of radar data for two points are different but their observed rainfall rates are the same, the QPE model has to fail estimations of rainfall rates at two points. If the precision of the rainfall gauge increases, the observed rainfall rates may be different and could result in a more accurate constructed QPE model. As shown in Figure 6, three lines can be observed in all the subfigures. Values of ground gauge for first, second, and third lines are 3, 6, and 9 mm/hr. These three lines indicate that the observed rainfall rates at ground gauge station are the same when the parameters of radar data are different. If precisions of these gauge stations become better, these lines may be disappeared and the data points in the lines are dissipated. This dispersion of data points, caused by the high precision of measuring instrument, may lead to improvement of the performance of QPE models for light rainfall event.
The tested QPE models lead to good performances for heavy rainfall events but not for light rainfall events. This characteristic of QPE with rain radar data is also observed in this study. MLbased QPE models outperform ZR relationshipbased models for events #3 and #4, albeit insignificantly. As mentioned above, the MLbased QPE models show good performances by efficiently extracting information from given radar data. If additional variables can be applied in QPE models, the performance of the QPE model may improve, particularly for light rainfall events. Thus, various sets of input variables that are frequently used in conventional QPE algorithms should be tested for MLbased QPE models to improve the performance of QPE models for light rainfall events.
7. Conclusions
The applicability of three ML algorithms in QPE models is investigated using case studies of polarization radar data of four rainfall events from Gwangdeoksan radar station, Gyeonggido, South Korea. Various combinations of input variable sets are also tested for QPE models. Conventional ZR relationbased models are also constructed and compared to MLbased models. In the current study, we reach the following conclusions:(1)ML algorithms can be applied to build a QPE model of polarization radar data. Overall, the MLbased QPE models outperform or are equal to ZR relationshipbased models. ML algorithms can extract information from radar data more efficiently than the ZR relationship, which leads to an improvement in QPE of the radar data.(2)Application of the ML algorithms for QPE models improves rainfall rate estimations for heavy events in South Korea by far. The performances of the MLbased QPE model are significantly improved based on performances of ZR relationshipbased models for heavy rainfall events. This improvement will be helpful in modeling floods and forecasting flash floods.(3)ELM algorithm may be the best ML algorithm among the tested ML algorithm with the adopted setting for QPE models of radar data in South Korea. Overall, the ELM outperforms other tested QPE models in QPE of radar data employed in the current study. Based on evaluation results of singlerainfall events, the ELM also leads to the best performance in two heavy rainfall events. Although the ELM is not the best QPE model for the two light rainfall events, the performances of QPE models using ELM are comparable to other QPE models.
In the current study, four rainfall events in 2018 were employed to evaluate the applicability of ML algorithms for the QPE model of polarization radar data as the radar instrument in Gwangdeoksan radar was updated. Future rainfall events should be included in data sets to further investigate the applicability and characteristics of ML algorithms in the QPE of polarization radar data in South Korea. In addition, the applicability of ML algorithms for QPF should be examined. Because ML algorithms show high applicability in QPE, they make good candidates for modeling functions between radar data and QPF.
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work was funded by the Korea Meteorological Administration Research and Development Program “Development of Application Technology on Atmospheric Research Aircraft” under Grant (1365003069).
References
 B. Martens, P. Cabus, I. De Jongh, and N. E. C. Verhoest, “Merging weather radar observations with groundbased measurements of rainfall using an adaptive multiquadric surface fitting algorithm,” Journal of Hydrology, vol. 500, pp. 84–96, 2013. View at: Publisher Site  Google Scholar
 S. Yang and S. W. Nesbitt, “Statistical properties of precipitation as observed by the TRMM precipitation radar,” Geophysical Research Letters, vol. 41, no. 15, pp. 5636–5643, 2014. View at: Publisher Site  Google Scholar
 W. F. Krajewski and J. A. Smith, “Radar hydrology: rainfall estimation,” Advances in Water Resources, vol. 25, no. 8–12, pp. 1387–1394, 2002. View at: Publisher Site  Google Scholar
 J. Kim, J. Lee, D. Kim, and B. Kang, “The role of rainfall spatial variability in estimating areal reduction factors,” Journal of Hydrology, vol. 568, pp. 416–426, 2019. View at: Publisher Site  Google Scholar
 W. Cho, J. Lee, J. Park, and D. Kim, “Radar polygon method: an areal rainfall estimation based on radar rainfall imageries,” Stochastic Environmental Research and Risk Assessment, vol. 31, no. 1, pp. 275–289, 2017. View at: Publisher Site  Google Scholar
 T. Park, T. Lee, D. Ko, J. Shin, and D. Lee, “Assessing spatially dependent errors in radar rainfall estimates for rainfallrunoff simulation,” Stochastic Environmental Research and Risk Assessment, vol. 31, no. 7, pp. 1823–1838, 2016. View at: Publisher Site  Google Scholar
 J. Simpson, R. F. Adler, and G. R. North, “A proposed tropical rainfall measuring mission (TRMM) satellite,” Bulletin of the American Meteorological Society, vol. 69, no. 3, pp. 278–295, 1988. View at: Publisher Site  Google Scholar
 R. J. Joyce, J. E. Janowiak, P. A. Arkin, and P. Xie, “CMORPH: a method that produces global precipitation estimates from passive microwave and infrared data at high spatial and temporal resolution,” Journal of Hydrometeorology, vol. 5, no. 3, pp. 487–503, 2004. View at: Publisher Site  Google Scholar
 Y. Wang and V. Chandrasekar, “Quantitative precipitation estimation in the CASA Xband dualpolarization radar network,” Journal of Atmospheric and Oceanic Technology, vol. 27, no. 10, pp. 1665–1676, 2010. View at: Publisher Site  Google Scholar
 G. Delrieu, I. Braud, A. Berne et al., “Weather radar and hydrology,” Advances in Water Resources, vol. 32, no. 7, pp. 969–974, 2009. View at: Publisher Site  Google Scholar
 T. Lee, J. Shin, T. Park, and D. Lee, “Basin rotation method for analyzing the directional influence of moving storms on basin response,” Stochastic Environmental Research and Risk Assessment, vol. 29, no. 1, pp. 251–263, 2015. View at: Publisher Site  Google Scholar
 N. Balakrishnan, D. S. Zrnić, J. Goldhirsh, and J. Rowland, “Comparison of simulated rain rates from disdrometer data employing polarimetric radar algorithms,” Journal of Atmospheric and Oceanic Technology, vol. 6, no. 3, pp. 476–486, 1989. View at: Publisher Site  Google Scholar
 A. V. Ryzhkov and D. S. Zrnić, “Comparison of dualpolarization radar estimators of rain,” Journal of Atmospheric and Oceanic Technology, vol. 12, no. 2, pp. 249–256, 1995. View at: Publisher Site  Google Scholar
 S. Verrier, L. Barthès, and C. Mallet, “Theoretical and empirical scale dependency of ZR relationships: evidence, impacts, and correction,” Journal of Geophysical Research: Atmospheres, vol. 118, no. 14, pp. 7435–7449, 2013. View at: Publisher Site  Google Scholar
 J. A. Smith and W. F. Krajewski, “Estimation of the mean field bias of radar rainfall estimates,” Journal of Applied Meteorology, vol. 30, no. 4, pp. 397–412, 1991. View at: Publisher Site  Google Scholar
 M.K. Suk, K.H. Chang, J.W. Cha, and K.E. Kim, “Operational realtime adjustment of radar rainfall estimation over the South Korea region,” Journal of the Meteorological Society of Japan. Ser. II, vol. 91, no. 4, pp. 545–554, 2013. View at: Publisher Site  Google Scholar
 C. Yoo, C. Park, J. Yoon, and J. Kim, “Interpretation of meanfield bias correction of radar rain rate using the concept of linear regression,” Hydrological Processes, vol. 28, no. 19, pp. 5081–5092, 2014. View at: Publisher Site  Google Scholar
 L. Yang, Y. Yang, P. Liu, and L. Wang, “RadarDerived quantitative precipitation estimation based on precipitation classification,” Advances in Meteorology, vol. 2016, Article ID 2457489, 16 pages, 2016. View at: Publisher Site  Google Scholar
 D.J. Seo and J. A. Smith, “Rainfall estimation using raingages and radar—A Bayesian approach: 1. Derivation of estimators,” Stochastic Hydrology and Hydraulics, vol. 5, no. 1, pp. 17–29, 1991. View at: Publisher Site  Google Scholar
 D.J. Seo and J. A. Smith, “Rainfall estimation using raingages and radar—A Bayesian approach: 2. An application,” Stochastic Hydrology and Hydraulics, vol. 5, no. 1, pp. 31–44, 1991. View at: Publisher Site  Google Scholar
 Q. Dai, M. A. RicoRamirez, D. Han, T. Islam, and S. Liguori, “Probabilistic radar rainfall nowcasts using empirical and theoretical uncertainty models,” Hydrological Processes, vol. 29, no. 1, pp. 66–79, 2013. View at: Publisher Site  Google Scholar
 A. Mosavi, P. Ozturk, and K.w. Chau, “Flood prediction using machine learning models: literature review,” Water, vol. 10, no. 11, p. 1536, 2018. View at: Publisher Site  Google Scholar
 P. Ganguli and M. J. Reddy, “Ensemble prediction of regional droughts using climate inputs and SVMcopula approach,” Hydrological Processes, vol. 28, no. 19, pp. 4989–5009, 2013. View at: Publisher Site  Google Scholar
 D. J. Gagne II, A. McGovern, and M. Xue, “Machine learning enhancement of stormscale ensemble probabilistic quantitative precipitation forecasts,” Weather and Forecasting, vol. 29, no. 4, pp. 1024–1043, 2014. View at: Publisher Site  Google Scholar
 Y. Tao, X. Gao, A. Ihler, S. Sorooshian, and K. Hsu, “Precipitation identification with bispectral satellite information using deep learning approaches,” Journal of Hydrometeorology, vol. 18, no. 5, pp. 1271–1283, 2017. View at: Publisher Site  Google Scholar
 X. Lu, Y. Ju, L. Wu, J. Fan, F. Zhang, and Z. Li, “Daily pan evaporation modeling from local and crossstation data using three treebased machine learning models,” Journal of Hydrology, vol. 566, pp. 668–684, 2018. View at: Publisher Site  Google Scholar
 B. T. Nolan, C. T. Green, P. F. Juckem, L. Liao, and J. E. Reddy, “Metamodeling and mapping of nitrate flux in the unsaturated zone and groundwater, Wisconsin, USA,” Journal of Hydrology, vol. 559, pp. 428–441, 2018. View at: Publisher Site  Google Scholar
 H. I. Erdal and O. Karakurt, “Advancing monthly streamflow prediction accuracy of CART models using ensemble learning paradigms,” Journal of Hydrology, vol. 477, pp. 119–128, 2013. View at: Publisher Site  Google Scholar
 Y.M. Chiang, F.J. Chang, B. J.D. Jou, and P.F. Lin, “Dynamic ANN for precipitation estimation and forecasting from radar observations,” Journal of Hydrology, vol. 334, no. 12, pp. 250–261, 2007. View at: Publisher Site  Google Scholar
 P.S. Yu, T.C. Yang, S.Y. Chen, C.M. Kuo, and H.W. Tseng, “Comparison of random forests and support vector machine for realtime radarderived rainfall forecasting,” Journal of Hydrology, vol. 552, pp. 92–104, 2017. View at: Publisher Site  Google Scholar
 M. R. Kumjian, “Principles and applications of dualpolarization weather radar. Part I: description of the polarimetric radar variables,” Journal of Operational Meteorology, vol. 1, no. 19, pp. 226–242, 2013. View at: Publisher Site  Google Scholar
 A. V. Ryzhkov, S. E. Giangrande, and T. J. Schuur, “Rainfall estimation with a polarimetric prototype of WSR88d,” Journal of Applied Meteorology, vol. 44, no. 4, pp. 502–515, 2005. View at: Publisher Site  Google Scholar
 R. Cifelli, V. Chandrasekar, S. Lim, P. C. Kennedy, Y. Wang, and S. A. Rutledge, “A new dualpolarization radar rainfall algorithm: application in Colorado precipitation events,” Journal of Atmospheric and Oceanic Technology, vol. 28, no. 3, pp. 352–364, 2011. View at: Publisher Site  Google Scholar
 T. Yang, A. A. Asanjan, E. Welles, X. Gao, S. Sorooshian, and X. Liu, “Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information,” Water Resources Research, vol. 53, no. 4, pp. 2786–2812, 2017. View at: Publisher Site  Google Scholar
 J. Fan, W. Yue, L. Wu et al., “Evaluation of SVM, ELM and four treebased ensemble models for predicting daily reference evapotranspiration using limited meteorological data in different climates of China,” Agricultural and Forest Meteorology, vol. 263, pp. 225–241, 2018. View at: Publisher Site  Google Scholar
 B. Pang, J. Yue, G. Zhao, and Z. Xu, “Statistical downscaling of temperature with the random forest model,” Advances in Meteorology, vol. 2017, Article ID 7265178, 11 pages, 2017. View at: Publisher Site  Google Scholar
 C. Choi, J. Kim, J. Kim, D. Kim, Y. Bae, and H. S. Kim, “Development of heavy rain damage prediction model using machine learning based on big data,” Advances in Meteorology, vol. 2018, Article ID 5024930, 11 pages, 2018. View at: Publisher Site  Google Scholar
 L. Breiman, “Random forests,” Machine Learning, vol. 45, no. 1, pp. 5–32, 2001. View at: Google Scholar
 M. N. Wright and A. Ziegler, “Ranger: a fast implementation of random forests for high dimensional data in C++ and R,” Survival Analysis, vol. 77, no. 1, p. 17, 2017. View at: Publisher Site  Google Scholar
 J. H. Friedman, “Stochastic gradient boosting,” Computational Statistics & Data Analysis, vol. 38, no. 4, pp. 367–378, 2002. View at: Publisher Site  Google Scholar
 A. TorresBarrán, Á. Alonso, and J. R. Dorronsoro, “Regression tree ensembles for wind energy and solar radiation prediction,” Neurocomputing, vol. 326327, pp. 151–160, 2019. View at: Publisher Site  Google Scholar
 S. A. Naghibi, H. R. Pourghasemi, and B. Dixon, “GISbased groundwater potential mapping using boosted regression tree, classification and regression tree, and random forest machine learning models in Iran,” Environmental Monitoring and Assessment, vol. 188, no. 1, p. 44, 2016. View at: Publisher Site  Google Scholar
 G.B. Huang, Q.Y. Zhu, and C.K. Siew, “Extreme learning machine: theory and applications,” Neurocomputing, vol. 70, no. 1–3, pp. 489–501, 2006. View at: Publisher Site  Google Scholar
 M. Peña and H. van den Dool, “Consolidation of multimodel forecasts by ridge regression: application to pacific sea surface temperature,” Journal of Climate, vol. 21, no. 24, pp. 6521–6538, 2008. View at: Publisher Site  Google Scholar
 G. B. Huang, H. Zhou, X. Ding, and R. Zhang, “Extreme learning machine for regression and multiclass classification,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 42, no. 2, pp. 513–529, 2012. View at: Publisher Site  Google Scholar
 M. J. Simpson and N. I. Fox, “Dualpolarized quantitative precipitation estimation as a function of range,” Hydrology and Earth System Sciences, vol. 22, no. 6, pp. 3375–3389, 2018. View at: Publisher Site  Google Scholar
 B.C. Seo, B. Dolan, W. F. Krajewski, S. A. Rutledge, and W. Petersen, “Comparison of single and dualpolarizationbased rainfall estimates using NEXRAD data for the NASA Iowa flood studies project,” Journal of Hydrometeorology, vol. 16, no. 4, pp. 1658–1675, 2015. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2019 JuYoung Shin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.