Abstract

The comprehensive assessment of the Integrated Multi-satellitE Retrievals for the Global Precipitation Measurement (IMERG) V05B is important for benchmarking the product’s continued improvement and future development. The performance of IMERG V05B precipitation products was systematically evaluated using 542 precipitation gauges at multiple spatiotemporal scales from March 2014 to February 2017 over China. Moreover, IMERG V05B was compared with IMERG V04A, the Tropical Rainfall Measuring Mission (TRMM) 3B42, and the Climate Prediction Center Morphing technique (CMORPH)-CRT in this study. Categorical verification techniques and statistical methods are used to quantify their performance. Results illustrate the following. (1) Except for IMERG V04A’s severe underestimation over the Tibetan Plateau (TP) and Xinjiang (XJ) with high negative relative biases (RBs) and CMORPH-CRT’s overestimation over XJ with high positive RB, the four satellite-based precipitation products generally capture the same spatial patterns of precipitation over China. (2) At the annual scale over China, the IMERG products do not show an advantage over its predecessor (TRMM 3B42) in terms of RMSEs, RRMSEs, and Rs; meanwhile, the performance of IMERG products is worse than TRMM 3B42 in spring and summer according to the RMSE, RRMSE, and R metrics. Between the two IMERG products, IMERG V05B shows the anticipated improvement (over IMERG V04A) with a decrease in RMSE from 0.4496 to 0.4097 mm/day, a decrease of RRMSE from 16.95% to 15.44%, and an increase of R from 0.9689 to 0.9759 during the whole study period. Similar results are obtained at the seasonal scale. Among the four satellite products, CMORPH-CRT shows the worst seasonal performance with the highest RMSE (0.6247 mm/day), RRMSE (23.55%), and lowest R (0.9343) over China. (3) Over XJ and TP, IMERG V05B clearly improves the strong underestimation of precipitation in IMERG V04A with the RBs of 5.2% vs. −21.8% over XJ, and 2.78% vs. −46% over TP. Results at the annual scale are similar to those obtained at the seasonal scale, except for summer results over XJ. While, over the remaining subregions, the two IMERG products have a close performance; meanwhile, IMERG V04A slightly improves IMERG V05B’s overestimation according to RBs (except for HN) at the annual scale. However, all four products are unreliable over XJ at both an annual and seasonal scale. (4) Across all products, TRMM 3B42 best reproduces the probability density function (PDF) of daily precipitation intensity. (5) According to the categorical verification technique in this study, both IMERG products yield better results for the detection of precipitation events on the basis of probability of detection (POD) and critical success index (CSI) categorical evaluations compared to TRMM 3B42 and CMORPH-CRT over China and across most of the subregions. However, all four products have room for further improvement, especially in high-latitude and dry climate regions. These findings provide valuable feedback for both IMERG algorithm developers and data set users.

1. Introduction

Precipitation is a crucial component of the Earth’s water and energy cycles. Reliable and accurate precipitation information plays an important role in hydrology, climatology, and water resource management [111]. Rain gauge networks may provide relatively accurate precipitation measurements but with an uneven distribution of stations and limited spatial representativeness [12]. Likewise, ground-based weather radars provide precipitation estimates at relatively high spatiotemporal resolution, but with limited utility in mountainous and cold regions [4, 13]. Recently, global scale precipitation estimates have become feasible through the development of satellite remote sensing techniques, and a series of satellite-based precipitation products (CMORPH [14], the TRMM Multi-satellite Precipitation Analysis (TMPA) [15], and IMERG [16]) have been developed and released.

The CMORPH technique integrates direct microwave-based retrievals of precipitation rate with observations of cloud top motion dynamics derived from infrared (IR) data to estimate high-resolution (0.25°/8 km, 3 h/0.5 h) global precipitation rates (60° N-60° S). Many previous studies have evaluated the performance of CMORPH products [14, 1721]. These efforts are essential to improve retrieval algorithms and to benefit satellite sensors development.

Since the launch of the TRMM satellite on 27 November 1997, TRMM-based satellite precipitation products have undergone a series of major revisions and widely used in hydrological applications [2225]. After over 17 years of fruitful data gathering, the spacecraft was turned off and reentered the Earth’s atmosphere on June 15, 2015. TMPA products, which combine remote sensing data from various passive microwave (PMW) and infrared (IR) sensors with gauge accumulation corrections based on the Global Precipitation Climatology Center (GPCC) monthly gauge analysis, aim to provide the global precipitation estimates from 50° N to 50° S at the TRMM-era. TMPA products have been widely examined and were proved to obtain a splendid success [2629].

On 27 February 2014, the American National Aeronautics and Space Administration (NASA) and the Japan Aerospace Exploration Agency (JAXA) launched the Global Precipitation Measurement (GPM) Core Observatory satellite. The GPM mission relies on an international network of satellites to provide higher spatiotemporal resolution (0.1°, 30 min) global precipitation estimates (60° N–60° S at present and to be expanded to 90° N–90° S in future releases) than current TMPA products. IMERG is the Level 3 multi-satellite precipitation algorithm of GPM, which combines sporadic precipitation rate estimates acquired from a constellation of microwave sensors, (relatively) continuous IR-based observations from geosynchronous satellites, and gridded monthly gauge precipitation data. Being a continuation of the successful TRMM mission, the GPM Microwave Imager (GMI) and the Dual-frequency Precipitation Radar (DPR) are an extension of TRMM’s sensors. Relative to the TRMM precipitation radar, the DPR is more sensitive to light rainfall and snowfall.

The preliminary comparison was conducted between IMERG V03D and TMPA by Huffman et al. [30]. Results found that the two products are comparable over land. The IMERG products have been released recently, more comprehensive evaluations are still essential to better understand error characteristics of IMERG products. Some initial evaluations have been conducted over the world, such as India [31, 32], Singapore [33], Malaysia [34], a data-sparse mountainous watershed in Myanmar [35], Mekong river basin in Southeast Asia [36], and China [4, 13, 3739]. These studies revealed that the performance of IMERG precipitation products varies from place to place. For example, IMERG V04A severely underestimates precipitation over the Tibetan Plateau cold region and the arid Xinjiang region in China [13], while IMERG V04A shows good performance over Singapore [33]. Therefore, a critical evaluation of satellite-based precipitation products is vital to understand their capability in a specific region before any application.

The algorithm for IMERG was updated to version 05 on 13 November 2017 [40]. Hereinafter, this new IMERG version is referred to as “IMERG V05B.” A critical evaluation of IMERG V05B precipitation data is therefore required. With its large land area, complex topography, and diverse climate, China provides an important testbed for evaluating the quality of new remote sensing precipitation products. The eastern and northern parts of China are characterized by flat plains. The southeastern parts of China mainly consist of hilly regions. Deserts dominate the northwestern China, and high altitude mountain areas are distributed in the southwestern Chinese plateaus. Monsoon wind strongly influences seasonal climate variability. The precipitation regime of China is primarily influenced by the southwest and southeast monsoons originating from the Indian and Pacific Oceans, respectively [41]. The accuracy of precipitation estimation using satellites is highly influenced both by topography and climate. Our goal is to derive new insight into IMERG’s error characteristics and provide useful evaluation information for both IMERG algorithms developers and data users.

2. Study Areas, Datasets, and Methodology

2.1. Study Areas

With a size of 9.6 million km2 and located between 73° and 135° E and 18° and 53° N, China is characterized by complex topography with considerable variation and diverse climates. The study domain includes all of China with the exception of the South China Sea region (see Figure 1). Precipitation distribution of the southern and eastern parts of China is influenced by the Asian monsoon. In general, annual precipitation gradually increases from the northwest to southeast due to the Asian monsoon and complex terrain. Besides, given China's geographical location, the mainland China can be divided into four major climate districts including the subtropical monsoon climate (SMC), the monsoon climate of medium latitudes (MCML), the plateau climate, and the temperate continental monsoon climate (TCMC). The SMC covers the southeastern China characterized by the high precipitation. The spatial heterogeneity of precipitation over this region is also very high. Hence, for further analysis, it has been divided into three subregions (the Southeastern China (HN) region, the Changjiang (CJ) River Plain region and the southwest Yungui Plateau (YG) region) based on the spatial distribution of average annual precipitation and the distribution of mountain. These three subregions are all characterized by hot and wet summers and mild and dry winters. The Northeastern China (DB) region and the Northern China (HB) region are controlled by the MCML and belong to semihumid zone. However, although they both have hot-wet summers and cold-dry winters, the DB is characterized by the high latitude and the ice or snow cover in winter. The Xinjiang (XJ) region regarded as the arid region and the Northwestern China (XB) region known as the semiarid region are dominated by the TCMC. The Qinghai-Tibet Plateau (TP) cold region with an average elevation about 4500 m and complex terrain belongs to the plateau climate. All the eight subregions are shown in Figure 1. For more detailed information regarding the subregions, the readers can refer to the related studies [11, 13, 21, 37, 38, 42].

2.2. Gauge Precipitation Observations

The daily precipitation datasets of 542 separate automatic meteorological stations were provided and calibrated by CMA (the China Meteorological Administration). The spatial distribution of all meteorological stations is shown in Figure 1. These gauges were chosen for they contain no missing values between 12 March 2014 and 28 February 2017. The rain gauges which are sensitive to both liquid and solid precipitation monitor the measurements of precipitation 24 times every day. Daily precipitation was defined as accumulated precipitation depth over 24 h starting at 8 pm local time. The National Meteorological Information Center (NMIC) performed the strict quality control check in three levels including the removal of questionable data, extreme value masking, and internal consistency checks [18, 43]. In this study, ground-based product datasets of the entire study period were downloaded from http://data.cma.cn/.

Many satellite-based precipitation estimates integrate the GPCC precipitation gauge data to calibrate their products. To avoid misleading results, the reference precipitation dataset used for the assessment of any satellite-based precipitation estimates should be independent from the GPCC product. Therefore, in this study, over Mainland China, rain stations used to construct the GPCC product have been explicitly excluded from reference gauges used for validation. As a result, our reference gauges (542 gauges) can be considered fully independent of gauge-adjusted satellite-based precipitation estimates such as the IMERG and TRMM 3B42 products.

2.3. Satellite-Based Precipitation Datasets
2.3.1. CMORPH-CRT

The CMORPH products are generated by the NOAA (National Oceanic and Atmospheric Administration) Climate Prediction Center’s MORPHing technique. Recently, the NOAA Climate Prediction Center (CPC) reprocessed the CMORPH products. The original CMORPH version is called Version 0.x, and the reprocessed CMORPH version is called Version 1.0. The Version 1.0 products contain three individual rainfall products: (i) RAW (CMORPH-RAW), (ii) a bias-corrected product (CMORPH-CRT) and (iii) a gauge-satellite blended product (CMORPH-BLD). The CMORPH-RAW product is a satellite-only precipitation product based on PMW data with (high-temporal-resolution) IR imagery used to interpolate between successive PMW-derived rainfall intensity fields. Probability density function matching, which performs a bias reduction function, is applied to CMORPH-RAW to generate the CMORPH–CRT product. CMORPH-CRT precipitation estimates are then further calibrated via a gauge analysis using an optional interpolation technique to generate the CMORPH-BLD product. Here, 0.25°/3-hourly CMORPH-CRT products (00z, 03z, 06z, 09z, 12z, 15z, 18z, 21z) from March 2014 to February 2017 were utilized, and the three-hourly precipitation data were accumulated to daily values. The CMORPH-CRT 3-hourly precipitation files are forward on the hour given in their file name. For example, a “00z” –hour file represents accumulation of rainfall from 0:00 to 2:59. For a full description of the CMORPH algorithm and its applications, the reader is referred to Joyce et al. [44] and Habib et al. [45]. To obtain a daily-scale CMORPH-CRT product in accord with the time span of daily precipitation collection at the local weather stations (1200-1200 UTC), we assigned a full weight (1.0) for the “12z,” “15z,” “18z,” and “21z” files for the current day and the “00z,” “03z,” “06z,” and “09z” files for the next day. In this study, the CMORPH-CRT product datasets of the entire study period were downloaded from ftp://ftp.cpc.ncep.noaa.gov/precip/.

2.3.2. TRMM 3B42

The TMPA algorithm was designed by the NASA Goddard Space Flight Center (GSFC). The current TMPA version 7 produces two standard precipitation products (the gauged-adjusted, post real-time research product (TRMM 3B42), and the near real-time product (TRMM 3B42RT)). TRMM 3B42RT applies TRMM Microwave Imager (TMI) dataset for calibration while TRMM 3B42 Combined Instrument (TCI) estimates and GPCC monthly gauge precipitation products are utilized to calibrate TRMM 3B42 for better satellite-based precipitation estimation. Here, 3-hourly TRMM 3B42 products with a spatial resolution of 0.25° × 0.25° (00z, 03z, 06z, 09z, 12z, 15z, 18z, and 21z) from March 2014 to February 2017 were employed. The TRMM 3B42 3-hourly precipitation files are centered on the hour given in their file name. For example, a “12z” -hour file represents data from 1030 UTC to 1330 UTC. To obtain a daily-scale TRMM 3B42 product in accord with the time span of daily precipitation collection at the local weather stations (1200-1200 UTC), we assigned a half weight (0.5) to the “12z” files for the current and next days and defined a full weight (1.0) for the “15z,” “18z,” and “21z” files for the current day and the “00z,” “03z,” “06z,” and “09z” files for the next day.

2.3.3. IMERG V04A and IMERG V05B

The GPM mission, which is a collaborative effort conducted by NASA and JAXA, provides global precipitation estimates and is focused on providing an improved understanding (and therefore forecasting) of extreme weather events and weather systems. IMERG produces three different types of products including an early run (near real-time with a latency of 4 h), a late run (reprocessed near real-time with a latency of 12 h), and a final run product (gauged-adjusted with a latency of about 4 months). Both the half-hourly and monthly IMERG final run products have been released on a 0.1° × 0.1° spatial grid. As mentioned above, the IMERG algorithm has been upgraded to Version 05 recently. IMERG V04A and IMERG V05B precipitation products have been released in March 2017 and November 2017, respectively. For more detailed information regarding IMERG, the reader is referred to the IMERG Algorithm Theoretical Basis Document [16, 30, 40, 46]. In this study, the TRMM 3B42 and IMERG product datasets of the entire study period were downloaded from https://pmm.nasa.gov/data-access/downloads/gpm.

Relative to Version 04, Version 05 (1) uses a new GPROF (GPM Profiling Algorithm) to compute precipitation estimates for all microwave sensors as input; (2) provides GPROF estimates from all constellation members in the microwave-only precipitation field (high quality precipitation) over the fully global domain; (3) includes these fully global GPROF estimates in the complete precipitation fields (instantaneous precipitation-calibrated and instantaneous precipitation-uncalibrated) outside the standard IR domain (60° N-S), although without morphing or IR fill-in; (4) refines gauge error estimates to provide proper weighting when combined with satellite-only estimates; (5) adds quality index for all half-hourly and monthly products; and (6) does not include TMI (TRMM Microwave Imager) data. Additional information on differences between Versions 04 and 05 can be found in the V05 IMERG Final Run Release Notes [40].

Here, half-hourly final run IMERG V04A and IMERG V05B products were examined between March 2014 and February 2017. The daily IMERG products were generated by summing all 48 half–hourly precipitation estimates. Then, accumulation amounts were multiplied by a factor of 0.5 because the unit of the half-hourly products is in mm/h.

In order to conduct a fair comparison among the satellite-based precipitation estimates, both the two IMERG products (IMERG V04A and IMERG V05B) were resampled from 0.1° × 0.1° to 0.25° × 0.25° using the inverse distance weighting (IDW) interpolation method [47]. The resampled IMERG products are now referred as R-IMERG V04A and R-IMERG V05B, respectively. The IDW interpolation method was used to acquire the spatial rainfall distribution in previous studies [4, 26, 48]. For more detailed information regarding resampling, the reader is referred to Wei et al. [4]. Nevertheless, it should be recognized that its application may result in additional uncertainties.

Overall, CMORPH-CRT, R-IMERG V05B, R-IMERG V04A, and TRMM 3B42 were examined in this paper. Prior to any comparison, all four satellite-based precipitation estimates were aggregated to a 0.25° spatial and daily temporal resolution.

2.4. Methodology
2.4.1. Statistical Analysis

Many previous studies have utilized ground-based rain gauge observations to validate the accuracy of GPM-IMERG products [4, 13, 32, 3739, 49, 50]. In this study, the daily datasets from 542 separate automatic meteorological stations (Figure 1) in Mainland China were analyzed to evaluate the accuracy of the four satellite-based precipitation products during the period March 2014–February 2017. Satellite-based precipitation estimates acquired for 0.25° grid-boxes containing ground stations are compared with gauge-based precipitation observations. In cases where the satellite grid center was close to the ground station, a direct comparison was made. However, in cases where the ground station was surrounded by four grid cells but not particularly close to any of them, an average of the four satellite grid points around the station was used as the basis for comparison. The evaluation of four satellite-based precipitation estimates was conducted based on continuous statistical metrics and categorical statistical metrics. First, annual daily average precipitation analysis was performed. Second, in order to examine seasonal effects, the evaluation analysis was performed separately for each of the four seasons: spring (March to May), summer (June to August), autumn (September to November), and winter (December to February). For regional-based analysis, the whole Mainland China was divided into eight subregions.

To comprehensively evaluate satellite-based precipitation products using gauged precipitation observations, four error indexes: the Pearson linear correlation coefficient (R), Root Mean Square Error (RMSE), Relative Root Mean Square Error (RRMSE), and Relative Bias (RB) were adopted. The definition of these metrics can be found in Chen and Li [37] and Wei et al. [4].

R measures the linear agreement between satellite-based precipitation estimates and rain gauge observations. A perfect positive fit is reflected by a R value is 1, whereas a weak linear correlation is indicated by R that is close to zero. RMSE measures the absolute average error magnitude. Smaller values of RMSE reflect satellite-based precipitation estimates which are closer to the observations. RRMSE [5, 5153] normalizes daily precipitation RMSE by the mean daily precipitation of the gauge stations. When RRMSE is more than 50%, such satellite-based precipitation products are considered unreliable. This particular threshold was adopted in previous precipitation assessment studies [4, 37]. Positive values of RB denote an overestimation of the precipitation amount, while negative values describe an underestimation. We refer the reader to Yuan et al. [35], Chen and Li [37], and Ning et al. [54] for a more detailed description of these statistical indices.

2.4.2. Categorical Statistics

Another assessment technique of satellite-based precipitation estimates is using a contingency table that reflects the frequency of rain/no-rain estimates in both satellite and gauge-based products (Table 1).

To evaluate the precipitation detection capability, three widely applied categorical statistical metrics, the probability of detection (POD), the false alarm ratio (FAR), and the critical success index (CSI), were used. POD is known as the hit rate, which denotes the fraction of precipitation events correctly detected by the satellite among all actual precipitation events. A perfect POD score is 1. FAR represents the ratio of the false event among all the events detected by satellite. The ideal FAR score is 0. CSI describes the overall ratio of precipitation events correctly detected by the satellite. The optimal value is 1. POD, FAR, and CSI were calculated as follows:where H represents the number of times that observed rain is correctly detected by the satellite; M is the number of times that observed rain is not detected by the satellite; and F is the number of times that rain is detected by satellite but not observed by gauge. POD, FAR, and CSI were only calculated at grid-boxes in which ground stations are located. Here, a threshold of 0.5 mm/day is used to determine the occurrence of rainfall for any given day while computing categorical statistics.

3. Results and Analysis

3.1. Annual Daily Average Precipitation Analysis

Figure 2 shows mean daily precipitation estimates derived from ground rain gauges and four satellite-based precipitation estimates over China. Precipitation accumulation captures by the ground observations generally increase from the northwest (daily average precipitation <1 mm/day) to the southeast (daily average precipitation >3 mm/day) of China. R-IMERG V05B, TRMM 3B42, and CMORPH-CRT all generally perform well in capturing this coarse-scale pattern. However, finer-scale differences exist among the three satellite-based products. In particular, TRMM 3B42 and CMORPH-CRT show very high accumulated maxima at sporadic individual pixels. These isolated grid points of anomalous high precipitation are more pronounced for CMORPH-CRT than for TRMM 3B42. Meanwhile, R-IMERG V05B has a smoother rain pattern which may be attributed to the IMERG product’s finer spatiotemporal resolution (0.1°/half hour). The IMERG products also have more temporal samples of precipitation to efficiently average out anomalous value [37]. According to Figure 2 and the average surface precipitation values sampled over the TP (i.e., 1.1108 mm/day for R-IMERG V05B, 0.5553 mm/day for R-IMERG V04A, 1.2498 mm/day for TRMM 3B42, 1.2515 mm/day for CMORPH-CRT, respectively), R-IMERG V04A is significantly underestimating precipitation over the TP. The underestimation of IMERG V04A over the TP has been noted previously by Wei [4] and Zhao [13].

Figure 3 shows scatterplots and fit metrics for the R-IMERG V05B, R-IMERG V04A, TRMM 3B42, and CMORPH-CRT products versus ground-based rain gauge observations for the quantitative comparison of mean daily precipitation over Mainland China throughout the entire study period. According to the R, RMSE, and RRMSE metrics plotted in Figures 3(a) and 3(b), the performance of the R-IMERG V05B product is generally superior to that of the R-IMERG V04A over mainland China throughout the full study period. When compared with R-IMERG V04, the R-IMERG V05B product has a higher R (0.9759 for R-IMERG V05B vs. 0.9689 for R-IMERG V04A), a smaller RMSE (0.4097 mm/day for R-IMERG V05B vs. 0.4496 mm/day for R-IMERG V04A), a lower RRMSE (15.44% for R-IMERG V05B vs. 16.95 mm/day for R-IMERG V04A), and an inferior RB (5.53% for R-IMERG V05B vs. 2.14% for R-IMERG V04A). In comparison with the TRMM 3B42 product’s successor (R-IMERG V05B), TRMM 3B42 has an advantage over R-IMERG V05B based on all statistical metrics. Among the four satellite-based precipitation estimates, CMORPH-CRT has the worst performance with the lowest R (0.9343), the largest RMSE (0.6247 mm/day), and the highest RRMSE (23.55%). The RRMSEs of all four satellite-based precipitation products are far below 50%, so all four satellite-based precipitation estimates can be considered reliable over Mainland China during our study period.

Table 2 lists R, RB, RMSE, and RRMSE metrics for average daily precipitation throughout the entire study period for the four satellite-based precipitation estimates over our eight subregions. R-IMERG V04A improves R-IMERG V05B’s overestimation over XB with RBs falling from 8.71% to 1.66%. Meanwhile, R-IMERG V05B slightly overestimates precipitation over DB and HB subregions with RB values of 15.56% and 10.57%, respectively. Although this situation is improved in R-IMERG V04A, its RBs are still about 12.48% over DB and 9.08% over HB, while CMORPH-CRT shows relatively small RBs (0.7% over DB and 4.36% over HB). The R-IMERG V04A considerably underestimates the precipitation estimates over the XJ and TP subregions with the RBs (−21.8%, −46%, respectively). However, this underestimation has been greatly improved by R-IMERG V05B with RBs down to 5.2% in XJ and 2.78% in TP, respectively. So, the R-IMERG V05B product demonstrates a better performance than R-IMERG V04A over the XJ and TP subregions. The R-IMERG V05B product exhibits a slightly inferior performance than R-IMERG V04A over XB, DB, HB, and CJ with the slightly larger RBs, RMSEs, and RRMSEs. TRMM 3B42 has a slight advantage over both the two IMERG products with relatively smaller RMSEs and RRMSEs over XB, YG, and HB. However, R-IMERG V05B demonstrates better performance than TRMM 3B42, with slightly higher R and relatively smaller RB, RMSE, and RRMSE in XJ. The CMORPH-CRT product has the largest RMSEs and RRMSEs and lowest Rs among the four satellite-based products over XJ, XB, YG, CJ, and HN. Except for XJ and R-IMERG V04A over TP, RRMSEs of all four satellite-based precipitation estimates are far less than 50% for subregions. Conversely, all four satellite-based precipitation estimates are unreliable over the arid XJ region based on their mutual RRMSE values (54.91% for R-IMERG V05B, 69.78% for R-IMERG V04A, 57.87% for TRMM 3B42 and 116.7% for CMORPH-CRT, respectively). The reasons behind this unreliability may be related to high latitude or the poor detection ability of the shallow orographic precipitation for passive microwave and IR satellites [13, 38].

3.2. Seasonal Scale Precipitation Analysis

Over China, spatial patterns of daily average R-IMERG V05B, R-IMERG V04A, TRMM 3B42, and CMORPH-CRT precipitation estimates for each individual season (during the period March 2014–February 2017) are shown in Figure 4. In general, all four satellite-based products capture the general precipitation patterns for four seasons over most parts of China. Precipitation rates peak in summer, with slightly lower amounts falling during autumn. TRMM 3B42 (Figures 4(i)4(l)) and CMORPH-CRT (Figures 4(m)4(p)) contain isolated grid points of anomalously more precipitation in each season, just as shown previously in annual precipitation results.

In spring, the two IMERG products (Figures 4(a) and 4(e)) show more precipitation than the other two satellite-based products (Figures 4(i) and 4(m)) over the eastern DB region. Likewise in winter, the two IMERG products (Figures 4(d) and 4(h)) also show more precipitation than the other two satellite-based products (Figures 4(l) and 4(p)) in areas bordering CJ and HN. Compared with the R-IMERG V05B and gauge-based products, R-IMERG V04A underestimates precipitation over the XJ region for all seasons except summer based on daily average precipitation accumulations (0.464 mm/day, 0.468 mm/day, 0.31 mm/day in spring; 0.53 mm/day, 0.49 mm/day, 0.32 mm/day in Autumn; 0.22 mm/day, 0.2 mm/day, 0.04 mm/day in Winter for R-IMERG V05B, Gauge, and R-IMERG V04A, respectively). Relative to R-IMERG V05B, the R-IMERG V04A product exhibits a significant underestimation of the precipitation over TP in every season according to Figures 4(a)4(h), 4(q)4(t), and the mean surface precipitation (1.04 mm/day, 1 mm/day, 0.29 mm/day in spring; 3.14 mm/day, 3.17 mm/day, 2.04 mm/day in Summer; 1.32 mm/day, 1.33 mm/day, 0.61 mm/day in Autumn; 0.09 mm/day, 0.12 mm/day, 0.01 mm/day in Winter for R-IMERG V05B, Gauge and R-IMERG V04A, respectively).

Seasonal differences in precipitation estimates derived from the R-IMERG V05B, R-IMERG V04A, TRMM 3B42, and CMORPH-CRT products against rain gauge observations over mainland China have been summarized in Figure 5. During the annual average daily precipitation analysis showed earlier in Figure 3, R-IMERG V04A demonstrated worse performance than R-IMERG V05B over Mainland China. Likewise, at the seasonal scale, compared with R-IMERG V05B, R-IMERG V04A exhibits poorer performance versus rain gauge observations with the larger RMSEs (0.54 mm/day vs. 0.6 mm/day in spring; 0.88 mm/day vs. 0.95 mm/day in summer; 0.48 mm/day vs. 0.53 mm/day in autumn; and 0.257 mm/day vs. 0.26 mm/day in winter for R-IMERG V05B, and R-IMERG V04A, respectively), relative higher RRMSEs (20.05% vs. 22.15% in spring; 19% vs. 20.66% in summer; 20.1% vs. 22% in autumn; 29.45% vs. 30.26% in winter for R-IMERG V05B and R-IMERG V04A, respectively), and relative lower Rs (0.979 vs. 0.973 in spring; 0.95 vs. 0.94 in summer; 0.95 vs. 0.94 in autumn for R-IMERG V05B and R-IMERG V04A, respectively). Based on RMSE, RRMSE, and R metric results, TRMM 3B42 shows the best performance and CMORPH-CRT gives the worst performance among the four satellite-based precipitation estimates over Mainland China at the annual scale.

At the seasonal scale, among the four satellite-based precipitation estimates, TRMM 3B42 has the smallest RMSEs (0.53 mm/day for spring, 0.82 mm/day for summer), the lowest RRMSEs (19.75% for spring, 17.84% for summer) and the highest Rs (0.981 for spring, 0.96 for summer) in spring and summer while CMORPH-CRT has the largest RMSEs (ranging from 22.75% in summer to 102.58% in winter), highest RRMSEs (ranging from 0.71 mm/day in autumn to 1.05 mm/day in summer), and lowest Rs (ranging from 0.66 in winter to 0.95 in spring) in every season. At the same time, precipitation estimates from R-IMERG V05B are higher than the gauge observations and exhibit consistently positive RBs (from 4.27% in winter to 6.12% in autumn). Precipitation estimates from R-IMERG V04A and TRMM 3B42 are lower than gauge observations only in winter on the basis of RBs, while, CMORPH-CRT precipitation estimates are higher than the gauge observations only in spring according to RBs. The underestimation by the satellite-based products may be influenced by the presence of snow and ice-covered surfaces during the winter, which degrades the performance of PMW-based retrieval algorithms [55].

Except for CMORPH-CRT in winter, all RRMSEs for the four satellite-based precipitation estimates are less than 50%. If winter is removed, all RRMSEs are less than 30%. Hence, except for the specific instances noted above, all four satellite-based precipitation estimates are generally reliable and can effectively capture seasonal patterns in precipitation.

Table 3 lists R, RB, RMSE, and RRMSE values (subdivided by season) for daily average precipitation derived from the four satellite-based precipitation estimates against rain gauge observations over eight subregions. The R-IMERG V04A product shows a severe underestimation over XJ and TP (RB ranging from −31.41% in spring to −77.79% in winter over XJ, ranging from −33.99% in summer to −89.63% in winter over TP, respectively) in each season (except for summer in XJ). However, the R-IMERG V05B product obviously improves this earlier underestimation in every season over these two subregions. For example, R-IMERG V05B decreases the absolute RB by 30.61% over XJ and 65.83% over TP in spring. The underestimation of R-IMERG V04A in each season over XJ and the TP is also consistent with the earlier results during annual daily average precipitation analysis (see Section 3.1). The R-IMERG V05B product consistently demonstrates a better performance than R-IMERG V04A with higher Rs, smaller RBs (except for summer in XJ), RMSEs, and lower RRMSEs over XJ and the TP in all seasons. During annual daily average precipitation analysis, TRMM 3B42 has an advantage over R-IMERG V05B based on its smaller RMSE, RB, and RRMSE metrics (Figures 3(a) and 3(c)). On the regional scale, except for XJ and HN, TRMM 3B42 shows a better performance than R-IMERG V05B with lower RMSEs and RRMSEs (Table 2) over all subregions. At the seasonal scale, TRMM 3B42 outperforms R-IMERG V05B and demonstrates smaller RMSEs and RRMSEs in Table 3 (over TP, DB, HN, CJ, and HN in spring; over the seven subregions except for HB in summer; over the TP, XB, YG, and HN in autumn, respectively). However, in winter, TRMM 3B42 is inferior to R-IMERG V05B in terms of RMSEs and RRMSEs (in Table 3) over all the subregions (except for XJ and XB).

Over the XJ region, satellite-based precipitation estimates are unreliable for all seasons according to their RRMSEs (all more than 50%) in Table 3. This unreliability is in line with the result during annual daily average precipitation analysis (see Section 3.1). Except for XJ, all the satellite-based precipitation estimates are reliable in all regions with the RRMSEs less than 50% (except for R-IMERG V04A over the TP) during spring, summer, and autumn. However, in winter, both IMERG products are unreliable over XJ, TP, and XB with RRMSE ranging from 57.91% to 115.7%, TRMM 3B42 is unreliable over XJ, TP, YG, and DB with RRMSE ranging from 53.99% to 91.39%, and CMORPH-CRT is unreliable over the eight subregions (except for HN) with RRMSE ranging from 65.05% to 276.6%. In general, RRMSE results (in Table 3) indicate that all the satellite-based precipitation estimates have a relatively inferior performance in winter versus the other three seasons.

3.3. Probability Distribution Function of Precipitation Intensity Analysis

The probability distribution function of rain-rate concurrence (PDFc) can reveal detailed information on the spatiotemporal inhomogeneity of precipitation events and provide insight into the dependence of estimate errors on precipitation rate and the potential of these errors on hydrological applications. As a result, the distribution of rainfall frequencies with different intensities for rainfall events is used in many studies to evaluate the quality of satellite-based precipitation products [13, 38, 39]. Here, R-IMERG V05B, R-IMERG V04A, TRMM 3B42, and COMRPH-CRT is compared to gauge-based precipitation estimates over mainland China and the eight Chinese subregions during the whole study period (Figure 6).

As shown in Figure 6, both IMERG products and CMORPH-CRT overestimate the frequency of light precipitation (<1 mm/day) and show a slight underestimation in rain rate bins over 2 mm/day. This result may be related to the fact that the IMERG PMW- (passive microwave-) based algorithm excels at estimating heavy, convective precipitation events and struggles with the detection of the shallow and warm precipitation. Compared with R-IMERG V05B, R-IMERG V04A slightly overestimates light precipitation events (<1 mm/day) and underestimate precipitation events for rain rate bins greater than 10 mm/day over XJ, TP, YG, and HN. Meanwhile, R-IMERG V05B is closer to the PDF of gauges, indicating the improved detection capability of R-IMERG V05B compared to R-IMERG V04A. In addition, the two IMERG products have a closer performance over XB, DB, HB, and CJ. For all of mainland China, TRMM 3B42 agrees best with the PDFc of daily rain gauge estimates among all four satellite-based precipitation products (Figure 6(a)).

3.4. Contingency Statistics

Figure 7 compares spatial maps of POD, FAR, and CSI statistics for all four satellite-based precipitation products over Mainland China. The POD and CSI of these products show a similar spatial pattern in that they generally increase from the northwest to the southeast of mainland China. In contrast, FAR shows a decrease from the northwest to the southeast. In other words, four satellite-based precipitation estimates agree well with the gauge data over the eastern and southern parts of Mainland China because these regions have relatively more moderate and heavy precipitation events and relatively flatter topography. The four satellite-based precipitation estimates show a slightly inferior performance over the northern and western parts of China. This result may be related to multiple factors including complex topography and climate, the altitude in mountainous terrain, sparse and uneven rain gauge distribution in mountain areas, and our particular optional interpolation technique. In addition, finer-scale differences still exist among the four satellite-based products. For example, over XJ, R-IMERG V05B has an advantage over R-IMERG V04A based on their respective POD results (Figures 7(a) and 7(d)).

Figure 8 compares POD, FAR, and CSI performance statistics samples between the satellite-based precipitation estimates and the precipitation gauges over mainland China and eight subregions. In general, all the four satellite-based precipitation estimates have low PODs (<0.66) and CSIs (<0.44) and high FARs (>0.4) over various subregions, especially over XJ, XB, DB, and HB. At the regional scale, all four satellite-based precipitation estimates have a better performance over YG, CJ, and HN than over the other subregions (except for TP). Over TP, compared with the other three satellite-based precipitation estimates, R-IMERG V04A has a worse performance with a lower POD in Figure 8(a). For example, POD increased by 48.4% from R-IMERG V04A to R-IMERG V05B, 13.6% from R-IMERG V04A to TRMM 3B42, and 27.6% from R-IMERG V04A to CMORPH-CRT. This result is consistent with the precipitation occurrence results shown above in Figure 6(c). The two IMERG products demonstrate similar performance over all the eight subregions (except for XJ and TP) with the closer PODs, FARs, and CSIs. Over XJ and TP, compared to R-IMERG V04A, R-IMERG V05B demonstrates improved an improved capability for detecting precipitation events, as indicated by its larger POD (0.4213 vs. 0.2839 over XJ and 0.6364 vs. 0.458 over TP).

4. Discussion

A number of studies have already assessed the quality of satellite-based precipitation products over China [4, 13, 3739]. However, IMERG V05B was recently released on November 2017 and has not yet been widely assessed in relation to previously available satellite precipitation products. Here, both IMERG V05B and V04A precipitation estimates are evaluated alongside their predecessor products (TRMM 3B42 and CMORPH-CRT).

The CMORPH-CRT and TRMM 3B42 precipitation estimates are both bias-corrected using a rain gauge analysis. It should also be point out that the algorithm for the TRMM 3B42 does not remain static during the whole study period. It instead switched over to the GPM satellite observations after the TRMM satellite was decommissioned in March 2015. In addition, our study period overlaps the transition between TRMM and GPM input into the TRMM 3B42 dataset. Therefore, for the time after March 2015, this study compares different retrieval algorithms, as opposed to different data sets.

The performance of the IMERG V04A algorithm in this study is consistent with earlier findings in China [13] and over the Tibetan Plateau [4]. It is interesting to note that both IMERG precipitation products do not demonstrate an advantage over their predecessor (TRMM 3B42). Compared with IMERG V04A, the IMERG V05B product shows the expected superior performance over China. Among the four satellite precipitation products, CMORPH-CRT has the worst performance over China. The IMERG products slightly improve daily POD and CSI values relative to TRMM 3B42 and CMORPH-CRT. This result may be due to the fact that the DPR of IMERG is more sensitive to light rainfall. In addition, IMERG has a shorter temporal resolution of 30 min which is useful in capturing short-lived precipitation events. Finally, IMERG has a finer spatial resolution (0.1°) which increases its ability to detect fine-scale -precipitation events.

Comparisons presented here are against 542 separate automatic meteorological stations. This is a relatively small number to evaluate the performance of satellite products over the entire extent of mainland China. This small number also certainly increases sampling uncertainty present in our assessments. However, with IMERG equipped with dual-frequency precipitation radar, comparisons in performance of IMERG and its predecessors, TMPA and CMORPH, are necessary over highly variable climate regions across China. Furthermore, assessment of the two IMERG products is vital for further refinement of the IMERG product algorithm. Nevertheless, we should stress that additional work is needed to evaluate IMERG using more extensive ground-based measurements.

5. Summary and Conclusion

The IMERG algorithm incorporates the GPCC gauge analysis and a variety of precipitation observations from relevant satellite sensors to produce gridded precipitation estimates with 0.1° × 0.1° spatial and half-hourly temporal resolution. Here, we evaluate the quality of the latest IMERG version (V05B) over all of mainland China and eight Chinese subregions. As a point of reference, IMERG V04A, CMORPH-CRT, and TRMM 3B42 precipitation estimates are also evaluated in parallel with the IMERG V05B product. The quantitative analysis is based on comparisons with ground-based rain gauge measurements.

The main findings of this study are as follows:(1)The IMERG V05B product does not show an advantage over its predecessor (TRMM 3B42) with respect to RB, RMSE and RRMSE results shown in Figure 3 and Table 2 over China and most of the eight subregions (except for XJ, TP, and HN) at annual scale. Over XJ, TP, and HN, IMERG V05B performs better with smaller RBs compared to TRMM 3B42; this is especially true in XJ where IMERG V05B increases R from 0.69 to 0.72, decreases RMSE from 0.3 to 0.29 mm/day, decreases the absolute RB from 7% to 5.2%, and decreases RRMSE from 57.87% to 54.91 at the annual scale. Nevertheless, all the four satellite-based precipitation products are unreliable over the arid/semiarid XJ; therefore, algorithm developers should prioritize efforts to improve rainfall retrievals in arid areas. Across all of Mainland China, TRMM 3B42 has a slight advantage over the other three satellite-based precipitation products with the lowest RMSE (0.3947 mm/day), RRMSE (14.88%), and highest R (0.9759) at an annual time scale. The other products are ranked (from best to worst) as IMERG V05B, IMERG V04A, and CMORPH-CRT.(2)Overall, the IMERG V05B product demonstrates its expected superior performance over China with lower RMSE (0.4097 mm/day), RRMSE (15.44%), and higher R (0.9759) in Figure 3 compared with IMERG V04A in terms of a daily average precipitation analysis. Meanwhile, at the seasonal scale, IMERG V05B also has an advantage over IMERG V04A with smaller RMSEs (0.54 vs. 0.6 mm/day in spring, 0.88 vs. 0.95 mm/day in summer, 0.48 vs. 0.53 mm/day in autumn, and 0.257 vs. 0.26 mm/day in winter, respectively), RRMSEs (20.05% vs. 22.15% in spring, 19% vs. 20.66% in summer, 20.1% vs. 22% in autumn, and 29.45% vs. 30.26% in winter, respectively) and higher Rs (0.979 vs. 0.973 in spring, 0.95 vs. 0.94 in autumn, and 0.95 vs. 0.94 in winter, respectively). During the spring and summer, among the four satellite-based precipitation estimates, TRMM 3B42 shows the best performance with the lowest RMSEs (0.53 and 0.82 mm/day), smallest RRMSEs (19.75% and 17.84%), and the highest Rs (0.981 and 0.96). However, CMORPH-CRT has the worst performance with largest RMSEs, RRMSEs, and the lowest Rs in every season.(3)During annual daily average precipitation analysis, IMERG V04A severely underestimates average precipitation in western parts of China (XJ and TP); however, IMERG V05B demonstrates better RB performance than IMERG V04A (5.2% vs. −21.8% over XJ, 2.78% vs. −46% over TP, respectively). Compared with IMERG V05B and TRMM 3B42, IMERG V04A shows a comparable level of precipitation underestimation over XJ with a lower RB of −31.41% (−34.01%, −77.79%) based on the spring (autumn, winter) daily mean precipitation and an even worse performance over TP with a much lower RB of −69.78% (−33.99%, −52.7%, and −89.63%) based on spring (summer, autumn, and winter) daily average precipitation. In contrast, CMORPH-CRT overestimates precipitation over XJ in terms of annual-scale RB (21.9%).(4)All the four satellite-based precipitation estimates show a distinct overestimation based on calculated RBs in Table 2 over XB, YG, DB, HB, CJ, and HN (except for CMORPH-CRT over HN). For example, IMERG V05B overestimates precipitation with a RB of 8.71% (15.6% and 10.57%) over XB (DB and HB). Over these three subregions, all RBs of the other three satellite-based precipitation estimates are lower than the corresponding RBs for IMERG V05B, especially CMORPH-CRT improves the overestimation with RBs down to 0.7% over DB and 4.36% over HB, respectively. According to RBs listed in Table 3, compared with IMERG V05B, all the three satellite-based precipitation estimates have lower RBs over XB, DB, and HB during both the spring and autumn.(5)Over all of Mainland China, across all four seasons, the four satellite-based precipitation products all exhibit their largest RRMSEs (Figure 5) during winter. Similar results are seen over all eight subregions except for CMORPH-CRT over XJ. Therefore, in general, satellite-based precipitation estimates perform worse during winter relative to other seasons.(6)Judging by PDFc results, both IMERG products and CMORPH-CRT overestimate the frequency of light precipitation (less than 1 mm/day) and show a slight underestimation for rain rate bins greater than 2 mm/day over all of mainland China and in each of the our eight subregions. In general, among the four satellite precipitation products, TRMM 3B42 agrees best with PDFc results obtained from rain gauges.(7)All four satellite-based precipitation products demonstrate low POD (<0.66) and CSI (<0.44) scores and high value of of FAR (>0.4) over China and within each of our eight subregions. However, both IMERG products have better scores of POD and CSI than the other two satellite precipitation products over China and across most of the subregions except for IMERG V04A over XJ, TP, and XB (Figure 8).(8)IMERG eliminates anomalous values of TRMM 3B42 and CMORPH-CRT found in isolated grid boxes. This is likely due to the higher spatiotemporal resolution (30 min/0.1°) of IMERG products.

This analysis provides important insight regarding the spatiotemporal error characteristics of the IMERG V05B, IMERG V04A, CMORPH-CRT, and TRMM 3B42 precipitation products over China and the eight subregions examined here. As such, these results provide satellite precipitation users with an enhanced understanding of the applicability of the latest V05 IMERG, V04 IMERG, TRMM 3B42, and CMORPH-CRT precipitation estimates for water resource management, hydrometeorological disaster prediction, and hydrologic simulation within China. In addition, results are potentially relevant for future refinement of the IMERG production algorithm.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare no conflicts of interest.

Authors’ Contributions

All authors contributed extensively to the work presented in this paper. Haishen Lu, Wade T. Crow, and Yonghua Zhu designed the framework of this study. Guanghua Wei performed the experiment. The manuscript was prepared by Guanghua Wei and revised by Haishen Lu, Wade T. Crow, and Yonghua Zhu. The data were provided by Guanghua Wei and Jianbin Su. Jianqun Wang provided some useful suggestions.

Acknowledgments

This research is supported by National Key Research and Development Program (grant nos. 2016YFC0400909 and 2016YFA0601504); NNSF (grant nos. 41830752 and 41571015, 41371049, 41323001, and 51539003); and the Project of the State Key Laboratory of Hydrology-Water Resources and Hydraulic Engineering, China (grant nos. 20165042612).