Abstract and Applied Analysis

Volume 2013 (2013), Article ID 862602, 9 pages

http://dx.doi.org/10.1155/2013/862602

## Bernstein-Type Inequality for Widely Dependent Sequence and Its Application to Nonparametric Regression Models

School of Mathematical Science, Anhui University, Hefei 230601, China

Received 8 February 2013; Accepted 2 July 2013

Academic Editor: Juan J. Trujillo

Copyright © 2013 Aiting Shen. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

We present the Bernstein-type inequality for widely dependent random variables. By using the Bernstein-type inequality and the truncated method, we further study the strong consistency of estimator of fixed design regression model under widely dependent random variables, which generalizes the corresponding one of independent random variables. As an application, the strong consistency for the nearest neighbor estimator is obtained.

#### 1. Introduction

Let be a sequence of random variables defined on a fixed probability space . It is well known that the Bernstein-type inequality for the partial sum plays an important role in probability limit theory and mathematical statistics. The main purpose of the paper is to present the Bernstein-type inequality, by which, we will further investigate the strong consistency for the estimator of nonparametric regression models based on widely dependent random variables.

##### 1.1. Brief Review

Consider the following fixed design regression model: where are known fixed design points from , where is a given compact set for some , is an unknown regression function defined on , and are random errors. Assume that for each , have the same distribution as . As an estimator of , the following weighted regression estimator will be considered: where , are the weight functions.

The above estimator was first proposed by Georgiev [1] and subsequently has been studied by many authors. For instance, when are assumed to be independent, consistency and asymptotic normality have been studied by Georgiev and Greblicki [2], Georgiev [3] and Müller [4] among others. Results for the case when are dependent have also been studied by various authors in recent years. Fan [5] extended the work of Georgiev [3] and Müller [4] in the estimation of the regression model to the case where it forms an -mixingale sequence for some . Roussas [6] discussed strong consistency and quadratic mean consistency for under mixing conditions. Roussas et al. [7] established asymptotic normality of assuming that the errors are from a strictly stationary stochastic process and satisfying the strong mixing condition. Tran et al. [8] discussed again asymptotic normality of assuming that the errors form a linear time series, more precisely, a weakly stationary linear process based on a martingale difference sequence. Hu et al. [9] studied the asymptotic normality for double array sum of linear time series. Hu et al. [10] gave the mean consistency, complete consistency, and asymptotic normality of regression models with linear process errors. Liang and Jing [11] presented some asymptotic properties for estimates of nonparametric regression models based on negatively associated sequences. Yang et al. [12] generalized the results of Liang and Jing [11] for negatively associated sequences to the case of negatively orthant dependent sequences and obtained the strong consistency for the estimator of the nonparametric regression models based on negatively orthant dependent errors. Wang et al. [13] studied the complete consistency of the estimator of nonparametric regression models based on -mixing sequences, and so forth. The main purpose of this paper is to investigate the strong consistency for the estimator of the nonparametric regression models based on widely dependent random variables, which contains independent random variables, negatively associated random variables, negatively orthant dependent random variables, extended negatively orthant dependent random variables, and some positively dependent random variables as specials cases. For more details about the strong consistency for the estimator of , Ren and Chen [14] obtained the strong consistency for the least squares estimator of and the nonparametric estimator of based on negatively associated samples, Baek and Liang [15] studied the strong consistency for the weighted least squares estimator of and nonparametric estimator of in a semi-parametric model under negatively associated samples, which extended the corresponding one on independent random error settings, Liang et al. [16] also studied the strong consistency in a in semiparametric model for a linear process with negatively associated innovations and established the convergence rate, they also pointed out that their results on nonparametric estimator of can attain the optimal convergence rate, and so forth.

##### 1.2. Concepts of Wide Dependence

In this section, we will present some wide dependence structures introduced in Wang et al. [17].

*Definition 1. *For the random variables , if there exists a finite real sequence satisfying for each and for all , ,
then we say that the random variables are widely upper orthant dependent (WUOD); if there exists a finite real sequence satisfying for each and for all , ,
then we say that the are widely lower orthant dependent (WLOD, in short); if they are both WUOD and WLOD, then we say that the are widely orthant dependent (WOD).

WUOD, WLOD, and WOD random variables are called by a joint name wide dependent (WD) random variables, and , , , are called dominating coefficients.

For examples of WD random variables with various dominating coefficients, we refer the reader to Wang et al. [17]. These examples show that WD random variables contain some common negatively dependent random variables, some positively dependent random variables, and some others. For details about WD random variables, one can refer to Wang et al. [17], Wang and Cheng [18], Wang et al. [19], Chen et al. [20], and so forth.

In what follows, denote . Recall that when for any in (3) and (4), the random variables are called negatively upper orthant dependent (NUOD) and negatively lower orthant dependent (NLOD), respectively. If they are both NUOD and NLOD, then we say that the random variables are negatively orthant dependent (NOD) (see, e.g., Ebrahimi and Ghosh [21], Block et al. [22], Joag-Dev and Proschan [23], Wang et al. [24–26], Wu [27, 28], Wu and Jiang [29], or Wu and Chen [30]).

If both (3) and (4) hold when for some constant , the random variables are called extended negatively upper orthant dependent (ENUOD) and extended negatively lower orthant dependent (ENLOD), respectively. If they are both ENUOD and ENLOD, then we say that the random variables are extended negatively orthant dependent (ENOD) (see, e.g., Liu [31]). The concept of general extended negative dependence was proposed by Liu [31, 32] and further promoted by Chen et al. [33, 34], Shen [35], Wang and Chen [18], S. J. Wang and W. S. Wang [36] and Wang et al. [37], and so forth.

Wang et al. [17] obtained the following properties for WD random variables, which will be used to prove the main results of the paper.

Proposition 2. *(1) Let be WLOD (WUOD) with dominating coefficients , . If are nondecreasing, then are still WLOD (WUOD) with dominating coefficients , ; if are nonincreasing, then are WUOD (WLOD) with dominating coefficients , .**(2) If are nonnegative and WUOD with dominating coefficients , , then for each ,
**In particular, if are WUOD with dominating coefficients , , then for each and any ,
*

By Proposition 2, we can get the following corollary immediately.

Corollary 3. *
(1) Let be WD. If are nondecreasing (or nonincreasing), then are still WD.**
(2) If are WD, then for each and any ,
*

In this paper, we will present the Bernstein-type inequality for WD random variables. By using the Bernstein-type inequality, we will further investigate the strong consistency for the estimator of nonparametric regression models based on WD errors.

This work is organized as follows: the Bernstein-type inequality for WD random variables is provided in Section 2 and strong consistency for the estimator of nonparametric regression models based on WD errors is investigated in Section 3.

Throughout the paper, denotes a positive constant not depending on , which may be different in various places. represents for all . Let denote the integer part of and be the indicator function of the set . Denote and . Let be a sequence of WD random variables. Denote . In the sequel, we will use the following different assumptions in different situations: where , , and are finite positive constants.

#### 2. Bernstein-Type Inequality for WD Random Variables

In this section, we will present the Bernstein-type inequality for WD random variables, which will be used to prove the strong consistency for estimator of the nonparametric regression model based on WD random variables.

Theorem 4. *Let be a sequence of WD random variables with and for each , where is a positive constant. Denote and for each . Then for any ,
*

*Proof. *For any , by Taylor’s expansion, and the inequality for , we can get that for ,
where
Denote and . Choosing such that and
It is easy to check that for and ,
which implies that for ,
By Markov’s inequality, Corollary 3, (12), and (16), we can get
Taking . It is easily seen that and . Substituting into the right-hand side of (17), we can obtain (10) immediately. By (10), we have
since is still a sequence of WD random variables. The desired result (11) follows from (10) and (18) immediately.

By Theorem 4, we can get the following complete convergence for WD random variables immediately.

Corollary 5. *Let be a sequence of WD random variables with and for each , where is a positive constant. Assume that . . Let the dominating coefficients , , satisfy (8) with any finite positive constant and . Then
*

*Proof. *For any , it follows from (11) that
which implies (19). Here and are positive constants not depending on .

#### 3. The Strong Consistency for the Estimator of Nonparametric Regression Models Based on WD Errors

Unless otherwise specified, we assume throughout the paper that is defined by (2). For any function , we use to denote all continuity points of the function on . The norm is the Euclidean norm. For any fixed design point , the following assumptions on weight functions will be used:; for all and ; for some .

Theorem 6. *Let be a sequence of mean zero WD random variables such that . Suppose that the conditions hold true and (9) holds for any positive constant . Assume that satisfies a local Lipschitz condition around the point . Then for any ,
*

*Proof. *For , we have by (1) and (2) that
By (22), the conditions and the assumption on , we have
Hence, to prove (21), we only need to show that
For fixed design point , without loss of generality, we assume that in what follows (otherwise, we use and instead of , respectively, and note that ). Let
Since for each , it is easy to see that
By the condition , we can see that
For fixed and , since have the same distribution as and are WD with mean zero, we have by applying Theorem 4 that for every ,
which implies
by Borel-Cantelli lemma.

Next, we will estimate and . It can be checked by that
which implies
Consequently, by Kronecker’s lemma, we have that
Thus, by the condition , it is easy to see that
By and again, we have
Combining (33) and (34), it follows that
Likewise, by , we can see that
which implies
Hence, by Kronecker’s lemma,
Consequently, we have by that
On the other hand, by and again, we can see that
From the statements above, we have
Therefore, (24) follows from (26), (29), (35), and (41) immediately. This completes the proof of the theorem.

Theorem 7. *Let be a sequence of mean zero WD random variables such that . Suppose that the conditions hold true and (9) holds for any positive constant . Assume that satisfies a local Lipschitz condition around the point . Then for any ,
*

*Proof. *According to (23), we can see that in order to prove (42), we only need to show that
We still assume that in what follows. The proof is similar to that of Theorem 6. We use the same notations , and for as those in Theorem 6, where is replaced by . Obviously implies . It follows by that
By applying Theorem 4 and (9), we can see that for every ,
which implies by Borel-Cantelli lemma that
Meanwhile, it can be checked by that
which implies
Then, we have by Kronecker’s lemma that
Consequently, it follows by that
On the other hand, it can be checked that
which implies
So, by Kronecker’s lemma,
Consequently, we have by that
Finally, similar to the proof of (21), we can get (43) immediately by (46)–(56). This completes the proof of the theorem.

As an application of Theorems 6 and 7, we give the strong consistency for the nearest neighbor estimator of . Without loss of generality, put , taking , . For any , we rewrite as follows: if , then is permuted before when .

Let , the nearest neighbor weight function estimator of in model (1) is defined as follows: where

Based on the notations above, we can get the following result by using Theorems 6 and 7.

Corollary 8. *Let be a sequence of mean zero WD random variables and (9) holds for any positive constant . Assume that satisfies a local Lipschitz condition around the point . Denote .*(i)*If , then (21) holds for any .*(ii)*If , then (42) holds for any .*

*Proof. *It suffices to show that the conditions are satisfied. For any , it follows from the definitions of and that
Hence, conditions are satisfied. By Theorems 6 and 7, we can get (i) and (ii) immediately. This completes the proof of the corollary.

#### Acknowledgments

The authors are most grateful to the Editor Juan J. Trujillo and anonymous referee for careful reading of the paper and valuable suggestions which helped in improving an earlier version of this paper. This work was supported by the National Natural Science Foundation of China (11201001, 11171001), the Natural Science Foundation of Anhui Province (1308085QA03, 11040606M12, 1208085QA03), the 211 Project of Anhui University, the Youth Science Research Fund of Anhui University, Applied Teaching Model Curriculum of Anhui University (XJYYXKC04), and the Students Science Research Training Program of Anhui University (KYXL2012007, kyxl2013003).

#### References

- A. A. Georgiev, “Local properties of function fitting estimates with application to system identification,” in
*Mathematical Statistics and Applications*, W. Grossmann, Ed., pp. 141–151, Reidel, Dordrecht, The Netherlands, 1985, Proceedings of the 4th Pannonian Symposium on Mathematical Statistics, September 1983. View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - A. A. Georgiev and W. Greblicki, “Nonparametric function recovering from noisy observations,”
*Journal of Statistical Planning and Inference*, vol. 13, no. 1, pp. 1–14, 1986. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - A. A. Georgiev, “Consistent nonparametric multiple regression: the fixed design case,”
*Journal of Multivariate Analysis*, vol. 25, no. 1, pp. 100–110, 1988. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - H.-G. Müller, “Weak and universal consistency of moving weighted averages,”
*Periodica Mathematica Hungarica*, vol. 18, no. 3, pp. 241–250, 1987. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Y. Fan, “Consistent nonparametric multiple regression for dependent heterogeneous processes: the fixed design case,”
*Journal of Multivariate Analysis*, vol. 33, no. 1, pp. 72–88, 1990. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - G. G. Roussas, “Consistent regression estimation with fixed design points under dependence conditions,”
*Statistics & Probability Letters*, vol. 8, no. 1, pp. 41–50, 1989. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - G. G. Roussas, L. T. Tran, and D. A. Ioannides, “Fixed design regression for time series: asymptotic normality,”
*Journal of Multivariate Analysis*, vol. 40, no. 2, pp. 262–291, 1992. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - L. Tran, G. Roussas, S. Yakowitz, and B. T. Van, “Fixed-design regression for linear time series,”
*The Annals of Statistics*, vol. 24, no. 3, pp. 975–991, 1996. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - S. H. Hu, C. H. Zhu, Y. B. Chen, and L. C. Wang, “Fixed-design regression for linear time series,”
*Acta Mathematica Scientia B*, vol. 22, no. 1, pp. 9–18, 2002. View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - S. H. Hu, G. M. Pan, and Q. B. Gao, “Estimation problems for a regression model with linear process errors,”
*Applied Mathematics–A Journal of Chinese Universities*, vol. 18, no. 1, pp. 81–90, 2003. View at Google Scholar · View at MathSciNet - H. Y. Liang and B. Y. Jing, “Asymptotic properties for estimates of nonparametric regression models based on negatively associated sequences,”
*Journal of Multivariate Analysis*, vol. 95, no. 2, pp. 227–245, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - W. Z. Yang, X. J. Wang, X. H. Wang, and S. H. Hu, “The consistency for estimator ol nonparametric regression model based on NOD errors,”
*Journal of Inequalities and Applications*, vol. 2012, article 140, 2012. View at Publisher · View at Google Scholar - X. J. Wang, F. X. Xia, M. M. Ge, S. H. Hu, and W. Z. Yang, “Complete consistency of the estimator of nonparametric regression models based on $\tilde{\rho}$-mixing sequences,”
*Abstract and Applied Analysis*, vol. 2012, Article ID 907286, 12 pages, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - Z. Ren and M. H. Chen, “Strong consistency of a class of estimators in a partial linear model for negative associated samples,”
*Chinese Journal of Applied Probability and Statistics*, vol. 18, no. 1, pp. 60–66, 2002. View at Google Scholar · View at MathSciNet - J.-I. Baek and H. Y. Liang, “Asymptotics of estimators in semi-parametric model under NA samples,”
*Journal of Statistical Planning and Inference*, vol. 136, no. 10, pp. 3362–3382, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - H. Y. Liang, V. Mammitzsch, and J. Steinebach, “On a semiparametric regression model whose errors form a linear process with negatively associated innovations,”
*Statistics*, vol. 40, no. 3, pp. 207–226, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - K. Wang, Y. Wang, and Q. Gao, “Uniform asymptotics for the finite-time ruin probability of a new dependent risk model with a constant interest rate,”
*Methodology and Computing in Applied Probability*, vol. 15, no. 1, pp. 109–124, 2013. View at Publisher · View at Google Scholar · View at Scopus - Y. Wang and D. Cheng, “Basic renewal theorems for random walks with widely dependent increments,”
*Journal of Mathematical Analysis and Applications*, vol. 384, no. 2, pp. 597–606, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Y. Wang, Z. Cui, K. Wang, and X. Ma, “Uniform asymptotics of the finite-time ruin probability for all times,”
*Journal of Mathematical Analysis and Applications*, vol. 390, no. 1, pp. 208–223, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Y. Chen, L. Wang, and Y. Wang, “Uniform asymptotics for the finite-time ruin probabilities of two kinds of nonstandard bidimensional risk models,”
*Journal of Mathematical Analysis and Applications*, vol. 401, no. 1, pp. 114–129, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - N. Ebrahimi and M. Ghosh, “Multivariate negative dependence,”
*Communications in Statistics-Theory and Methods*, vol. 10, no. 4, pp. 307–337, 1981. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - H. W. Block, T. H. Savits, and M. Shaked, “Some concepts of negative dependence,”
*The Annals of Probability*, vol. 10, no. 3, pp. 765–772, 1982. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - K. Joag-Dev and F. Proschan, “Negative association of random variables, with applications,”
*The Annals of Statistics*, vol. 11, no. 1, pp. 286–295, 1983. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - X. J. Wang, S. H. Hu, W. Z. Yang, and N. X. Ling, “Exponential inequalities and inverse moment for NOD sequence,”
*Statistics & Probability Letters*, vol. 80, no. 5-6, pp. 452–461, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - X. J. Wang, S. H. Hu, and A. I. Volodin, “Strong limit theorems for weighted sums of NOD sequence and exponential inequalities,”
*Bulletin of the Korean Mathematical Society*, vol. 48, no. 5, pp. 923–938, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - X. J. Wang, S. H. Hu, A. T. Shen, and W. Z. Yang, “An exponential inequality for a NOD sequence and a strong law of large numbers,”
*Applied Mathematics Letters*, vol. 24, no. 2, pp. 219–223, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Q. Y. Wu, “A strong limit theorem for weighted sums of sequences of negatively dependent random variables,”
*Journal of Inequalities and Applications*, vol. 2010, Article ID 383805, 8 pages, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Q. Y. Wu, “A complete convergence theorem for weighted sums ol arrays ol rowwise negatively dependent random variables,”
*Journal of Inequalities and Applications*, vol. 2012, article 50, 2012. View at Google Scholar - Q. Y. Wu and Y. Y. Jiang, “The strong consistency of $M$ estimator in a linear model for negatively dependent random samples,”
*Communications in Statistics-Theory and Methods*, vol. 40, no. 3, pp. 467–491, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Q. Y. Wu and P. Y. Chen, “An improved result in almost sure central limit theorem for self-normalized products of partial sums,”
*Journal of Inequalities and Applications*, vol. 2013, article 129, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - L. Liu, “Precise large deviations for dependent random variables with heavy tails,”
*Statistics & Probability Letters*, vol. 79, no. 9, pp. 1290–1298, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - L. Liu, “Necessary and sufficient conditions for moderate deviations of dependent random variables with heavy tails,”
*Science in China A*, vol. 53, no. 6, pp. 1421–1434, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Y. Chen, A. Chen, and K. W. Ng, “The strong law of large numbers for extended negatively dependent random variables,”
*Journal of Applied Probability*, vol. 47, no. 4, pp. 908–922, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Y. Chen, K. C. Yuen, and K. W. Ng, “Precise large deviations of random sums in presence of negative dependence and consistent variation,”
*Methodology and Computing in Applied Probability*, vol. 13, no. 4, pp. 821–833, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - A. T. Shen, “Probability inequalities for END sequence and their applications,”
*Journal of Inequalities and Applications*, vol. 2011, article 98, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - S. J. Wang and W. S. Wang, “Extended precise large deviations of random sums in the presence of END structure and consistent variation,”
*Journal of Applied Mathematics*, vol. 2012, Article ID 436531, 12 pages, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - X. J. Wang, S. J. Wang, S. H. Hu, J. M. Ling, and Y. F. Wei, “On complete convergence of weighted sums for arrays of rowwise extended negatively dependent random variables,”
*Stochastics*, Article ID 736996, 2012. View at Publisher · View at Google Scholar