Research Article | Open Access
Complete Consistency of the Estimator of Nonparametric Regression Models Based on -Mixing Sequences
We study the complete consistency for estimator of nonparametric regression model based on -mixing sequences by using the classical Rosenthal-type inequality and the truncated method. As an application, the complete consistency for the nearest neighbor estimator is obtained.
Consider the following fixed design nonparametric regression model: where are known fixed design points from , where is a given compact set for some , is an unknown regression function defined on , and are random errors. Assume that for each , have the same distribution as . As an estimator of , the following weighted regression estimator will be considered: where , are the weight function.
The above estimator was first proposed by Georgiev  and subsequently has been studied by many authors. For instance, when are assumed to be independent, consistency and asymptotic normality have been studied by Georgiev and Greblicki , Georgiev  and Müller  among others. Results for the case when are dependent have also been studied by various authors in recent years. Fan  extended the work of Georgiev  and Müller  in the estimation of the regression model to the case that forms an -mixingale sequence for some . Roussas  discussed strong consistency and quadratic mean consistency for under mixing conditions. Roussas et al.  established asymptotic normality of assuming that the errors are from a strictly stationary stochastic process and satisfying the strong mixing condition. Tran et al.  discussed again asymptotic normality of assuming that the errors form a linear time series, more precisely, a weakly stationary linear process based on a martingale difference sequence. Hu et al.  studied the asymptotic normality for double array sum of linear time series. Hu et al.  gave the mean consistency, complete consistency, and asymptotic normality of regression models with linear process errors. Liang and Jing  presented some asymptotic properties for estimates of nonparametric regression models based on negatively associated sequences, Yang et al.  generalized the results of Liang and Jing  for negatively associated sequences to the case of negatively orthant dependent sequences, and so forth. The main purpose of this section is to investigate the complete consistency for estimator of the nonparametric regression model based on -mixing random variables.
In the following, we will give the definition of sequence of -mixing random variables.
Let be a random variable sequence defined on a fixed probability space . Write . Given -algebras in , let Define the -mixing coefficients by Obviously, , and .
Definition 1.1. A sequence of random variables is said to be a -mixing sequence if there exists such that .
-mixing random variables were introduced by Bradley , and many applications have been found. Many authors have studied this concept providing interesting results and applications. See for example, Bradley  for the central limit theorem, Bryc and Smoleński , Peligrad , and Utev and Peligrad  for moment inequalities, Gan , Kuczmaszewska , Wu and Jiang , and Wang et al.  for almost sure convergence, Peligrad and Gut , Gan , Cai , Kuczmaszewska , Zhu , An and Yuan , Sung  and Wang et al.  for complete convergence, and Peligrad  for invariance principle, Zhou et al.  and Sung  for strong law of large numbers, and so forth. When these are compared with the corresponding results of independent random variable sequences, there still remains much to be desired.
Throughout the paper, denotes a positive constant not depending on , which may be different in various places. represents for all . Let denote the integer part of and let be the indicator function of the set . Denote and .
2. Main Result
Unless otherwise specified, we assume throughout the paper that is defined by (1.2). For any function , we use to denote all continuity points of the function on . The norm is the Euclidean norm. For any fixed design point , the following assumptions on weight function will be used:) as ;() for all ;() as for all .
Based on the assumptions above, we can get the following complete consistency of the nonparametric regression estimator .
Theorem 2.1. Let be a sequence of -mixing random variables with mean zero, which is stochastically dominated by a random variable . Assume that conditions – hold true. If there exists some such that and then
As an application of Theorem 2.1, we give the complete consistency for the nearest neighbor estimator of . Without loss of generality, put , taking , . For any , we rewrite as follows: if , then is permuted before when .
Let , the nearest neighbor weight function estimator of in model (1.1) is defined as follows: where
Based on the notations above, we can get the following result by using Theorem 2.1.
Corollary 2.2. Let be a sequence of -mixing random variables with mean zero, which is stochastically dominated by a random variable . Suppose that is continuous on the compact set . If there exists some such that and , then
In this section, we will present some important lemmas which will be used to prove the main results of the paper. The first one is the Rosenthal-type inequality, which was proved by Utev and Peligrad .
Lemma 3.1. Let be a -mixing sequence of random variables, , for some and for every . Then there exists a positive constant C depending only on such that
The concept of stochastic domination will be used in this work.
Definition 3.2. A sequence of random variables is said to be stochastically dominated by a random variable if there exists a positive constant such that for all and .
Lemma 3.3. Let be a sequence of random variables which is stochastically dominated by a random variable . For any and , the following two statements hold: where and are positive constants.
4. Proofs of the Main Results
Proof of Theorem 2.1. For and , we have by (1.1) and (1.2) that
Since , hence for any , there exists a such that when . Thus, by setting in (4.1), we can get that
By conditions ()–() and the arbitrariness of , we can get that
For fixed design point , note that , so without loss of generality, we assume that in what follows.
From the condition (2.1), we assume that By (4.3), we can see that in order to prove (2.2), we only need to show that That is to say, it suffices to show that for all , For fixed , denote It is easy to check that for any , which implies that Hence, to prove (4.6), it suffices to show that and .
By condition () and , we can get that which implies that .
Next, we will prove that . Firstly, we will show that Actually, by the conditions , Lemma 3.3, (4.4) and , we can see that which implies (4.11). Hence, to prove , we only need to show that for all , By Markov’s inequality, Lemma 3.1, ’s inequality, and Jensen’s inequality, we have for that Take which implies that and . By ’s inequality and Lemma 3.3, we can get If , then we have by Markov’s inequality, and (4.4) that If , then we have by Markov’s inequality, and (4.4) again that From (4.14)–(4.18), we have proved that .
By ’s inequality and Lemma 3.3, we can see that has been proved by (4.10). In the following, we will show that . Denote It is easily seen that for and for all . Hence, It is easily seen that for all , which implies that for all , Therefore, Thus, the inequality (4.13) follows from (4.14)–(4.19), (4.21), and (4.24). This completes the proof of the theorem.
Proof of Corollary 2.2. It suffices to show that the conditions of Theorem 2.1 are satisfied. Since is continuous on the compact set , hence, is uniformly continuous on the compact set , which implies that is bounded on set .
For any , if follows from the definition of and that Hence, conditions ()–() and (2.1) are satisfied. By Theorem 2.1, we can get (2.6) immediately. This completes the proof of the corollary.
This paper is supported by the National Natural Science Foundation of China (11201001, 11171001, and 11126176), Natural Science Foundation of Anhui Province (1208085QA03), Doctoral Research Start-up Funds Projects of Anhui University, Academic Innovation Team of Anhui University (KJTD001B), University Students Science Research Training Program of Anhui University (KYXL2012007), and Students’ Innovative Training Project of Anhui University (cxcy2012003). The authors are most grateful to the editor Ciprian A. Tudor and anonymous referee for careful reading of the paper and valuable suggestions which helped in significantly improving an earlier version of this paper.
- A. A. Georgiev, “Local properties of function fitting estimates with application to system identification,” in Proceedings of the 4th Pannonian Symposium on Mathematical Statistics, W. Grossmann, Ed., Mathematical Statistics and Applications, pp. 141–151, Bad Tatzmannsdorf, Dordrecht, The Netherlands, 1983.
- A. A. Georgiev and W. Greblicki, “Nonparametric function recovering from noisy observations,” Journal of Statistical Planning and Inference, vol. 13, no. 1, pp. 1–14, 1986.
- A. A. Georgiev, “Consistent nonparametric multiple regression: the fixed design case,” Journal of Multivariate Analysis, vol. 25, no. 1, pp. 100–110, 1988.
- H.-G. Müller, “Weak and universal consistency of moving weighted averages,” Periodica Mathematica Hungarica, vol. 18, no. 3, pp. 241–250, 1987.
- Y. Fan, “Consistent nonparametric multiple regression for dependent heterogeneous processes: the fixed design case,” Journal of Multivariate Analysis, vol. 33, no. 1, pp. 72–88, 1990.
- G. G. Roussas, “Consistent regression estimation with fixed design points under dependence conditions,” Statistics & Probability Letters, vol. 8, no. 1, pp. 41–50, 1989.
- G. G. Roussas, L. T. Tran, and D. A. Ioannides, “Fixed design regression for time series: asymptotic normality,” Journal of Multivariate Analysis, vol. 40, no. 2, pp. 262–291, 1992.
- L. Tran, G. Roussas, S. Yakowitz, and B. Truong Van, “Fixed-design regression for linear time series,” The Annals of Statistics, vol. 24, no. 3, pp. 975–991, 1996.
- S. H. Hu, C. H. Zhu, Y. B. Chen, and L. C. Wang, “Fixed-design regression for linear time series,” Acta Mathematica Scientia, vol. 22, no. 1, pp. 9–18, 2002.
- S. H. Hu, G. M. Pan, and Q. B. Gao, “Estimation problems for a regression model with linear process errors,” Applied Mathematics, vol. 18, no. 1, pp. 81–90, 2003.
- H.-Y. Liang and B.-Y. Jing, “Asymptotic properties for estimates of nonparametric regression models based on negatively associated sequences,” Journal of Multivariate Analysis, vol. 95, no. 2, pp. 227–245, 2005.
- W. Z. Yang, X. J. Wang, X. H. Wang, and S. H. Hu, “The consistency for estimator of nonparametricregression model based on NOD errors,” Journal of Inequalities and Applications, vol. 2012, 140, 2012.
- R. C. Bradley, “On the spectral density and asymptotic normality of weakly dependent random fields,” Journal of Theoretical Probability, vol. 5, no. 2, pp. 355–373, 1992.
- W. Bryc and W. Smoleński, “Moment conditions for almost sure convergence of weakly correlated random variables,” Proceedings of the American Mathematical Society, vol. 119, no. 2, pp. 629–635, 1993.
- M. Peligrad, “Maximum of partial sums and an invariance principle for a class of weak dependent random variables,” Proceedings of the American Mathematical Society, vol. 126, no. 4, pp. 1181–1189, 1998.
- S. Utev and M. Peligrad, “Maximal inequalities and an invariance principle for a class of weakly dependent random variables,” Journal of Theoretical Probability, vol. 16, no. 1, pp. 101–115, 2003.
- S. X. Gan, “Almost sure convergence for -mixing random variable sequences,” Statistics & Probability Letters, vol. 67, no. 4, pp. 289–298, 2004.
- A. Kuczmaszewska, “On Chung-Teicher type strong law of large numbers for -mixing random variables,” Discrete Dynamics in Nature and Society, vol. 2008, Article ID 140548, 10 pages, 2008.
- Q. Y. Wu and Y. Y. Jiang, “Some strong limit theorems for -mixing sequences of random variables,” Statistics & Probability Letters, vol. 78, no. 8, pp. 1017–1023, 2008.
- X. J. Wang, S. H. Hu, Y. Shen, and N. X. Ling, “Strong law of large numbers and growth rate for a class of random variable sequence,” Statistics & Probability Letters, vol. 78, no. 18, pp. 3330–3337, 2008.
- M. Peligrad and A. Gut, “Almost-sure results for a class of dependent random variables,” Journal of Theoretical Probability, vol. 12, no. 1, pp. 87–104, 1999.
- G.-H. Cai, “Strong law of large numbers for -mixing sequences with different distributions,” Discrete Dynamics in Nature and Society, vol. 2006, Article ID 27648, 7 pages, 2006.
- A. Kuczmaszewska, “On complete convergence for arrays of rowwise dependent random variables,” Statistics & Probability Letters, vol. 77, no. 11, pp. 1050–1060, 2007.
- M.-H. Zhu, “Strong laws of large numbers for arrays of rowwise -mixing random variables,” Discrete Dynamics in Nature and Society, vol. 2007, Article ID 74296, 6 pages, 2007.
- J. An and D. M. Yuan, “Complete convergence of weighted sums for -mixing sequence of random variables,” Statistics & Probability Letters, vol. 78, no. 12, pp. 1466–1472, 2008.
- S. H. Sung, “Complete convergence for weighted sums of -mixing random variables,” Discrete Dynamics in Nature and Society, vol. 2010, Article ID 630608, 13 pages, 2010.
- X. J. Wang, X. Q. Li, W. Z. Yang, and S. H. Hu, “On complete convergence for arrays of rowwiseweakly dependent random variables,” Applied Mathematics Letters, vol. 25, no. 11, pp. 1916–1920, 2012.
- X. C. Zhou, C. C. Tan, and J. G. Lin, “On the strong laws for weighted sums of -mixing random variables,” Journal of Inequalities and Applications, vol. 2011, Article ID 157816, 8 pages, 2011.
- S. H. Sung, “On the strong convergence for weighted sums of -mixing random variables,” Statistical Papers. In press.
Copyright © 2012 Xuejun Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.