Research Article | Open Access

# Improved Liu-Type Estimator of Parameters in Two Seemingly Unrelated Regressions

**Academic Editor:**F. Sartoretto

#### Abstract

We consider the parameter estimation in two seemingly unrelated regression systems. To overcome the multicollinearity, we propose a Liu-type estimator in seemingly unrelated regression systems. The superiority of the new estimator over the classic estimator in the mean square error is discussed and we also discuss the admissibility of the Liu-type estimator.

#### 1. Introduction

Consider the following two seemingly unrelated regressions (SUR): where are vectors of observations, are matrices with full column rank, are vectors of unknown regression parameters, are vectors of error variables, and where is a positive definite matrix. This system has been used in many fields, such as social biological sciences and econometrics. Zellner [1, 2] firstly defined this system and later it was discussed by many researchers, such as Wang et al. [3], Roozbeh et al. [4], and Singh et al. [5].

For system (1), when , we can get the estimator of as follows: When the error vector is related, the estimator may not fully use the information of the parameter. How to use the information to improve the is a problem. Revankar [6] and Srivastava and Giles [7] have discussed this problem. Wang [8] uses the covariance-improve method to estimate the parameter in two seemingly unrelated regressions. With the prior information, Wang [8] proposes the covariance-improve estimator of and : where , , .

When the design matrix is ill-conditioned, the estimator , is no longer a good estimator. Many researchers have discussed this problem. One method to overcome this problem is to consider biased estimator, such as Liu and Wang [9] introduce the ridge estimator, Liu [10] proposes the principal regression component estimator, Qiu [11] proposes the classic type estimator, and Roozbeh et al. [12] introduce the ridge estimator.

In this paper, we propose a Liu-type estimator to overcome the multicollinearity in the two seemingly unrelated regressions. Then we discuss the superiority of the Liu-type estimator over the covariance-improve estimator in the mean square error criterion, and we also discuss the selection of the parameter in the proposed estimator. Since the estimator of is similar to the estimator of , so in this paper, we only discuss the estimator of .

The rest of the paper is organized as follows. The Liu-type estimator is given in Section 2 and the properties of the new estimator under the mean square error criterion are discussed in Section 3. The admissibility of the proposed estimator is studied in Section 4 and some conclusion remarks are given in Section 5.

#### 2. The Proposed Estimator

In this section, we use the prior information to obtain the Liu-type estimator. Firstly, we give a lemma.

Lemma 1 (see [10]). *Let be an estimator of , the prior information with , and
**Then in the estimator , the estimator has minimum mean square error and
*

Now we establish the Liu-type estimator in SUR model. Set satisfy and has the max column full rank; then and

By Lemma 1, when is known, we establish a new estimator for : where is the estimator for the single model in (1), , , , , and . We call this estimator as Liu-type estimator in SUR model. By the definition of the Liu-type estimator, it is easy to know that it is a general estimator which includes the covariance-improve estimator proposed by Wang [8] and the ridge estimator proposed by Liu [10] as special cases.

(1) When , then

(2) When , then

In next section, we will give the properties of the new estimator.

#### 3. MSE: The Superiority of the New Estimator over the Covariance-Improve Estimator

In this section, we discuss the statistical properties of the new estimator . Firstly, we give the definition of the mean square error (MSE).

Let be an estimator of ; the MSE of is defined as where .

In the following theorem, we give the superiority of the new estimator over the covariance-improve estimator in the mean square error.

Theorem 2. *For the SUR model (1), when is known,**(a) when fixed,**(1) if , then MSEMSE;**(2) if , when /, then ;**(b) when fixed,**(1) if , then ;**(2) if , when , then .*

*Proof. *By the definition of the covariance-improve estimator , we obtain
Then by the definition of the mean square error, we obtain
Since , there exists an orthogonal matrix such that , where is the ordered eigenvalues of ; thus we obtain
where . Since so we get that , .

Now we compute the MSE of the Liu-type estimator () for SUR model (1). Firstly, we compute that
Thus we have
where .

In order to compare and , we consider the following difference:
When fixed, then we write (17) as follows:
So

(1) If , then ;

(2) if , when , then .

When fixed, then we write (17) as follows:

So if

(1) , then ;

(2) , when , then .

#### 4. The Admissible of the New Estimator

As we all know, the admissible of an estimator is an important problem in SUR model. In this section, we discuss the admissible of the new estimator . Firstly, we give the definition of the admissible.

*Definition 3. *Let and be two estimators of , for arbitrarily risk loss function , (1) for arbitrarily . (2) There at least exist a such that the inequality is satisfied, Then we see that is uniformly better than for risk loss function . If, in some class estimators, there is not exist an estimator that is uniformly better than , we can say that is admissible estimator of for risk loss function in that class estimators.

Lemma 4 (see [13]). *For linear model
**
where is a known matrix and is full column rank. Let , ; then in the linear estimators of , is admissible estimator of if and only if
*

Now we discuss the admissibility of the new estimator. In this section we consider the quadratic loss (mean square error).

Theorem 5. *For the SUR model (1), when is know, if , then is admissible estimator of in the class of linear estimators .*

* Proof. *If , then
For SUR model (1), let , , , and , Then (1) can be written as
where
and (24) satisfies the following equation:
Note that
Then (25) can be written as follows:
When , (25) can be written as follows:
Then by (28), we may get
multiplication in (28); we have
Then

Let and ; by Lemma 4, if we want to prove that is admissible estimator of , we only need to prove . Since , we may conclude that
Then
It is obvious that . The proof is completed.

Theorem 6. *For the SUR model (1), when is known, if , then is admissible estimator of in the class of linear estimators .*

*Proof. *For SUR model (1), when , by Lin [14], we obtain ; thus we obtain
Similar to Theorem 5, we only need to prove ; and are defined as Theorem 5:
Denote ; by Rao et al. [15], we have
Then we have
Obviously . The proof is completed.

#### 5. Conclusion Remarks

In this paper we consider the parameter estimation in seemingly unrelated regression system. A Liu-type estimator is proposed to overcome the multicollinearity in seemingly unrelated regression system. The superiority of the new estimator has been also discussed and the admissibility of the new estimator is also discussed.

#### Conflict of Interests

The author declares that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

The author is grateful to the editor and the anonymous referee for the valuable comments which improved the quality of the paper. This work was supported by the Scientific Research Foundation of Chongqing University of Arts and Sciences (Grant no. R2013SC12), Program for Innovation Team Building at Institutions of Higher Education in Chongqing (Grant no. KJTD201321), and the National Natural Science Foundation of China (nos. 11201505, 71271227).

#### References

- A. Zellner, “An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias,”
*Journal of the American Statistical Association*, vol. 57, no. 298, pp. 348–368, 1962. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - A. Zellner, “Estimators for seemingly unrelated equations: some exact finite sample results,”
*Journal of the American Statistical Association*, vol. 11, no. 58, pp. 977–992, 1963. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - L. Wang, H. Lian, and R. S. Singh, “On efficient estimators of two seemingly unrelated regressions,”
*Statistics & Probability Letters*, vol. 81, no. 5, pp. 563–570, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - M. Roozbeh, M. Arashi, and H. Niroumand, “On seemingly unrelated semi-parametric models,” in
*Proceedings of the 58th World Statistical Congress*, pp. 5125–5131, International Statistical Institute, 2011. View at: Google Scholar - S. R. Singh, L. C. Wang, and H. M. Song, “The superiorities of minimum bayes risk linear unbiased estimator in two seemingly unrelated regressions,”
*Journal of Statistical and Econometric Methods*, vol. 12, no. 3, pp. 153–174, 2013. View at: Google Scholar - N. S. Revankar, “Some finite sample results in the context of two seemingly unrelated regression equations,”
*Journal of the American Statistical Association*, vol. 69, no. 3, pp. 187–190, 1974. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - V. K. Srivastava and D. E. Giles,
*A Seemingly Unrelated Regression Equations Models*, vol. 4, Marcel Dekker Inc., New York, NY, USA, 1987. View at: MathSciNet - S. G. Wang, “Covariance improvement estimate of the parameters in seemingly unrelated regression models,” in
*Proceedings of the 2nd Japan China Symposium on Statistics*, pp. 318–321, 1986. View at: Google Scholar - A. Y. Liu and S. G. Wang, “A biased estimator in two seemingly unrelated regression model,”
*Chinese Journal of Applied Probability and Statistics*, vol. 7, no. 3, pp. 266–274, 1991. View at: Google Scholar | Zentralblatt MATH | MathSciNet - A. Y. Liu, “A improved principal component regression estimator in two seemingly unrelated regression model,”
*Application of Statistics and Management*, vol. 12, no. 2, pp. 70–75, 1993. View at: Google Scholar - S. M. Qiu,
*Improved c-k Estimators of Parameters in Seemingly Unrelated Regression System*, Hunan University, 2008. - M. Roozbeh, M. Arashi, and M. Gasparini, “Seemingly unrelated ridge regression in semiparametric models,”
*Communications in Statistics, Theory and Methods*, vol. 41, no. 8, pp. 1364–1386, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - X. R. Chen,
*The Parameter Estimation in Linear Regression Model*, Science Press, 1985. - C. T. Lin, “A class of two-stage regression estimation system,”
*Chinese Science Bulletin*, vol. 15, no. 14, pp. 840–842, 1984. View at: Google Scholar | MathSciNet - C. R. Rao, H. Toutenburg, Shalabh, and C. Heumann,
*Linear Models and Generalizations*, Springer, Berlin, Germany, 2008. View at: MathSciNet

#### Copyright

Copyright © 2014 Jibo Wu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.