Research Article  Open Access
Kai Huang, MingYi You, YunXia Ye, Bin Jiang, AnNan Lu, "Direction of Arrival Based on the Multioutput Least Squares Support Vector Regression Model", Mathematical Problems in Engineering, vol. 2020, Article ID 8601376, 8 pages, 2020. https://doi.org/10.1155/2020/8601376
Direction of Arrival Based on the Multioutput Least Squares Support Vector Regression Model
Abstract
The interferometer is a widely used directionfinding system with high precision. When there are comprehensive disturbances in the directionfinding system, some scholars have proposed corresponding correction algorithms, but most of them require hypothesis based on the geometric position of the array. The method of using machine learning that has attracted much attention recently is data driven, which can be independent of these assumptions. We propose a directionfinding method for the interferometer by using multioutput least squares support vector regression (MLSSVR) model. The application of this method includes the following: the construction of MLSSVR model training data, training and construction of the MLSSVR model, and the estimation of direction of arrival. Finally, the method is verified through numerical simulation. When there are comprehensive deviations in the system, the directionfinding accuracy can be effectively improved.
1. Introduction
Direction of arrival (DOA) estimation is a widely studied problem in various fields, including wireless communications [1], radar detection [2–4], target localization, and tracking [5, 6]. Various methods have been proposed to estimate DOA of emitters, such as interferometer [7, 8] and array processing [9–11].
The interferometer estimates the DOA based on the phase difference of different directionfinding baselines. The accuracy of interferometer is sensitive to the phase difference of baselines. In engineering applications, there may be various deviations, such as phase inconsistency between channels, mutual coupling between the antennas, and antenna location deviations. In order to achieve optimal directionfinding performance, the methods including correlationcoefficient [12], weighted least squares [13], and parameter estimation [14] are always used. To facilitate method implementation, simplified models are established to describe the effects of various deviations, and autocalibration processes are proposed to improve DOA estimation precision [15–21]. Most of the simplifications on array deviations are made from mathematical perspectives approximately with various additional assumptions, such as uniform linearity or circularity array geometries [15–17], constrained antennas location deviations within a particular line or plane [18, 19], and intersensor independence of gain and phase errors [20, 21].
However, the effect of comprehensive disturbances, which probably exist in practical systems, is much more difficult to be modeled precisely and calibrated automatically. The multiple deviations have a great influence on the amplitude and phase of each receiving channel, which greatly affects the performance of the interferometer directionfinding system. The commonly used method to reduce the effect of multiple deviations is the external field calibration method; i.e., for the different directions of incoming signal with a large signaltonoise ratio, the measured values of the phase difference from baselines are directly recorded and saved together with the known calibration directions [22]. In the application of the directionfinding system, the DOA is calculated by least squares between the measured value of each phase difference with the saved values from the external field. The external field calibration method is simple in principle and easy to operate and has been widely used in engineering. Due to the influence of multiple deviations, even if there are different gains of each antenna, the external field calibration method always uses the equalweight least squares method. The influence of the inconsistency between the antennas on the directionfinding accuracy has not been fully considered, i.e., the external field calibration method fails to maximize the effectiveness of the directionfinding system.
Recently, some scholars have used machine learning to solve the DOA estimation with comprehensive disturbances [23–31]. Machine learning have significant advantages over traditional methods based on array geometries and least square in solving directionfinding problems in complicated scenarios with multiple deviations, such as radial basis function (RBF) [23], least squares support vector classification (LSSVC) [24], support vector regression (SVR) [25–29], and deep neural networks (DNN) [30, 31]. These methods are data driven and do not rely on preassumptions about array geometries and whether they are calibrated or not. Despite its potential usefulness, the standard formulation of the LSSVR cannot cope with the multioutput case [32]. Therefore, with the angles around 0° and 360°, the accuracy has not been effectively improved. The DNN for direction finding requires large samples to perform well, resulting in too long model training time, and if the samples size is insufficient, this method cannot effectively perform. This paper proposes a directionfinding method for the interferometer based on the multioutput least squares support vector regression (MLSSVR) model. The multioutput mode can avoid large errors in the singleoutput mode around 0° and 360°, and it is expected to achieve higher directionfinding accuracy within the angle range. Due to the MLSSVR model, the model training time can be greatly shortened. The application of this method includes the following: (1) the construction of MLSSVR model training data, (2) training and construction of the MLSSVR model, and (3) the estimation of direction of arrival.
The organization of the rest of the paper is as follows. Section 2 formulates the array output model with complicated deviations. Section 3 presents the process of the MLSSVR model for DOA estimation. Section 4 carries out simulations to verify the validity of the method. Section 5 concludes this work.
The main notation used in this paper is listed in Table 1.

2. Problem Formulation
Assume that the waveform of signal is s(t) and direction of signal is . Then, the antenna output is
When the comprehensive disturbances exist in the directionfinding system, such as phase inconsistency between channels, mutual coupling between the antennas, and antenna location deviations, these disturbances cause deviations to , and the actual antenna output is
is the direction vector of array with comprehensive disturbances.
The phase difference between the antennas may be far away from the theoretical value. Obviously, at this time, highprecision direction finding cannot be performed according to the theoretical geometry of the antennas. In this case, the external field calibration method can be used generally. We propose the MLSSVR model to achieve higherprecision direction finding, and this method is data driven and do not rely on preassumptions about array geometries and whether they are calibrated or not.
3. MLSSVR Model for DOA Estimation
3.1. Construction Training Data of the MLSSVR Model
For the MLSSVR model, the training data are constructed as a matrix comprising phase differences of baselines and their corresponding vectors related to the direction of incoming signal, which iswhere is the phase difference vector of the ith training sample, where T is the transposed symbol, and is the ith vector which is related to the DOA of the signal. In order to avoid the large directionfinding error around 0° or 360° caused by the unreasonable loss function of the singleoutput SVR model, we use the dual output form, namely,
Here, is the DOA corresponding to the ith training sample.
It should be pointed out that the MLSSVR model is not acquired through only one experiment, and the acquisition of its training data should be carried out under the condition of similar signaltonoise ratio in the application scenario. On the other hand, in training data of the MLSSVR model, for a given DOA, it is usually necessary to obtain several samples (generally more than 10 [32]). In addition, the DOA of the signal should cover the angle range in the application as much as possible, namely,
Here, and represent the upper and lower limits of the possible direction of arrival, respectively.
If the directions of adjacent known incoming signal in the training samples are not the same, they will differ by a fixed step , i.e., or . The value should generally be less than the requisite accuracy of direction finding in the application. Between and , the number of sample categories is M.
3.2. Train and Build a MLSSVR Model
Given a data set , and .The purpose of multioutput regression is to give a set of input vectors and predict a set of output vectors . The MLSSVR model solves this problem by finding and that minimize the following objective function with constraints:
Here, , , is the mapping function (kernel function) of , whose purpose is to transform into a more distinguishable highdimensional feature space with dimensions, , and is a slack variable; where is a matrix, and is a regularization parameter.
In order to achieve the solution of (6), the objective function can be constructed as a heuristic Bayesian architecture. Let , where contains common parameter information and carries the individual information of each sample. To obtain a solution , , and , the following objective function with constraints can be constructed:
Among them, is another regularization parameter.
Equation (7) can be transformed into Lagrange’s equation, and then, the optimal solutions , , and can be achieved using the Karush–Kuhn–Tucker (KKT) optimization conditions. After that, the corresponding decision function is [32]
3.3. DOA Estimate
Given a set of phase difference data , based on equation (8), we have
Based on the result of equation (9), the final DOA is estimated as
Here, atan2 is the fourquadrant inverse tangent function.
4. Simulations and Analysis
This section gives a numerical simulation in a typical scenario to demonstrate the effectiveness of the MLSSVR model applied to direction finding. Consider a 5element uniform circular array with a radiustowavelength ratio of 0.4. The radial basis kernel function is adopted to solve formula (8): . After multiple trainings, determine the parameters and in formula (7) and the radial basis function parameter .
4.1. Phase Inconsistency between Channels
Assume that the RMSE of phase difference under 10 dB signaltonoise ratio is 25°, 5°, 5°, 10°, and 15° in 5 channels, respectively. The training data sets consist of phase difference and cosine and sine functions of each angle from 0° to 360° with a step of 1°, and 10 groups of samples are collected per angle, i.e., the number of training data sets L = 3600. Under the same signaltonoise ratio, a total of 3600 testing samples of phase difference are generated from 0° to 360°. As a comparison, the DOA of testing samples is also calculated by using least squares (LS) with training data sets. Figure 1 shows the directionfinding error of testing samples.
4.2. Mutual Coupling between the Antennas
When there is mutual coupling between antennas, assume the mutual coupling matrix as follows:
Selecting 10 samples for each angle from 0° to 360°, and the training data sets consist of phase difference and cosine and sine functions of each angle. Under the same signaltonoise ratio and mutual coupling, 3600 groups of phase difference from different DOA are generated as the testing samples. Figure 2 shows the directionfinding error of testing samples.
4.3. Both Phase Inconsistency and Mutual Coupling
In the presence of phase inconsistency and mutual coupling simultaneously, 3600 groups of phase difference and cosine and sine functions of DOA are generated as the training data sets for 0°∼360° with a step of 1°, and 10 samples are selected for each angle. Under the same signaltonoise ratio, with the comprehensive disturbances which consist of phase inconsistency and mutual coupling, the testing samples are composed of 3600 groups of phase difference from different DOA. Figure 3 shows the directionfinding error of testing samples.
4.4. Different SNRs
In the presence of phase inconsistency and mutual coupling simultaneously, the training data sets are generated in the same way as mentioned in Section 4.3 under 10 dB SNR, while testing samples are generated under the 5 dB SNR. The number of training data sets and testing samples are both 3600. Figure 4 shows the directionfinding error of testing samples.
Table 2 shows the RMSE of DOA of the testing samples by using LS and MLSSVR, respectively, under different disturbance scenarios. From the results in Table 2, it can be seen that the MLSSVR model can significantly reduce the directionfinding error and obtain highprecision directionfinding results in the full range of 360°.

4.5. Comparison of MLSSVR and Neural Networks
The training data sets and testing samples are generated in the same way as mentioned in Section 4.3. The number of training data sets and the number of testing samples are both 3600. In additional, both phase inconsistency and mutual coupling are still in existence. For the same training data sets and testing samples, the twolayer convolutional neural network is used to estimate the DOA. The MaxEpochs is set to 15 (For the neural network model, it was obvious that the value of MaxEpochs in neural network could be larger to reduce the directionfinding error of the model. Here, a small value was deliberately selected to reduce the training time of neural network to approximate the training time of MLSSVR model.), so that the training time of the neural network model is close to the MLSSVR model. Figure 5 shows the directionfinding error of testing samples.
Table 3 shows the MLSSVR model is suitable for small training data sets, and compared with neural network model, the MLSSVR model ensures directionfinding accuracy while shortening training time.

5. Conclusion
The standard formulation of support vector regression can only deal with the singleoutput case, and when it is applied to radio directionfinding, there may be a problem that the directionfinding results have large errors around 0° or 360°. This paper applies the MLSSVR model to the field of radio directionfinding; the training data sets consist of phase differences of each baseline and the cosine and sine functions of each angle from 0° to 360°. The DOA is calculated by the sine function and cosine function of the incident angle, thus avoiding a larger case finding the error results in the vicinity of 0° or 360°. In the case of comprehensive disturbances in the directionfinding system, the effectiveness of the MLSSVR model is verified by numerical simulation. And with small training data sets, it can still effectively improve the directionfinding accuracy compared to the LS method.
Data Availability
All training data sets and testing samples used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work was supported by the No. 36 Research Institute of CETC under the project no. CX05.
References
 L. Wan, L. Sun, X. Kong, Y. Yuan, K. Sun, and F. Xia, “Taskdriven resource assignment in mobile edge computing exploiting evolutionary computation,” IEEE Wireless Communications, vol. 26, no. 6, pp. 94–101, 2019. View at: Publisher Site  Google Scholar
 F. Wen, Z. Zhang, K. Wang, G. Sheng, and G. Zhang, “Angle estimation and mutual coupling selfcalibration for ULAbased bistatic MIMO radar,” Signal Processing, vol. 144, pp. 61–67, 2018. View at: Publisher Site  Google Scholar
 F. Wen and J. Shi, “Fast direction finding for bistatic EMVSMIMO radar without pairing,” Signal Process, vol. 173, 2020. View at: Publisher Site  Google Scholar
 X. Wang, L. Wang, X. Li, and G. Bi, “Nuclear norm minimization framework for DOA estimation in MIMO radar,” Signal Processing, vol. 135, pp. 147–152, 2017. View at: Publisher Site  Google Scholar
 L. Wan, X. Kong, and F. Xia, “Joint rangeDopplerangle estimation for intelligent tracking of moving aerial targets,” IEEE Internet of Things Journal, vol. 5, no. 3, pp. 1625–1636, 2018. View at: Publisher Site  Google Scholar
 K. C. Ho and Y. T. Chan, “An asymptotically unbiased estimator for bearingsonly and Dopplerbearing target motion analysis,” IEEE Transactions on Signal Processing, vol. 54, no. 3, pp. 809–822, 2006. View at: Publisher Site  Google Scholar
 J.H. Lee, J.H. Lee, and J.M. Woo, “Method for obtaining three and fourelement array spacing for interferometer directionfinding system,” IEEE Antennas and Wireless Propagation Letters, vol. 15, pp. 897–900, 2016. View at: Publisher Site  Google Scholar
 J. H. Lee, J. K. Kim, H. K. Ryu, and Y. J. Park, “Multiple array spacings for an interferometer direction finder with high directionfinding accuracy in a wide range of frequencies,” IEEE Antennas and Wireless Propagation Letters, vol. 17, no. 4, pp. 563–566, 2018. View at: Publisher Site  Google Scholar
 D. Meng, X. Wang, M. Huang, L. Wan, and B. Zhang, “Robust weighted subspace fitting for DOA estimation via block sparse recovery,” IEEE Communications Letters, vol. 24, no. 3, pp. 563–567, 2020. View at: Publisher Site  Google Scholar
 J. Zheng, T. Yang, H. Liu, and T. Su, “Efficient data transmission strategy for IIoTs with arbitrary geometrical array,” IEEE Transactions on Industrial Informatics, vol. 99, Article ID 2993586, 2020. View at: Publisher Site  Google Scholar
 J. Zheng, T. Yang, H. Liu, T. Su, and L. Wan, “Accurate detection and localization of UAV swarmsenabled MEC system,” IEEE Transactions on Industrial Informatics, vol. 99, Article ID 3015730, 2020. View at: Publisher Site  Google Scholar
 C. S. Park and D. Y. Kim, “The fast correlative interferometer direction finder using I/Q demodulator,,” in Proceedings of the AsiaPacific Conference on Information Processing, pp. 1–5, Busan, South Korea, 2006. View at: Google Scholar
 G. Zhu, Y. Wang, and S. Mi, “Research on direction finding technique based on the combination of weighted least squares method and MUSIC algorithm,” Rader Science and Technology, vol. 17, no. 3, pp. 319–323, 2019. View at: Google Scholar
 J. Zheng, H. Liu, and Q. H. Liu, “Parameterized centroid frequencychirp rate distribution for LFM signal analysis and mechanisms of constant delay introduction,” IEEE Transactions on Signal Processing, vol. 65, no. 24, pp. 6435–6447, 2017. View at: Publisher Site  Google Scholar
 B. Friedlander and A. J. Weiss, “Direction finding in the presence of mutual coupling,” IEEE Transactions on Antennas and Propagation, vol. 39, no. 3, pp. 273–284, 1991. View at: Publisher Site  Google Scholar
 T. Svantesson, “Modeling and estimation of mutual coupling in a uniform linear array of dipole,” in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 2961–2964, IEEE, Phoenix, AZ, USA, March 1999. View at: Google Scholar
 M. Lin and L. Yang, “Blind calibration and DOA estimation with uniform circular arrays in the presence of mutual coupling,” IEEE Antennas and Wireless Propagation Letters, vol. 5, no. 1, pp. 315–318, 2006. View at: Publisher Site  Google Scholar
 A. J. Weiss and B. Friedlander, “Array shape calibration using eigenstructure methods,” Signal Processing, vol. 22, no. 3, pp. 251–258, 1991. View at: Publisher Site  Google Scholar
 B. P. Flanagan and K. L. Bell, “Array selfcalibration with large sensor position errors,” Signal Processing, vol. 81, no. 10, pp. 2201–2214, 2001. View at: Publisher Site  Google Scholar
 A. Paulraj and T. Kailath, “Direction of arrival estimation by eigenstructure methods with unknown sensor gain and phase,” Acoustics, Speech, and Signal Processing,” in Proceedings of the ICASSP’85. IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 640–643, IEEE, Tampa, FL, USA, April 1985. View at: Publisher Site  Google Scholar
 Y. Li and M. Er, “Theoretical analyses of gain and phase error calibration with optimal implementation for linear equispaced array,” IEEE Transactions on Signal Processing, vol. 54, no. 2, pp. 712–723, 2006. View at: Google Scholar
 Q. Zhai, “Research on least square directionfinding method,” Radio Engineering, vol. 38, no. 3, pp. 55–57, 2008. View at: Google Scholar
 C. S. Shieh and C. T. Lin, “Direction of arrival estimation based on phase differences using neural fuzzy network,” IEEE Transactions on Antennas and Propagation, vol. 48, no. 7, pp. 1115–1124, 2000. View at: Google Scholar
 C. G. Christodoulou, J. A. Rohwer, and C. T. Abdallah, “The use of machine learning in smart antennas,” in Proceedings of the IEEE Antennas and Propagation Society Symposium, pp. 321–324, IEEE, Monterey, CA, USA, June 2004. View at: Publisher Site  Google Scholar
 J. A. Rohwer, C. T. Abdallah, and C. G. Christodoulou, “Least squares support vector machines for direction of arrival estimation with error control and validation,” in Proceedings of the GLOBECOM’03. IEEE Global Telecommunications Conference, pp. 2172–2176, IEEE, San Francisco, CA, USA, December 2003. View at: Publisher Site  Google Scholar
 C. A. M. Lima, C. Junqueira, R. Suyama, F. J. V. Zuben, and J. M. T. Romano, “Leastsquare support vector machines for DOA estimation: a stepbystep description and sensitivity analysis,” in Proceedings of the International Joint Conference on Neural Networks, pp. 3226–3231, Montreal, Canada, July 2005. View at: Publisher Site  Google Scholar
 S. Vigneshwaran, N. Sundararajan, and P. Saratchandran, “Direction of arrival (DOA) estimation under array sensor failures using a minimal resource allocation neural network,” IEEE Transactions on Antennas and Propagation, vol. 55, no. 2, pp. 334–343, 2007. View at: Publisher Site  Google Scholar
 M. Dehghanpour, V. T. T. Vakili, and A. Farrokhi, “DOA estimation using multiple kernel learning SVM considering mutual coupling,” in Proceedings of the 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems, pp. 55–61, Bucharest, Romania, September 2012. View at: Publisher Site  Google Scholar
 R. Wang, B. Wen, and W. Huang, “A support vector regressionbased method for target direction of arrival estimation from HF radar data,” IEEE Geoscience and Remote Sensing Letters, vol. 15, no. 5, pp. 674–678, 2018. View at: Publisher Site  Google Scholar
 Z.M. Liu, C. Zhang, and P. S. Yu, “Directionofarrival estimation based on deep neural networks with robustness to array imperfections,” IEEE Transactions on Antennas and Propagation, vol. 66, no. 12, pp. 7315–7327, 2018. View at: Publisher Site  Google Scholar
 S. Abeywickrama, L. Jayasinghe, H. Fu, S. Nissanka, and C. Yuen, “RFbased direction finding of UAVs uing DNN,” in Proceedings of the IEEE International Conference on Communication Systems (ICCS), IEEE, Chengdu, China, December 2018. View at: Publisher Site  Google Scholar
 S. Xu, X. An, X. Qiao, L. Zhu, and L. Li, “Multioutput leastsquares support vector regression machines,” Pattern Recognition Letters, vol. 34, no. 9, pp. 1078–1084, 2013. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2020 Kai Huang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.