Application of Support Vector Machines for Estimating Wall Parameters in Through-Wall Radar Imaging
In through-wall radar imaging (TWRI), ambiguities in wall characteristics including the thickness and the relative permittivity will distort the image and shift the imaged target position. To quickly and accurately estimate the wall parameters, an approach based on a support vector machine (SVM) is proposed. In TWRI problem, the nonlinearity is embodied in the relationship between backscatter data and the wall parameters, which can be obtained through the SVM training process. Measurement results reveal that once the training phase is completed, the technique only needs no more than one second to estimate wall parameters with acceptable errors. Then through-wall images are reconstructed using a back-projection (BP) algorithm by a finite-difference time-domain (FDTD) simulation. Noiseless and noisy measurements are discussed; the simulation results demonstrate that noisy contamination has little influence on the imaging quality. Furthermore, the feasibility and the validity are tested by a more realistic situation. The results show that high-quality and focused images are obtained regardless of the errors in the wall parameter estimates.
Though-wall radar imaging (TWRI) is a form of nondestructive detection that has applications in civil engineering and security. In TWRI, if the wall parameters such as the wall thickness and the relative permittivity are known in advance, the changes in the speed and the amplitude attenuation of the electromagnetic waves that pass through the wall can be calculated accurately. Moreover, the refraction point of the electromagnetic waves can be determined precisely. Hence, targets behind walls can be easily detected and located. There have been many studies on TWRI that have created high-quality images with known wall parameters [1–3]. However, wall parameters are generally not known a priori. If the wall parameters are not properly considered, the TWRI images will be fuzzy or distorted and the positions of the targets in the image will be incorrect.
Walls are commonly constructed with brick, wood, glass, plaster, or concrete block, and the propagation of EM waves in these materials differs. Efforts have been made to understand the effects of various common building materials. In addition, efforts have been made to image or locate the target through building walls with unknown characteristics [4–7]. Although these methods can provide high-quality, that is, focused, images, certain algorithms rely on knowledge of the wall parameters such as the dielectric constant, the wall thickness, and the conductivity.
In recent years, various studies have attempted to estimate the values of wall parameters. At several different transceiver-receiver separations various time-delay-only measurements were proposed for a wall parameter estimation. The estimated wall parameters can be utilized for improving the accuracy of real-time locating and tracking of moving humans [8, 9]. Through setting various targets located at various distances on the other side of the wall, the frequency domain data was converted to time domain and then mapped with spatial domain to estimate the wall parameters. But this technique can only be experimented in a known environment . Multichannel radar antennas were used to accurately and simultaneously estimate both the wall parameters and the target position . A linear trajectory was fitted to a set of target images assuming various wall thicknesses via the Radon transform for each assumed dielectric constant . The intersection of the trajectories corresponding to the various dielectric constants was taken as the estimated target position, which was then used to obtain estimates of the wall thickness and the dielectric constant. All above methods require the use of two or more antenna arrays or at least two measurements. Measurement methods are effective in a lab, but their usefulness is limited in practice. Other methods construct a cost function between wall parameters and a computer index, such as the sharpness of the target images and the entropy [13, 14]. These methods attempt to minimize the cost function and can produce satisfactory images, but they impose a significant computational burden. The estimation of wall parameters was approached as a least squares problem based on a forward model of electromagnetic wave propagation in a homogeneous wall . Two filter-based approaches were developed and can provide quick and precise estimates of wall parameters, but they do not work well in low-SNR conditions.
In this study, we use a novel approach to obtain quick and precise estimates of wall parameters. The approach is based on SVMs. The SVM, which was introduced by Vapnik, is a statistical learning method. The SVM is based on the VC dimension and structural risk minimization. By solving a convex quadratic programming problem, SVMs can find the global optimal solution rather than local minima and avoid overfitting. SVMs have a strong theoretical foundation and good generalization performance. The algorithm is based on limited sample information and can provide real-time results. Originally, SVMs were developed for solving binary classification problems. Recently, SVMs have been used for feature recognition in ground-penetrating radar (GPR) images. SVMs are capable of identifying features in GPR images with scarce data in nonlinear and high-dimensional problems . Through-wall radar is similar to GPR, so we address through-wall problems using an SVM. Several studies of this method have been conducted, and the results were satisfactory. Wang and Zhang [17, 18] were able to estimate the location and the electromagnetic characteristics of the target, but the method failed to produce a clear image of the target. Other studies have performed human activity classification based on micro-Doppler signatures [19, 20], but the methods used require that the target is moving and thus do not work with a static target.
To obtain an image of a target, we first estimate the wall parameters using an SVM and then construct the image based on the estimated parameters using the BP algorithm. This paper is organized as follows. In Section 2, we discuss the imaging geometry of TWRI, and a parameter estimation approach based on SVMs for through-wall detection is proposed. In Section 3, the performance of the proposed wall parameter estimation method is assessed, and the images obtained using the BP algorithm are given. Several conclusions are discussed in Section 4.
2. Materials and Methods
This section presents the basic formulation for TWRI using an SVM. A simulation model is employed, and the SVM is used to estimate the unknown parameters. Finally, the entropy criterion is described.
2.1. Image Reconstruction
TWRI belongs to the electromagnetic inverse problem. The information of the targets behind the walls is deduced according to limited information of receiving signals. Figure 1 shows a simple schematic of TWRI. In this study, we consider the 2D problem, where both the wall and the target are assumed to be infinitely high and invariant in the -axis. As shown in Figure 1, the domain contains three regions: regions I and III are free space and region II is the wall. The dielectric permittivity and the magnetic permeability of the free space are denoted by and . The relative permittivity and the magnetic permeability of the wall are denoted by and , respectively, and the thickness of the wall is denoted by . The transmitter position is , which is 0.05 m from the front side of the wall. The receiver position is , which is 0.04 m from the wall on the same side as the transmitter. The receiver moves along a scan line of length between and and collects the scattered field. The scan interval of the receiver is 0.02 m. The target is located in the imaging region, which is behind the wall and inaccessible to the observer. The imaging region is a rectangle bounded laterally by and and longitudinally by and .
Simulations were performed using the finite-difference time-domain (FDTD) method, which is an exact field computation method that has been successfully used to compute the propagation of EM waves through walls. In the FDTD simulation, the domain of the TWRI problem is discretized into square cells 1 cm on a side. The time resolution was s. To model the EM illumination through a homogeneous wall, the transmitter signal was assumed to be an UWB short pulse, a 1.2 ns Gaussian pulse modulated by a 2 GHz cosine wave. The receiver collects the scattered field. The scattered field at every sampling location is contained in the vector , where is the index of the sampling location. The sampling location is also the receiver location. The vector contains the only information available, and this information is limited and nonlinear in the location, the shape, the relative permittivity and conductivity of the targets and the thickness, and the relative permittivity of the wall parameters, which are all we want to know. The information of the targets can be determined directly by the scatter field based on the theory of the SVM [17, 18], but no more information can be got. So this paper is devoted to develop the relationship between the wall parameters and the scatter field. We represent the wall parameters as , where and is the conductivity of the wall. The relationship between and is generally expressed as follows:
Obviously, and have nonlinear relationship which is difficult to get directly. But in the SVM, we can suppose that is the input and is the output. Through training the input-output pairs by the SVM, the unknown function can be approximated formulated; then a simple, linear connection between and is obtained. So the uncertain wall parameters are predicted quickly and accurately from .
2.2. The Basic Theory of the SVM
In the SVM, the training dataset is , where denotes the space of the input patterns in a data vector, denotes the space of the output patterns in an element, and is the number of samples. Because the receiving signal of every receiver is different under the condition of different sample, the feature can be extracted by every receiver. Thus every vector contains features, where is the number of the receivers. Since the SVM can only predict one parameter at one time, the thickness such as relative permittivity of the wall has its own mapping to the scattered data. Here we take , as an example. Firstly we suppose a regression function whose form iswhere denotes the dot product in , is weight vector, and is bias of the regression function. The optimization regression function based on the support vector regression (SVR) is built on structural risk minimization principle. The goal is error-free fitting all data by a linear function with proper accuracy which is . is a constant number set in advance. At the same time the slack variables and are introduced for infeasible constraints for some acceptable errors. Therefore, the problem can be treated as an original optimization issue as follows:
The constant is a penalty parameter which determines the trade-off between the flatness of and the amount up to which deviation larger than is tolerated. The constrained optimization problem above is solved by Lagrange multiplier condition method and is transformed to its dual problem, that is,
The optimal solution of the constrained quadratic programming problem (CQP) is , where and are Lagrange multipliers. is a nonlinear mapping through which is mapped to the higher-dimensional space . The transformed vector and are linear in the higher-dimensional space, but is unknown explicitly. To simplify the complexity of the algorithm, the kernel function which satisfies Mercer’s condition is introduced. Frequently used kernel functions include linear function, polynomial function, radial basis function (RBF), and sigmoid function. Among the four types, the RBF has the best performance and is used in this study. The RBF is given bywhere is the variance of the kernel function, which is determined using cross-validation. So the dot product in higher-dimensional is solved skillfully while is not important any longer. Then the decision function is as follows:where is a training pattern whose corresponding Lagrange multiplier is nonzero, such training patterns are called support vectors (SVs) and is the number of SVs. The threshold value which satisfies Karush-Kuhn-Tucker (KKT) condition has two expressions according to or , which both in the open interval . If is selected,
If is selected,
The predicted value for a new input is obtained according to (6). The process of establishing the mapping for the relative permittivity is the same as the one for the thickness of the wall.
2.3. Entropy Criterion
The ultimate goal is to construct an image of the target. Using the estimated wall parameters, we can image the target behind the wall with the BP algorithm. To assess the image quality, the entropy of the image is defined as inwhere denotes the field amplitude of the th FDTD cell. The smaller the value of the entropy criterion is, the better the quality is. The values of the entropy criterion for the images constructed using actual and estimated values of the wall parameters are compared to test whether the image obtained with the estimated wall parameters is satisfactory.
3. Results and Discussion
To show the effectiveness of the method based on the SVM, results from numerical simulations are presented in this section. Referring to the schematic of TWRI shown in Figure 1, the imaging region is a rectangle defined by , m, m, and m. The position of the transmitter is m, m. The positions of the receivers are from m to m, with m for both. A metal target with its center located at (0.9 m, 1.4 m) and a radius of 0.15 m was assumed to exist behind the wall in the imaging region.
The training and testing data for the SVM were obtained by repeated simulations in FDTD, with variations in the wall thickness and the relative permittivity, as follows:
One-half of the dataset was used for the training dataset, and the other half of the dataset was used as the testing dataset. The model was obtained after the training of the SVM and then was applied to the testing dataset to get the estimation results. Figure 2 displays the relationships between the actual and estimated values of the wall parameters, that is, the thickness and the relative permittivity of the wall.
(a) Wall thickness
(b) Relative permittivity
Figure 3 shows the errors in the estimation of the two wall parameters. In Figure 3(a), the estimation error for the wall thickness is generally less than 0.005 m. In Figure 3(b), the estimation error for the relative permittivity is generally less than 0.1. So the SVM can estimate the wall parameters with small errors in TWRI. Moreover, if the model is obtained, the estimation time is no more than 1 s. The estimation approach based on the SVM will not increase the imaging time.
(a) Wall thickness
(b) Relative permittivity
The above-mentioned analysis is for noiseless circumstance. In reality, it is important that the estimated method is robust under noise contamination. So we also simulate the noisy environment. In FDTD simulation a wall is added with the actual values of , m. Other parameters are the same as before, except that dB Gaussian noise whose interval is 5 dB is added in , and the results are shown in Figures 4 and 5. In Figure 4, the estimated value of relative permittivity and wall thickness is given and the horizontal line represents their actual value. The estimated value of relative permittivity is always higher than the actual value and decreases gradually with the increasing of the noise. The changing trend of the wall thickness is approximately the same as the relative permittivity. The estimated value and the actual value of wall thickness are almost identical when SNR is higher than 65 dB.
Figure 5 displays the entropy under noisy situation. The entropy keeps almost unchanged when SNR is higher than 25 dB. Figure 5 combined with Figure 4 shows that the high-quality imaging is got when the error is concealed out or the predicted value is almost equal to the actual value [12, 15] when SNR is no less than 25 dB.
We note that, in this example, the target is known, and we can estimate the wall parameters very well and detect the target successfully. However, in many applications, the target is unknown, as are the wall parameters. This is a challenge for the method. As previously discussed, the target is a cylinder. With the center of the target unchanged, the wall parameters for other values of the target radius were estimated. We selected the values m in increments of 0.02 m. Figure 6 shows the estimated values of the wall parameters for the various values of the target radius. The estimated values are not equal to the actual ones, and several are quite different. We observe that if m, the estimated value of the wall thickness is greater than the actual value and the estimated value of the relative permittivity is less than the actual value. However, if m, this trend is not followed.
From Figure 7 we know that the entropy of the image reaches the minimum when m no matter with the actual values of the wall parameters or the estimated ones, and the error is nearly zero. This is because the model was constructed for m. At this radius, the estimated values of the wall parameters are the most consistent with the actual ones, so the image quality is the best.
When m, the entropy for the estimated values of the wall parameters differs from that for the actual values. However, although the values of the wall parameters are not correctly estimated, a reasonable value for the entropy nevertheless can be achieved. In Figure 7, the entropy with the estimated wall parameters is greatest for m. Because the estimated values of the wall parameters are both higher than the actual ones, the image quality is the worst.
To check the robust of the approach, Figures 8(a), 8(b), and 8(c) give the BP image results with the target radius of 0.17 m in estimated wall parameters with 5 dB noise, estimated value with 35 dB noise, and actual values. The estimated wall parameters with 5 dB, 35 dB are , m, , m, respectively. In all cases, the target image is well focused, but the location of the target image constructed with the estimated wall parameters is closer to the wall (i.e., in the range direction) than that of the target image constructed with the actual wall parameters. The imaging quality with noise is slightly inferior to that with actual values.
(a) Estimated values with SNR = 5 dB
(b) Estimated values with SNR = 35 dB
(c) Actual value
Knowledge of the exact values of the wall parameters permits the construction of focused images and the determination of the exact position of an object behind a wall. Unfortunately, the wall characteristics such as the thickness and the relative permittivity are unknown parameters in practical TWRI applications. In this study, a novel approach based on SVMs is used to estimate the values of the wall parameters. The approach can estimate the wall thickness and the relative permittivity quickly and accurately. Images obtained using the BP algorithm validate the efficiency of the proposed method. In a realistic situation, the estimated values of the wall parameters can be used to form a reasonably focused image regardless of the estimation error. The approach is robust and high-fidelity under noisy situation. In this study, the target behind the wall is cylindrical in shape; other shapes are also suitable. In addition, the approach based on SVMs is shown to be effective for the case of a single target, but this approach is not suitable for the case of multiple targets. Estimation of the wall parameters when there are multiple targets will be studied in the future.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work is supported by the National Natural Science Foundation of China (Grant nos. 61071022 and 61372045).
P. Protiva, J. Mrkvica, M. Safarik, R. Sikl, V. Vlasak, and J. Machac, “An improved technique for estimating wall parameters from time-delay through-wall radar measurements,” in Proceedings of the 22nd International Conference on Radioelektronika, pp. 1–4, April 2012.View at: Google Scholar
S. Kaushal and D. Singh, “Role of signal processing for estimating the wall thickness for TWI system,” in Proceedings of the 4th International Conference on Computing, Communications and Networking Technologies (ICCCNT '13), pp. 1–7, IEEE, Tiruchengode, India, July 2013.View at: Publisher Site | Google Scholar
X. Gu and Y. H. Zhang, “Autofocus imaging simulation for through-wall radar by using FDTD with unknown wall characteristics,” in Proceedings of the Asia-Pacific Microwave Conference (APMC '10), pp. 1657–1660, December 2010.View at: Google Scholar
X. Y. Xie, P. Li, and L. B. Liu, “GPR identification of voids inside concrete based on support vector machine (SVM) algorithm,” in Proceedings of the 14th International Conference on Ground Penetrating Radar (GPR '12), pp. 381–386, IEEE, Shanghai, China, June 2012.View at: Google Scholar
F. F. Wang and Y. R. Zhang, “The support vector machine for dielectric target detection through a wall,” Journal of Electromagnetic Waves and Applications, vol. 25, pp. 75–84, 2011.View at: Google Scholar
F.-F. Wang and Y.-R. Zhang, “An electromagnetic inverse scattering approach based on support vector machine,” Acta Physica Sinica, vol. 61, no. 8, pp. 084101-1–084101-7, 2012 (Chinese).View at: Google Scholar
X. X. Liu, H. Leung, and G. A. Lampropoulous, “An intelligent through-the-wall recognition system for homeland security,” in Proceedings of the IEEE World Congress on Computational Intelligence, pp. 2084–2090, Hong Kong, 2008.View at: Google Scholar