Abstract
The camera always suffers from image instability on the moving vehicle due to the unintentional vibrations caused by road roughness. This paper presents a novel adaptive neural network based on sliding mode control strategy to stabilize the image captured area of the camera. The purpose is to suppress vertical displacement of sprung mass with the application of active suspension system. Since the active suspension system has nonlinear and time varying characteristics, adaptive neural network (ANN) is proposed to make the controller robustness against systematic uncertainties, which release the model-based requirement of the sliding model control, and the weighting matrix is adjusted online according to Lyapunov function. The control system consists of two loops. The outer loop is a position controller designed with sliding mode strategy, while the PID controller in the inner loop is to track the desired force. The closed loop stability and asymptotic convergence performance can be guaranteed on the basis of the Lyapunov stability theory. Finally, the simulation results show that the employed controller effectively suppresses the vibration of the camera and enhances the stabilization of the entire camera, where different excitations are considered to validate the system performance.
1. Introduction
Camera stabilization is very important for visual guidance in autonomous vehicle, and the goal of image stabilization is to remove unwanted motion from dynamic camera sequences [1]. The better image-acquisition process will increase the feasibility and reliability of the process and analysis afterward. Current efforts in the research of image stabilization techniques can be broadly classified as three major categories: optical stabilization [2], digital image stabilization [3], and mechanical stabilization [4]. The ability of vibration amplitude control in optical and digital image stabilization is relatively limited. Different from former two stabilizers, mechanical stabilization involves stabilizing the entire camera, not just the image. It is suitable for large camera moving situation. In the condition of the camera fixed on the top of the car, the vertical vibration amplitude of the camera needs to be reduced. Therefore, active suspension system (ASS) is a kind of mechanical stabilization that can suppress the large vertical vibration caused by road roughness.
Active suspension system has been widely used in both military and civil vehicles [5–7]. Compared with the conventional suspension, the force actuator is added to provide energy to the suspension system, which enables the suspension to control the attitude of the vehicle body [8]. In previous works such as [9, 10], they ignored the actuator dynamics. However, the nonlinear dynamic of the hydraulic actuator should be considered to improve the performance of the control system [11]. The control strategy of active suspension system has attracted many researchers’ attention in the past few decades. Different control approaches have been applied, such as H [12], LQG control [13], fuzzy control [14], and artificial neural networks [15]. The road disturbances, the measurement errors, and the dynamic uncertain model are the key factors that affect the control performance.
In reality, the camera’s vibrations are inevitable and unpredictable. The vehicle body can provide a stable platform for the camera to detection of the obstacles with application of active suspension system. For a nonlinear active suspension system with bounded uncertainty and external disturbance, the sliding mode control (SMC) has the advantage of robustness to improve the antidisturbance ability of the system. In [16], the state predictors along with SMC technique are applied to active suspension system, which consider the time delay of the data transmission. Mixed control strategies are proposed in [17], and an enhanced adaptive self-fuzzy sliding mode controller for a quarter-car active suspension system is presented. Furthermore, an adaptive sliding controller is used with the function approximation approach for nonlinear system containing bounded unknown time-varying uncertainties in [18]. Besides the SMC strategy, neural network approach has received increasing attention mainly due to its advantages of nonlinear mapping properties and its ability to deal with uncertainty [19]. However, in traditional multilayer neural controller, the relatively complex structure of neuron network takes much time for computation and weight adjustment. An adaptive neural network with learning and self-tuning ability could be used to overcome the drawbacks.
This paper lays an emphasis on designing a controller with a quarter-car active suspension to suppress vertical vibration of the camera so that the displacement of the sprung mass changes as small as possible. In this way, we propose a sliding mode controller combined with adaptive neural networks approach to stabilize the image captured area of the camera. In the meantime, the dynamics of the hydraulic actuator is considered and can track the desired force with PID controller in the inner loop. Owing to the parameters of the model which are nonlinear, conventional adaptive schemes are not applicable. Adaptive radial basis function neural network (RBFNN) [20, 21] is employed to make the controller robustness against system uncertainties and the update laws of the weighting matrix are derived on the basis of the Lyapunov stability theory. The closed loop stability and asymptotic convergence performance can be guaranteed. Finally, the effectiveness of the proposed control approach is validated by simulations under different road profiles.
This paper is organized as follows. Section 2 gives suspension system dynamic. Section 3 develops the adaptive NN controller. In Section 4, the results of computer simulation of the controller are presented. Section 5 concludes this paper.
2. Suspension System Dynamic and Problem Formulation
This paper considers the quarter-car model [22] with a camera installed on the top of vehicle as shown in Figure 1. The camera is rigidly connected with the vehicle body. The sprung mass represents the car body and unsprung mass is . The tire is modeled as a linear spring with stiffness . and are the linear damping and stiffness of the suspension system, respectively. Variables , , and are the displacement of the body, wheel, and road profile, respectively. A hydraulic actuator between the sprung and unsprung masses can exert a force .
The dynamic equations of the suspension system can be expressed as
The electrohydraulic actuator comprises a servo-valve and a hydraulic cylinder as shown in Figure 2. Detailed introduction of such a hydraulic actuator can be found in [23]. The spool valve system is formulated aswhere is the control voltage and is the mechanical delay time constant of the servo-valve system. is the conversion gain.
The dynamic of the hydraulic cylinder equation is given by [24]where is area of piston, meanwhile, , , and are the hydraulic parameters which may be time varying. Consider , , and , where is bulk modulus of hydraulic fluid, is the total volume of actuator cylinder chamber, is the leakage coefficient, is the discharge coefficient, is the spool valve area gradient, is the hydraulic fluid density, and is the hydraulic supply pressure.
Remark 1 (see [25]). The practical hydraulic actuator has the properties of inherent nonlinear and time-varying characteristics, and precise parameters in (3) are not easy to estimate which is due to the uncertainties in the actuator dynamic model. Furthermore, the uncertainties in the model are bounded.
Select the state variables as , where , the camera (sprung mass) displacement; , camera (sprung mass) velocity; , unsprung mass displacement; , unsprung mass velocity; is external disturbances; and . Then, the equation of quarter-car active suspension system with actuator dynamic is given aswhere
Actually, the sprung mass is always time varying. The system dynamics can be simplified aswhere is an unknown bounded function and is the time-varying control gain. From (4), we can obtain
The objective of this paper is to design a controller to suppressing vertical vibration of the camera so that the target is stable in image plane. Since the camera is in rigid connection with the car body, the displacement of the car body can reflect the vibration situation of the camera in the following analysis.
Lemma 2 (see [26]). Let be a continuous function, which is defined on a compact set . Then, there exists a neural networks system which can approximate with arbitrary accuracy, such thatwhere is the ideal constant weight vector, is the RBFs vector, is the number of the neurons, and is the approximation error which is minimized by the ideal vector :Assuming that is bounded, with being an unknown constant. is Gaussian function; that is,with and representing the centers and widths of the Gaussian functions, and is the dimension of .
3. Controller Design
The proposed control scheme consists of two loops as shown in Figure 3. The nonlinearity of the hydraulic actuators and their force generation capabilities are also considered in control design. The outer loop performs a position control of the vehicle body, and the desired value of is zero. The inner loop is the PID controller for tracking purpose. The RBFNN approach is employed to approximate the unknown function and . This control method may be much more feasible in practical application.
3.1. Designing Inner Loop
In order to track the desired force for the inner loop, a PID controller is used to control the electrohydraulic actuators. The PID controller can be designed to stabilize the closed loop system and provide suitable tracking performance [27]. The PID controller is given as follows:where is the proportional gain, is the integral gain, and is the differential gain. The error is defined aswhere is the desired force and is the actual force generated by the actuator.
3.2. Designing Outer Loop
According to RFB neural network stated previously, a novel sliding mode controller for a quarter-car active suspension systems can be developed. The sliding surface is defined aswhere is the convergent rate of on the sliding surface. The derivative of above equation (13) is given as follows:Substituting (6) into (14), The control force can be designed aswhere , , and are the estimate of , , and , respectively. The constants and are parameters to be selected. Substituting (16) into (15),where , , and . They are assumed to be unknown bounded function and satisfy the Dirichlet conditions. Therefore, the RBFNN can represent and aswhere and . With these representations, (18) can be rewritten aswhere . To prove the stability of this control system and to find the update laws for and , the Lyapunov function candidate is chosen aswhere and are both positive definite and symmetric matrix. Taking the time derivative of (21) yields
Therefore, the update laws and parameter can be designed asSo , , and could be approximated by the following equations:
Hence, we may conclude that
In order to satisfy , it must be .
Then, we can choose with the condition . The derivative of the Lyapunov function becomes
Therefore, , and imply . In addition, (20) implies ; hence, asymptotic convergence of can be concluded using Barbalat’s lemma [28]. And this further implies that the sliding surface can converge to zero at last.
4. Simulations
In this section, the simulation will be given on a quarter-car model. System parameters are shown in Table 1.
In order to evaluate the performance of the designed controller, we consider three typical cases.
Case 1. As the resonance frequency of the car body is about 1 Hz, an external excitation close to this frequency might induce unwanted oscillation. Then, to test control performance near the system resonance frequency, consider that the road profile is assigned as
Case 2. Consider a sine bump in an otherwise smooth road surface. The mathematical description of this type ground displacement is given bywhere and are height and length of the bump and is the vehicle velocity. Assume , , and . The corresponding road excitation is shown in Figure 4.
Case 3. Consider the road excitation which is consistent and typically specified as a random process with a ground displacement power spectral density (PSD) ofwhere is the spatial frequency in , stands for PSD in time domain, and is the reference spatial frequency. Select the road roughness as , , , and . This PSD indicates that the road profile can be obtained from integrating a white noise in time domain [29]. So the displacement of the road excitation in time domain is shown in Figure 5.
In the simulation, the method presented in this paper is represented by NN-SMC, and the compared method is denoted by LQR. The matrixes and are chosen as diagonal matrixes and all of these diagonal elements are 0.3 and 0.2, respectively. The initial parameter that influences the converging slope of the sliding surface is chosen as 100. It will influence the converging rate of on the sliding surface. We set the adaptation laws with initial conditions and . The initial weighting vectors are selected to be and , respectively, after a rough test, and the system initial condition is set as . The PID controllers for all the three cases are , , and . The number of neurons in the hidden layer is 5, and . The center of Gaussian function is set , (), and , , , , and .
According to the numerical result of sinusoidal road excitation in Figure 6, the displacement attenuation of the camera (sprung mass) with the proposed NN-SMC controller is dramatically improved and the maximum deflection is kept within ±0.2 mm. It can be observed that the maximum camera displacement has been reduced from 60 mm to 0.1 mm. And the suspension deflection is almost the same as that with the LQR method in Figure 7, but the maximum magnitude is about 50% smaller than the passive suspension. From Figure 8, the estimated value of converges fast to true value of within 0.6 s.
When a vehicle is riding on the bump terrain, the dynamic responses of the camera position by using NN-SMC and LQR controllers are shown in Figure 9. It can be observed that NN-SMC has more obvious performance improvement. The maximum amplitude of sprung mass displacement responses is suppressed by 65% and 30%, respectively, compared with the passive suspension, and the curve converges to zero within 1.6 s by NN-SMC method. In Figure 10, the maximum value of suspension deflection by NN-SMC is 35 mm, which is smaller than the value under LQR method. In addition, the trajectory of is shown in Figure 11.
The dynamic responses of the sprung mass displacement with the random excitation are shown in Figure 12. The root mean square (RMS) value of the sprung mass displacement with NN-SMC is 3.33 × 10−4, while the RMS value is 8.7 × 10−3 by LQR. As it appears in Figure 13, the fluctuation amplitude of the red line with NN-SMC is smaller than the blue dotted line. In Figure 14, the maximum value of body acceleration by NN-SMC is 0.65 m/s2, which is smaller than the maximum value under LQR method. But the root mean square (RMS) value of the body acceleration with NN-SMC is 4.1 × 10−2, which is slightly larger than the RMS value 3.7 × 10−2 by LQR.
From the above results of the simulation, it is clearly seen from Figures 9 and 10 in Case 2 that the closed loop system with NN-SMC has stronger robustness. Furthermore, Figure 6 indicates that the vertical vibration of the camera is much smaller in the NN-SMC method for the resonance frequency of the car body, which improves the stabilization for capturing images. The tracking speed of the estimation value of is given in Figure 8 and the tracking performance is satisfactory. Therefore, the NN-SMC method possesses a faster dynamic property and has a better performance on the whole.
5. Conclusions
The vibration of the camera will directly affect the image quality and impede the subsequent processes. So the study of the image vibration attenuation is important in applications. In this paper, this innovative sliding mode control based on mixed adaptive neural networks approach has been successfully employed and simulated to reduce the vertical vibration of the camera using a quarter-car active suspension system, where electrohydraulic actuators with nonlinear characteristics are considered for accurate control. The radial basis function (RBF) network is used to overcome the uncertainties in the dynamic model of ASS, and, by means of the Lyapunov theorem, the weights of neural networks are regulated online without previous learning phase. The whole control architecture contains two loops. The inner loop is a PID controller to track the desired force, whereas, in the outer loop, the position controller is designed by the sliding mode strategy. The proposed control scheme can significantly suppress the displacement oscillation amplitude of the camera. Different road conditions are used in the simulation. The results show that the presented method can guarantee that the active suspension system has a fast convergence and strong robustness, which can effectively enhance the stabilization of the camera image.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
This research is partially supported by the National Science Foundation of China under Contract no. 51005018, and this paper is also funded by International Graduate Exchange Program of Beijing Institute of Technology.