Research Article  Open Access
Liyang Wang, Ming Chen, Xiangkui Jiang, Wei Wang, "Constrained Quadratic Programming and NeurodynamicsBased Solver for Energy Optimization of Biped Walking Robots", Mathematical Problems in Engineering, vol. 2017, Article ID 6725427, 15 pages, 2017. https://doi.org/10.1155/2017/6725427
Constrained Quadratic Programming and NeurodynamicsBased Solver for Energy Optimization of Biped Walking Robots
Abstract
The application of biped robots is always trapped by their high energy consumption. This paper makes a contribution by optimizing the joint torques to decrease the energy consumption without changing the biped gaits. In this work, a constrained quadratic programming (QP) problem for energy optimization is formulated. A neurodynamicsbased solver is presented to solve the QP problem. Differing from the existing literatures, the proposed neurodynamicsbased energy optimization (NEO) strategy minimizes the energy consumption and guarantees the following three important constraints simultaneously: (i) the forcemoment equilibrium equation of biped robots, (ii) frictions applied by each leg on the ground to hold the biped robot without slippage and tipping over, and (iii) physical limits of the motors. Simulations demonstrate that the proposed strategy is effective for energyefficient biped walking.
1. Introduction
Biped robots receive a lot of attention from the scientists and engineers these years [1–10]. Compared with wheeled driven robots and crawler robots, biped robots have anthropomorphic adaptability to unstructured environments with relative less energy consumption. However, Honda’s ASIMO, perhaps representative of humanoid robots, uses at least 10 times the energy (scaled as dimensionless specific cost of transport) of a typical human [11]. Energy consumption of the existing biped robots is much more than that of human being.
Two main kinds of approaches have been presented to optimize the energy efficiency for legged robots: the first type focuses on the improvements of mechanical device [11–14] and the second type is devoted to better optimization algorithm [15–19].
A wellknown improvement of biped mechanical device is brought by “semipassive walkers.” Numerous very successful “semipassive walkers” have been built [11], such as the Cornell biped, the Delft biped, and the MIT learning biped robots. These robots are built based on passive dynamics, with small active power sources substituted for gravity, which can walk on level ground. However, uneven ground leads to falls of the Cornell biped robot and floor irregularities lead to falls of the Delft biped robot. Although the MIT learning biped robot continually learns and adapts to the terrain as it walks, its energy consumption is especially high.
From another aspect, several auxiliary devices are designed to decrease energy consumption of legged robots. In [12], an elastic load suspension mechanism was developed and utilized on a hexapod robot to increase the energy efficiency of legged robot locomotion. The experiments demonstrate that the robot with an elastically suspended load consumed up to 24% less power than with a rigidly attached load. In [13], a flexible shoe system was proposed for biped robots to optimize energy consumption of the lateral plane motion. The shoe system can absorb the kinetic energy of the robot, which is confirmed by simulations and experiments. In [14], the energy efficiency of a humanoid robot with spinal motion was investigated. Simulations show that, with the additional degrees of freedom (DoF) in the torso, the robot requires 26.5% less energy than its rigidtorso counterpart to complete the same walking.
Differing from various mechanical devices for decreasing the energy consumption of legged robots, optimization algorithms can be used more widely because this kind of approach is applicable to all the robots with actuators. Motivated by trunk rotations of human being, an algorithm based on fuzzy logic and iterative optimization [15] provides a remarkable descend rate of energy consumption for biped robots. In [16], an online gait synthesis algorithm compromising waking stability and energy efficiency is proposed and the parameters are optimized for a given travel distance minimizing the energy consumed by the actuators. In [17], a reference generation algorithm was proposed for biped robots based on linear inverted pendulum model. Simulation results suggest that the proposed moving zeromomentpoint (ZMP) references are more energyefficient than the ones with fixed ZMP under the supporting foot. However, when decreasing the energy consumption of biped robots, the reported works neglect the inevitable presence of some inside constraints, including the reaction forces from the ground, frictional force between the feet and the ground, and some limitations of the biped joints.
On the other hand, some recent works have been done in modeling, measuring, estimating, and rejecting the undesired force introduced to the dynamics of robots. Fakoorian et al. [18] designed a continuoustime extended Kalman filter (EKF) and a continuoustime unscented Kalman filter (UKF) to estimate not only the states of the robot system but also the ground reaction forces that act on the foot. Moosavi et al. [19] designed a nonlinear controller for secondorder nonlinear uncertain dynamical systems. The results demonstrate that the proposed method is a partly modelfree controller that works well in certain and partly uncertain system. Differing from the existing literatures, the proposed neurodynamicsbased energy optimization (NEO) strategy minimizes the energy consumption and guarantees the following three important constraints simultaneously: (i) the forcemoment equilibrium equation of biped robots, (ii) frictions applied by each leg on the ground to hold the biped robot without slippage and tipping over, and (iii) Physical limits of the motors.
In this work, in order to provide optimal controller to meet all the abovementioned constraints, a QP problem is formulated to deal with the constrained optimization problem. Utilizing the dynamics model, an objective function based on energyefficiency optimization can be computed so that the control input can be produced within system constraints. Furthermore, the optimized control outputs need to be available as the robot moves on at each step. Therefore, online implementation is the next fundamental issue in the energy efficiency optimization. Whether the energy optimum control can be implemented successfully is dependent on the efficiency of online optimization.
To solve the proposed constrained optimization problem in real time, neurodynamicsbased QP solvers are considered because of their sufficient online computational power [20–22]. Several optimal controls for robots have been realized using neural network optimization [23–25]. In this paper, considering the physical constraints on biped motions, a novel neurodynamicsbased energyefficiency optimization controller is developed. The strategy for optimizing the energy efficiency is formulated as a constrained QP problem, which can be solved online using a primaldual neural network (PDNN). Simulation studies are presented to illustrate the feasibility of the proposed strategy.
Main contributions of this work could be summarized as follows:(i)A new complete model for energy optimization of biped walking robots is built. Several necessary physical constraints for the biped system are formulated in the optimization controller, which provides a more practical objective for the energy optimization of biped robots.(ii)A neurodynamicsbased solver is presented to handle the proposed optimization problem. To the best of our knowledge, no works on biped walking using energy optimum control based on neural network have been reported before.
The organization of this paper is as follows. In Section 2, the background about the energy consumption of biped walking robots is presented. A QP problem for the energy optimization is formulated in Section 3. Section 4 proposed a neurodynamicsbased solution for the proposed QP problem to realize the energy optimization. Section 5 presented the diagram of the neurodynamicsbased energy optimization control system. Simulation results are provided in Section 6, followed by the conclusions in Section 7.
2. Energy Consumption of a Biped Walking Robot
The main idea is to optimize the energy consumption of a biped robot walking on horizontal ground. For optimization purposes, we consider the following assumptions.
Assumption 1. We assume that the robot walks on practicable horizontal terrain. Therefore, there are no forbidden zones, and every foot can be placed on the ground and provide support to the robot.
Assumption 2. We assume that all the motors in the biped joints have the same configurations. The robot’s actuators are based on DC electric motors (electrical motors cannot store the gains of negative energy) [26, 27].
Assumption 3. Consider a biped robot with point contacts between the ground and each foot. Assume that each foot contacts the ground with Coulomb friction.
The energy consumption of a biped robot is given by the sum of the energy consumed in every joint plus the energy consumed by electronic equipment (computers, drivers, analog I/O, etc.). The contribution of the latter is out of the scope of this work.
If a joint is driven by an electrical motor, the consumed energy is given bywhere is the voltage and is the current through the motor. As a normal practice in modeling DC motors for robotic joints [27], the following electrical model of a motor is considered here:where represents the resistance of the motor and denotes the rotation speed of the motor. is the back electromotive constant, denotes the torque constant, and represents the motor torque. As a first approximation to the model, we consider the rotor inductance, , to be null. Note that in standard international unit the value of is the value of ; that is, (Nm/A) (Vs).
Substituting (2) into (1), we obtain
According to Assumption 2, the energy expended by the motor of joint of leg during time can be given bywhere denotes the serial number of the legs and is the serial number of the joints/motors in one leg. The function is defined asTaking into consideration all joints in the biped robot, the total energy consumption becomesConsidering the practical differences between the rotation speed and torques in joint and motor of leg , joint gear ratio and the joint gear’s mechanical efficiency are introduced here. Thus, and , where and represent the speed and torques in joint of leg , while and represent those in motor of leg . Therefore, (6) can be rewritten asThe main goal of this work is to minimize the expended energy given by (7). Then, the objective function can be presented as
In the next section, the energyefficiency optimization problem will be formulated as a QP problem, which can be solved online using neurodynamics.
Remark 4. Load plays a crucial role in the application of the robot. In [28], the combination of neural network (NN), proportional derivative (PD), and robust controller is used for determining the maximum loadcarrying capacity (MLCC) of articulated robots, subject to both actuator and endeffector deflection constraints. The proposed technique is then applied to articulated robots, and MLCC is obtained for a given trajectory. Literature [29] provides accurate estimates of the robot load inertial parameters, and accurate actuator torques predictions, both of which are essential for the acceptance of the results in an industrial environment. The key element to the success of this work is the comprehensiveness of the applied model, which includes, besides the dynamics resulting from the robot load and motor inertia, the coupling between the actuator torques, the mechanical losses in the motors, and the efficiency of the transmissions.
From the literatures, we know that load is not the only factor that demands the torque. In this work, the weight of the robot is considered as the load.
3. Formulate a QP Problem for EnergyEfficient Biped Robots
The objective function shown in (8) can be expressed as the following optimization problem:where. denotes that the elements in the matrix are equal to the bigger elements between in the matrix and in the matrix . The problem shown in (9) should guarantee three necessary constraints:(i)The forcemoment equilibrium equation of biped robots(ii)Frictions applied by each leg on the ground to hold the biped robot without slippage and tipping over(iii)Physical limits of the motors
Let us begin with the forcemoment equilibrium equation for the whole biped system, which can be written aswhere is a vector of the ground reaction forces acting on the left foot and the right foot.where denotes the position of leg referring to basic coordinate frame. contains the forces and moments acting on the robot’s center of gravity (COG).
Biped dynamics provide the relevance between ground reaction forces acting on the feet and the joint torques of the legs. Consider the th leg of a biped robot; the dynamics of the system can be expressed in the vectormatrix form aswhere is a joint position vector of the th leg; for the biped robot. is the inertia matrix of the leg, is a vector of centrifugal and Coriolis terms, is a vector of gravity terms, is the vector of joint torques, is the vector of ground reaction forces of the th leg, and is the Jacobian matrix from the joints of the th leg to the basic coordinate space. Equation (13) can be rewritten asReplacing in (11) with (14), the forcemoment equilibrium equation (11) can be written aswhere is an equilibrium matrix for the torque andEquation (15) is the first constraint describing the forcemoment equilibrium equation of biped robots.
On the other hand, considering the friction applied by the leg on the ground, the second constraint can be written aswhere is the coefficient matrix of the friction constraint for the feet. where is the Coulomb friction coefficient between the feet and the touched ground.
The third constraint is about the physical limits of the motors, which has the form of . and are known torque vectors according to the motors in the robot: and .
From the above, the energyefficiency optimization problem can be formulated as the following QP problem:where the definitions of the symbols can be found in (9), (15), and (17).
As we can see, now the strategy for minimizing the energy consumption of biped robots is finally formulated as a constrained QP problem (see (19)–(22)). In the next section, we are going to solve this QP problem using neurodynamics.
4. Solve the QP Problem for Energy Optimization
First of all, the QP problem described in (19)–(22) needs to be converted to a LVI problem. For this purpose, and are defined as the dual decision vectors corresponding to the equality constraint (20) and the inequality constraint (21), respectively. As a result, the primaldual decision vector and its upper/lower bounds are defined as follows:where elements in are defined sufficiently positive to represent infinity for any for the convenience of simulation and hardware implementation of the operation. The convex set made by primaldual decision vector is presented as . Then the QP problem in (19)–(22) is equivalent to the following LVI problem:That is to say, we need to find a vector with a coefficient matrix and a vector as follows:As a summary of this step, a theorem and the corresponding proof are given below.
Theorem 5 (see [21] (LVI formulation)). The QP problem in (19)–(22) is equivalent to the following LVI problem, that is, to find a vector such that , where coefficients , , and are defined in (24) and (23), respectively.
Proof. From [21], we know that the Lagrangian dual problem of the QP problem in (19)–(22) is to maximize over and , whereNote that function is convex with given , and . Therefore, the necessary and sufficient condition for a minimum isThus, the dual problem of (19)–(22) can be derived asMultiplying both sides of (27) by , we have Then the dual form can be rewritten asTo obtain the optimum of the primal problem (see (19)–(22)) and its dual problem (see (30)), the necessary and sufficient conditions are as follows: Primal feasibility: Dual feasibility: Complementarity:To simplify the above necessary and sufficient conditions, by defining and considering (35)(36), dual feasibility constraint (33) becomeswhich is equal to the following LVI problem: to find an optimum such thatwhere .
In addition, by defining , we have the following LVI for the equality constraint (31): to find such thatSimilarly, by defining , we have the following LVI for the inequality constraint (32) and the equality constraint (34): to find such thatBy taking the Cartesian product of the three sets , , and defined above, we formulate the convex set presented in (24) as follows:In consequence, LVIs (38)–(40) can be combined into an LVI in the matrix form, that is, to find an optimum such that , andContrasting the definitions of in (23) and and in (25), the above LVIs (see (42)) are exactly in the compact form (see (25)) as the equivalence of QP problem in (19)–(22). The proof is then completed.
On the other hand, from [20], it is known that LVI in (25) is equivalent to the following system of piecewise linear equations:where is a piecewise linear projection operator with the th projection element of being defined asTo solve linear projection equation (43), the dual dynamical system design approach presented in [20] is adopted to build a dynamical system. Considering the asymmetric , a primaldual neural network is developed as follows to solve (43):where is a design parameter used to scale the convergence rate of the system. The convergence rate is improved when the value of is increased. Furthermore, by replacing with , the dynamical system (45) can be rewritten as follows:where is a positive design parameter for the convergence rate of the PDNN (see (46)). About the convergence analysis of the abovementioned primaldual dynamical solver, there is a theorem presented as follows.
Theorem 6 (see [22]). Starting from any initial state, the state vector of primaldual dynamical system (45) is convergent to an equilibrium point , of which the first elements constitute the optimal solution to the quadratic programming problem in (19)–(22). Moreover, the exponential convergence can be achieved if there exists a constant such that
Remark 7. As a primaldual dynamical solver, primaldual neural networks can efficiently generate exact optimal solutions [21]. Furthermore, compared to dual neural networks, the LVI (linear variational inequality) based primaldual neural networks do not entail any matrix inversion online, so that they can reduce the computational time greatly [20]. Therefore, a LVIbased primaldual neural network is applied to perform the minimization of the energy consumption with equality and inequality constraints for biped robots in this work.
5. NeurodynamicsBased Energy Optimization Control
Over the past two decades, much progress has been made in the control of robot systems based on various control techniques. In [30], two novel robust adaptive PID control schemes are proposed to solve the strong nonlinearity and coupling problems in robot manipulator control. In [31], a support vector regressionbased control system is proposed to learn the external disturbances and increase the zeromomentpoint stability margin of humanoid robots. In [32], a kinematics openloop control system of hexapod robot with an embedded digital signal controller is proposed. In [33], an openloop controller is implemented on field programmable gate array (FPGA) of the robot. Experimental results reveal the viability of the proposed controller.
On the other hand, many mature techniques have been used to track the planned trajectories with a certain control strategy. In [34], a trajectory generator and a joint trajectory tracking controller are designed. The proposed combination is successfully implemented and the robot is able to walk at 0.11 m/s. Literature [35] considers the problem of joint trajectory control with oscillations cancelling for planar multilink flexible manipulators. A feedforward torque is designed to preset the elastic coordinates of the system, so that the controller is able to drive the arm along the desired trajectory. In [36], in order to reduce gait planning and to get a good tracking performance, masterslaver dualleg coordination control was proposed for the biped robot with heterogeneous legs. In [37], an openclosedloop iterative learning control algorithm with angle correction term is proposed, which uses the error signal and the deviation of two adjacent error signals to adjust itself.
In this work, the proposed neurodynamicsbased method is an openloop controller. As shown in Figure 1, control method based on energyefficiency optimization is proposed to obtain the tradeoff between the forcemoment equilibrium and energy efficiency for biped walking by minimizing the energyrelated cost function while guaranteeing physical constraints. There are two parts in the control system: QP problem for energy optimization and a LVIbased primaldual neural network for solving the QP problem. The control object of the proposed method is to follow the planned trajectories for the biped joints using optimal joint torques deduced by the proposed controller. The inputs of the controller include the planned trajectories for the biped joints, the forcemoment equilibrium equation of biped robot, friction coefficient between the ground and the robot, and physical parameters of the motors equipped on the robot. The outputs of the controller are the optimal joint torques for the biped joints, which are deduced using a LVIbased primaldual neural network.
Firstly, the strategy for optimizing the energy efficiency is formulated as a constrained QP problem. Three important physical constraints for the biped system are formulated in this QP problem for energy optimization of biped walking robots.
Secondly, a neurodynamicsbased solver is presented to solve the proposed constrained optimization problem.
Thirdly, joint trajectories are planned for the biped robot. The planned trajectories provide parameters for the forcemoment equilibrium equation of biped robot, which is one of the constraints of the energy optimization QP problem. So the biped robot is able to make the step and does not fall.
6. Simulation Research
To verify the effectiveness of the proposed energyefficiency control method, some simulations are implemented in this section. Matlab is used to model the biped robot and the controller.
6.1. Structure and Parameters of the Biped Robot
Consider a planar biped robot with 6 degrees of freedom shown in Figure 2. The robot consists of one torso and two legs. The main parameters of the biped robot can be found in Table 1.

Typical gait is planned for this simulated biped robot to walk on the horizontal ground. In this work, it is assumed that the torso of the biped robot moves at a constant velocity with a constant height. The COG of the simplified model is located at the geometric center of the torso. The basic coordinate frame, with its origin at the COG, is defined as a bodyfixed frame. The whole walking period of the biped robot is considered to be composed of a singlesupport phase and an instantaneous doublesupport phase. The supporting foot is assumed to remain in full contact with the ground during the singlesupport phase. The trajectories of the ankles and the hips are given as follows:where and denote the position of the hip and and denote the position of the swinging ankle joint at the th sample. is the walking step length and is the height of swinging ankle. is the total sampling number in a walking cycle . and are the lengths of lower limbs. Here, and .
6.2. Parameters for the QP Problem and the NeurodynamicsBased Solver
For the parameters of the constrained QP problem in (19)–(22), the parameters of the motors are determined by the motors that are equipped in the robot. Here, we take a set of typical motor parameters as an example. The electric resistance of the motor (Ω), torque constant (Nm/A), gear reduction rate , and the joint gear’s mechanical efficiency . Submitting all the abovementioned parameters to (9), we have and , where is the joint velocity vector of the th leg. Here, the joint velocity can be calculated using the gait planned in Section 6.1. Consider the th leg of a biped robot; , where denotes the joint velocity at the th sample and is the sampling interval. The smaller the value of is, the more accurate but the more computationally intensive the joint velocity is [38].
For the constraint condition of forcemoment equilibrium equation, the Coulomb friction coefficient depends on the ground environment. Here, we take as an example. The inertia matrix of the leg , the centrifugal and Coriolis terms , and the gravity terms in the dynamic equation can be calculated using the method shown in [39].
Considering the physical limits of the motors, we have .
For the neurodynamicsbased solver, the positive design parameter for the convergence rate of the PDNN is , which is determined using the trialanderror method.
6.3. Biped Walking via Different Controllers
The proposed control method is tested on the control of the biped robot mentioned above by simulation experiments. The performances of the proposed NEO are compared with those of the SVM control methods [40, 41] and NN control methods.
For the SVM controller, the parameters include a penalty coefficient , degree of the polynomial kernels , width of the RBF kernels , and mixed coefficient of the mixed kernels . When training the biped dynamic, we sample the joint variables in the period of s and let the sampling interval be s. That is to say, there are 200 sampling points in a single walking period; the desired sample set satisfying the ZMP criterion is .
On the other side, for comparison with the proposed NEO, a threelayered backpropagation (BP) NN is built to control the biped robot. Details of the NN are introduced as follows.
Layer 1 (Input Layer). In this layer, the input signal is directly transferred to the next layer; that is,where and is the input variable. is the output of the input layer.
Layer 2 (Hidden Layer). Each node in the hidden layer performs a transfer operation using a Sigmoid function; that is,where is the output of the hidden layer. is a Sigmoid function. is the index of the hidden units. The number of the hidden units is designed as here using the trialanderror method. is the connection weight between the input layer and the hidden layer. The initial values of the connection weights can be selected randomly, and different initial values could lead to different performance of the NN.
Layer 3 (Output Layer). This layer performs the calculation for the output of the whole network:where is the control torque for the th biped joint: . is the connection weight between the hidden layer and the output layer. The initial values of can be selected randomly.
By using BP algorithm, the NN is trained offline with the 200 desired samples for 100 times. The structure of the NN is shown in Figure 3.
The proposed control method and the abovementioned two intelligent methods are adopted to control the simulated biped robot, respectively. As we can see from Figures 45, all the three methods can realize the planned biped walking. Energy consumption trajectories are shown in Figures 67. As shown in the figures, the proposed NEO needs less energy than the other methods due to the proposed energybased optimal control. For example, when the energy consumption of all the joints is 159.79 J for the proposed NEO, the energy consumption is 409.10 J for the NN and 311.68 J for the SVM (see Table 2). Furthermore, the proposed NEO always needs less energy than the other two methods when different biped motions are considered (Motion 1: the step length is 0.18 m; Motion 2: the step length is 0.20 m). At the same time, the SVM controller exhibits greater energy efficiency compared with the NN controller. The possible cause is that the SVM is more efficient in learning the energyefficient controller using limited samples.

(a)
(b)
(c)
(a)
(b)
(c)
Remark 8. In the simulation section, the robot’s joint trajectories are predefined. This paper makes contribution by optimizing the joint torques to decrease the energy consumption without changing the biped gaits.
Joint torques for different controllers when the step length is 0.20 m are shown in Figures 8–13. As shown in the figures, the proposed NEO strategy exhibits smaller driving torques compared with the NN method and SVM method. It is because we deduce the optimal joint torque for the biped robot according to the proposed energy optimization problem. As a result, torque costs of the biped joints are reduced remarkably. This contributes to the effectiveness of the proposed NEO strategy in terms of reducing the energy consumption of biped robots. At the same time, the proposed NEO strategy minimizes the energy consumption and guarantees three necessary constraints simultaneously. Therefore, the forcemoment equilibrium equation of biped robots is guaranteed and the biped robot does not fall.
On the other hand, the SVM controller exhibits greater energy efficiency (realize the same motion with smaller driving torques) compared with the NN controller. The possible cause is that the number of the learning samples for the NN controllers is not large enough in this work. Conventional machine learning methods such as NN use empirical risk minimization (ERM) based on infinite samples, which is disadvantageous to the learning control based on small sample sizes for biped robots. The SVM is direct implementation of the structural risk minimization (SRM) principle. This difference makes SVM more efficient in resolving the smallsamplesizes learning problems.
7. Conclusions
To build a more practical objective function for the energy optimization of biped robots, three important constraints are incorporated into the optimal controller for biped robots. Simulation results demonstrate that the proposed NEO strategy effectively decreases the energy consumption of biped walking robot. In addition, the proposed strategy can guarantee the forcemoment equilibrium equation and the physical limits of the motors. Coulomb friction is applied between the leg and the ground by setting a friction coefficient. The biped robot can provide optimal joint torques without slippage or tipping over.
It is worth noting that most of the existing algorithms realize the energy minimization via optimizing gait parameters. However, gait parameters, such as foot trajectories and the trajectories of the COG, are not the only aspect to be concerned. Other factors, such as the forces and moments acting on the biped robot, can also impose on energy consumption of the biped robot to a large extent. For example, people walking in the mud or in a gale usually feel more tired. Therefore, when the foot trajectories and the COG trajectories are determined, optimizing the torques of each joint is significant for the energy optimization of the whole biped system. This point is verified by simulations and the results of this work are significant.
In this work, the proposed neurodynamicsbased method is an openloop controller. In the simulation experiments, we do not introduce any error accumulation during the biped walking. So the simulated robot is able to follow the planned trajectories and does not fall. However, for a real robot system, there must be error accumulation introduced by the mechanical devices. In this situation, the biped robot tends to deviate from the reference trajectory if there is no feedback and correction for error compensating. Consequently, future works will include the design of closedloop controllers which are more suitable for real robot systems.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
Acknowledgments
This work is supported by the National Natural Science Foundation of China (Projects 61403264 and 61305098) and by the Natural Science Foundation of Guangdong Province (Project 2016A030310018). Grateful thanks go to Dr. Ye XianMing who gives considerable help by means of environment support.
References
 K. Hirai, M. Hirose, Y. Haikawa, and T. Takenaka, “Development of Honda humanoid robot,” in Proceedings of the 1998 IEEE International Conference on Robotics and Automation. Part 1 (of 4), pp. 1321–1326, May 1998. View at: Google Scholar
 T. Mcgeer, “Passive Dynamic Walking,” The International Journal of Robotics Research, vol. 9, no. 2, pp. 62–82, 1990. View at: Publisher Site  Google Scholar
 M. Vukobratović and B. Borovac, “Zeromoment point—thirty five years of its life,” International Journal of Humanoid Robotics, vol. 1, no. 1, pp. 157–173, 2004. View at: Publisher Site  Google Scholar
 C. Zhou, X. Wang, Z. Li, and N. Tsagarakis, “Overview of Gait Synthesis for the Humanoid COMAN,” Journal of Bionic Engineering, vol. 14, no. 1, pp. 15–25, 2017. View at: Publisher Site  Google Scholar
 A. Amanatiadis, “A Multisensor Indoor Localization System for Biped Robots Operating in Industrial Environments,” IEEE Transactions on Industrial Electronics, vol. 63, no. 12, pp. 7597–7606, 2016. View at: Publisher Site  Google Scholar
 L. Yang, Z. Liu, and Y. Zhang, “Online walking control system for biped robot with optimized learning mechanism: an experimental study,” Nonlinear Dynamics, vol. 86, no. 3, pp. 2035–2047, 2016. View at: Publisher Site  Google Scholar
 J. Rosado, F. Silva, V. Santos, and A. Amaro, “Adaptive Robot Biped Locomotion with Dynamic Motion Primitives and Coupled Phase Oscillators,” Journal of Intelligent and Robotic Systems: Theory and Applications, vol. 83, no. 34, pp. 375–391, 2016. View at: Publisher Site  Google Scholar
 L. Wang, Z. Liu, P. Chen, Y. Zhang, S. Lee, and X. Chen, “A UKFbased predictable SVR learning controller for biped walking,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 43, no. 6, pp. 1440–1450, 2013. View at: Publisher Site  Google Scholar
 J. J. AlcarazJiménez, D. HerreroPérez, and H. MartínezBarberá, “Robust feedback control of ZMPbased gait for the humanoid robot Nao,” International Journal of Robotics Research, vol. 32, no. 910, pp. 1074–1088, 2013. View at: Publisher Site  Google Scholar
 S. S. Ge, Z. Li, and H. Yang, “Data driven adaptive predictive control for holonomic constrained underactuated biped robots,” IEEE Transactions on Control Systems Technology, vol. 20, no. 3, pp. 787–795, 2012. View at: Publisher Site  Google Scholar
 S. Collins, A. Ruina, R. Tedrake, and M. Wisse, “Efficient bipedal robots based on passivedynamic walkers,” Science, vol. 307, no. 5712, pp. 1082–1085, 2005. View at: Publisher Site  Google Scholar
 J. Ackerman and J. Seipel, “Energy efficiency of legged robot locomotion with elastically suspended loads,” IEEE Transactions on Robotics, vol. 29, no. 2, pp. 321–330, 2013. View at: Publisher Site  Google Scholar
 H. Minakata, H. Seki, and S. Tadakuma, “A study of energysaving shoes for robot considering lateral plane motion,” IEEE Transactions on Industrial Electronics, vol. 55, no. 3, pp. 1271–1276, 2008. View at: Publisher Site  Google Scholar
 J. Or, “Humanoids grow a spine: The effect of lateral spinal motion on the mechanical energy efficiency,” IEEE Robotics and Automation Magazine, vol. 20, no. 2, pp. 71–81, 2013. View at: Publisher Site  Google Scholar
 Z. Liu, L. Wang, C. L. Philip Chen, X. Zeng, Y. Zhang, and Y. Wang, “Energyefficiencybased gait control system architecture and algorithm for biped robots,” IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, vol. 42, no. 6, pp. 926–933, 2012. View at: Publisher Site  Google Scholar
 H.K. Shin and B. K. Kim, “Energyefficient gait planning and control for biped robots utilizing the allowable ZMP region,” IEEE Transactions on Robotics, vol. 30, no. 4, pp. 986–993, 2014. View at: Publisher Site  Google Scholar
 K. Erbatur and O. Kurt, “Natural ZMP trajectories for biped robot reference generation,” IEEE Transactions on Industrial Electronics, vol. 56, no. 3, pp. 835–845, 2009. View at: Publisher Site  Google Scholar
 S. Fakoorian, V. Azimi, M. Moosavi, H. Richter, and D. Simon, “Ground Reaction Force Estimation in Prosthetic Legs with Nonlinear Kalman Filtering Methods,” Journal of Dynamic Systems Measurement & Control, 2017. View at: Publisher Site  Google Scholar
 M. Moosavi, M. Eram, and A. Khajeh, “Design New Artificial Intelligence Base Modified PID Hybrid Controller for Highly Nonlinear System,” in International Journal of Advanced Science & Technology, p. 57, 2013. View at: Google Scholar
 Y. Zhang, J. Wang, and Y. Xia, “A dual neural network for redundancy resolution of kinematically redundant manipulators subject to joint limits and joint velocity limits,” IEEE Transactions on Neural Networks, vol. 14, no. 3, pp. 658–667, 2003. View at: Publisher Site  Google Scholar
 Y. Zhang, S. S. Ge, and T. H. Lee, “A unified quadraticprogrammingbased dynamical system approach to joint torque optimization of physically constrained redundant manipulators,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 34, no. 5, pp. 2126–2132, 2004. View at: Publisher Site  Google Scholar
 Y. Zhang, “On the LVIbased primaldual neural network for solving online linear and quadratic programming problems,” in Proceedings of the 2005 American Control Conference, ACC, pp. 1351–1356, Portland, OR, USA, June 2005. View at: Google Scholar
 Z. Li, Y. Xia, C.Y. Su, J. Deng, J. Fu, and W. He, “Missile guidance law based on robust model predictive control using neuralnetwork optimization,” IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 8, pp. 1803–1809, 2015. View at: Publisher Site  Google Scholar  MathSciNet
 H. Xiao, Z. Li, C. Yang et al., “Robust stabilization of a wheeled mobile robot using model predictive control based on neurodynamics optimization,” IEEE Transactions on Industrial Electronics, vol. 64, no. 1, pp. 505–516, 2017. View at: Publisher Site  Google Scholar
 Z. Li, S. S. Ge, and S. Liu, “Contactforce distribution optimization and control for quadruped robots using both gradient and adaptive neural networks,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 8, pp. 1460–1473, 2014. View at: Publisher Site  Google Scholar
 J. Nishii, K. Ogawa, and R. Suzuki, “The optimal gait pattern in hexapods based on energetic efficiency,” in Proceedings of the Proc. 3rd Int. Symp. on Artificial Life and Robotics, vol. 10, pp. 106–109, Beppu, Japan, 1998. View at: Google Scholar
 S. Ma, “Timeoptimal control of robotic manipulators with limit heat characteristics of the actuator,” Advanced Robotics, vol. 16, no. 4, pp. 309–324, 2002. View at: Publisher Site  Google Scholar
 M. H. Korayem, A. Alamdari, R. Haghighi, and A. H. Korayem, “Determining maximum loadcarrying capacity of robots using adaptive robust neural controller,” Robotica, pp. 1–11, 2010. View at: Publisher Site  Google Scholar
 J. Swevers, B. Naumer, S. Pieters et al., “An Experimental Robot Load Identification Method for Industrial Application,” International Journal of Robotics Research, vol. 21, no. 12, pp. 98–107, 200. View at: Google Scholar
 J. Xu and L. Qiao, “Robust adaptive PID control of robot manipulator with bounded disturbances,” Mathematical Problems in Engineering, vol. 2013, Article ID 535437, 2013. View at: Publisher Site  Google Scholar
 L. Wang, M. Chen, G. Li, and Y. Fan, “Databased control for humanoid robots using support vector regression, fuzzy logic, and cubature Kalman filter,” Mathematical Problems in Engineering, Article ID 1984634, Art. ID 1984634, 19 pages, 2016. View at: Publisher Site  Google Scholar  MathSciNet
 M. K. Totaki, R. C. F. P. Carvalho, R. B. Letang, R. Schneiater, W. M. Moraes, and A. B. Campo, “Kinematics open loop control of hexapod robot with an embedded Digital Signal Controller (DSC),” in Proceedings of the 2010 IEEE International Symposium on Industrial Electronics, ISIE 2010, pp. 3889–3893, ita, July 2010. View at: Publisher Site  Google Scholar
 F. PerezPeña, A. MorgadoEstevez, A. LinaresBarranco et al., “Neuroinspired spikebased motion: From dynamic vision sensor to robot motor openloop control through spikeVITE,” Sensors (Switzerland), vol. 13, no. 11, pp. 15805–15832, 2013. View at: Publisher Site  Google Scholar
 B. Vanderborght, B. Verreist, M. Van Damme, R. Van Ham, P. Beyl, and D. Lefeber, “Locomotion control architecture for the pneumatic biped lucy consisting of a trajectory generator and joint trajectory tracking controller,” in Proceedings of the 2006 6th IEEERAS International Conference on Humanoid Robots, HUMANOIDS, pp. 240–245, ita, December 2006. View at: Publisher Site  Google Scholar
 M. Benosman and G. Le Vey, “Joint trajectory tracking for planar multilink flexible manipulator: Simulation and experiment for a twolink flexible manipulator,” ProceedingsIEEE International Conference on Robotics and Automation, vol. 3, pp. 2461–2466, 2002. View at: Publisher Site  Google Scholar
 B. Wang, H. Xie, D. Cong, and X. Xu, “Biped robot control strategy and openclosedloop iterative learning control,” Frontiers of Electrical and Electronic Engineering in China, vol. 2, no. 1, pp. 104–107, 2007. View at: Publisher Site  Google Scholar
 H.B. Wang and Y. Wang, “Openclosed loop {ILC} corrected with angle relationship of output vectors for tracking control of manipulator,” Acta Automatica Sinica. Zidonghua Xuebao, vol. 36, no. 12, pp. 1758–1765, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 L. Wang, Z. Liu, C. L. P. Chen, Y. Zhang, S. Lee, and X. Chen, “Energyefficient SVM learning control system for biped walking robots,” IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 5, pp. 831–837, 2013. View at: Publisher Site  Google Scholar
 Z. Liu and C. Li, “Fuzzy neural networks quadratic stabilization output feedback control for biped robots via H∞ approach,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 33, no. 1, pp. 67–84, 2003. View at: Publisher Site  Google Scholar
 L. Wang, Z. Liu, P. Chen, Y. Zhang, S. Lee, and X. Chen, “A UKFbased predictable SVR learning controller for biped walking,” IEEE Transactions on Systems, Man, and Cybernetics: Systems Part A, vol. 43, no. 6, pp. 1440–1450, 2013. View at: Publisher Site  Google Scholar
 L. Wang, Z. Liu, C. L. Philip Chen, Y. Zhang, S. Lee, and X. Chen, “Fuzzy SVM learning control system considering time properties of biped walking samples,” Engineering Applications of Artificial Intelligence, vol. 26, no. 2, pp. 757–765, 2013. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2017 Liyang Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.