Semiparametric Deep Learning Manipulator Inverse Dynamics Modeling Method for Smart City and Industrial Applications

Liu, Nan; Li, Liangyu; Hao, Bing; Yang, Liusong; Hu, Tonghai; Xue, Tao; Wang, Shoujun; Shao, Xingmao

doi:https://doi.org/10.1155/2020/9053715

Complexity

On this page

Abstract Introduction Evaluation Results Conclusion Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Complexity Problems Handled by Advanced Computer Simulation Technology in Smart Cities 2020

View this Special Issue

Research Article | Open Access

Volume 2020 | Article ID 9053715 | https://doi.org/10.1155/2020/9053715

Semiparametric Deep Learning Manipulator Inverse Dynamics Modeling Method for Smart City and Industrial Applications

Nan Liu,^1,2Liangyu Li,¹Bing Hao,³Liusong Yang,³Tonghai Hu,³Tao Xue,²Shoujun Wang,²and Xingmao Shao²

Guest Editor: Zhihan Lv

Received14 Apr 2020

Revised25 May 2020

Accepted02 Jun 2020

Published30 Jun 2020

Abstract

In smart cities and factories, robotic applications require high accuracy and security, which depends on precise inverse dynamics modeling. However, the physical modeling methods cannot include the nondeterministic factors of the manipulator, such as flexibility, joint clearance, and friction. In this paper, the Semiparametric Deep Learning (SDL) method is proposed to model robot inverse dynamics. SDL is a type of deep learning framework, designed for optimal inference, combining the Rigid Body Dynamics (RBD) model and Nonparametric Deep Learning (NDL) model. The SDL model takes advantage of the global characteristics of classic RBD and the powerful fitting capabilities of the deep learning approach. Moreover, the parametric and nonparametric parts of the SDL model can be optimized at the same time instead of being optimized separately. The proposed method is validated using experiments, performed on a UR5 robotic platform. The results show that the performance of SDL model is better than that of RBD model and NDL model. SDL can always provide relatively accurate joint torque prediction, even when the RBD or NDL model is not accurate.

1. Introduction

Smart cities and factories contain “intelligent” things that can autonomously and collaboratively enhance the quality of living and working conditions, save human lives, and act as a sustainable resource ecosystem. To implement these advanced collaborative technologies, such as drones, robots, artificial intelligence, and Internet of Things, it is required to increase the “intelligence” of smart cities and factories, by improving the connectivity, energy efficiency, and quality of services [1]. There have been many excellent application cases, such as [2–4]. Particularly, intelligent robotic platforms are a technology, increasingly used, in smart cities and factories, where the constantly changing applications scenarios also place higher demands in robot control. Specifically, in motion control systems, there is a time delay in the transmission of feedback information, making smooth motion impossible to achieve by feedback control alone. Therefore, feedforward control becomes particularly important. In robotics, feedforward control usually refers to model-based control, involving the dynamics of the robotic platform. The accuracy of such dynamical models is critical to the development of control laws that are compliant, energy efficient, and safe [5].

There are two major approaches for modeling robot dynamics: parametric and nonparametric. Parametric approaches rely on parameterized Newtonian physics models of the robot dynamics. Common methods for physics-based dynamics modeling can be found in the literature. These methods require the mechanical parameters of the rigid bodies, composing the robot, to be identified [6–9] and then employed in model-based control and state estimation schemes [10]. The advantage of these models is that they represent a global and unique relationship between the joint trajectory and the torques . This type of inverse dynamics model can be computed efficiently and employed in real time. Thus, a great deal of prior knowledge is acquired, without the need of data. For example, it is well known that robots are subject to gravitational forces, viscous forces, and joint constraints, making it wasteful to have to go through a laborious data-gathering and machine learning process, to discover these well-known constraints. The disadvantage of parametric models is that they are only crude idealizations of the actual system dynamics, such as rigidity of links or a simple analytical form of friction, which may not be accurate in real systems. In the case of traditional industrial robots, these unmodeled dynamics can often be ignored. However, for modern robotic platforms, these omittances and simplifications result in significant control inefficiencies.

Alternatively, the model can be obtained from experimental data, using machine learning techniques, resulting in a nonparametric model. Nonparametric methods, based on algorithms such as Support Vector Regression (SVR) [11–13], Neural Network (NN) [14–16], Local Weighted Projection Regression (LWPR) [17–19], Independent Joint Learning (IJL) [20–22], or Gaussian Processes Regression (GPR) [23–27], can model dynamics by extrapolating the input-output relationship directly from the available data. If a suitable kernel function or learning architecture is selected, then the nonparametric model is a universal approximator which can account for the dynamics factors, not considered by the parametric model. Therefore, nonparametric methods can be more flexible to use and are powerful in capturing higher order nonlinearities, resulting in faster model approximation and higher learning accuracy. When learning inverse dynamics, the nonparametric methods will approximate a function describing the relationship , including all nonlinearities encoded by the sampled data.

Nonparametric methods attempt to learn the model from scratch and, thus, do not make use of any knowledge available from analytical robotics. Nevertheless, nonparametric learning methods also exhibit several drawbacks. First, very large amounts of data are necessary for obtaining a sufficiently accurate model and predictions on the entire input space [28]. Second, since nonparametric models rely on local neighborhood training data to make predictions, they do not generalize well to unexplored state regions, where little or no training data are available. Covering the entire state space becomes exponentially harder, as the complexity and number of degrees of freedom in the robot system increase. Thus, if only small and relatively poor data sets are available, nonparametric models will not be able to generalize well for unknown data. Third, it is indeed wasteful to have to go through a laborious data-gathering and machine learning process to discover such well-known prior knowledge as Rigid Body Dynamics.

Thus, it appears quite desirable to combine the benefits of parametric and nonparametric approaches to improve on the aforementioned issues. However, doing so, in an efficient way, is not trivial. A reasonable approach would be to first fit a parametric model and then fit a nonparametric model to the errors made by the parametric model. Nguyen-Tuong et al. [29] present a learning technique which combines prior knowledge about the physical structure of the mechanical system and learning from available data using Gaussian Process Regression (GPR) [30]. Similar approaches are presented in [20] and [31]. In [32], an incremental semiparametric robot dynamics learning scheme, based on Locally Weighted Projection Regression (LWPR), initialized using a linearized parametric model, is presented [33]. However, this approach uses a fixed parametric model that is not updated, as new data become available. Moreover, LWPR has been shown to underperform with respect to other methods (e.g., [34]). These semiparametric methods, as described above, could not benefit from simultaneous optimization of parametric and nonparametric models. Instead, the nonparametric model is applied, after parametric identification, which may result in a suboptimal model. In addition, as far as it can be known, there is no semiparametric method based on deep learning methods.

Deep learning is a new approach in machine learning, which has been widely applied in smart cities and factories [35]. Deep learning has turned out to be very good at discovering intricate structures in high-dimensional data and is therefore applicable to many domains of science, business, and government. Since it requires very little engineering by hand, it can easily take advantage of increased amount of available computation resources and data [36]. In this work, a method that is based on deep learning and semiparametric approach is presented. The method is formalized in the framework of what is called Semiparametric Deep Learning (SDL), designed for optimal inference using combinations of parametric RBD and Nonparametric Deep Learning models. Key properties of this method are (1) appropriate deep learning frame for a semiparametric approach and (2) features that can be optimized simultaneously for parametric and nonparametric models. The proposed method is validated using experiments performed on a UR5 robot. The article is organized as follows. In Section 2, a complete description of the proposed Semiparametric Deep Learning framework is introduced. Section 3 presents the validation of the proposed method on the UR5 robotic platform. Finally, Section 4 summarizes the content of the presented work.

2. Methodology

The parametric modeling method and NDL, as the basis of the SDL method, have been elaborated in previous research publications [37, 38]. Therefore, this section only briefly reviews the above two methods, while it analyzes the SDL modeling method, proposed in this paper.

2.1. Parametric Robot Dynamics Model

It is well known that the robot dynamics can be modeled according to the following [39]:in which are joint positions, velocities, and accelerations of the robot, respectively, denotes the joint torques, is the generalized inertia matrix of the robot, are the Coriolis and centripetal forces, and is gravity. As shown in equation (1), the robot dynamics equation contains Rigid Body Dynamics (RBD) model:

The model errors are caused by unmodeled dynamics (e.g., hydraulic tubes, actuator dynamics, and flexibility and dynamics of the cable drives), ideal-joint assumptions (e.g., no friction and clearance), and inaccuracies in the RBD model parameters. The RBD model of a manipulator is well known to be linear regarding the parameters β [39], i.e.,in which is a matrix containing nonlinear functions of joint angles, velocities, and accelerations, often called basis functions. Modeling the robot dynamics, using the RBD model in equation (3), requires the identification of the dynamics parameters . For the 6 Degree-of-Freedom (DoF) UR5 robot, for example, 60 dynamics parameters are to be identified (for each DoF, there are 10 parameters that could ideally be obtained directly from the CAD data).

2.2. Nonparametric Deep Learning Model

2.2.1. NDL Formulation

The inverse dynamic model, in model-based control, is described as the mapping from joint positions, velocities, and accelerations to torques, as shown in equation (1). The aim of nonparametric learning model is to predict the torque value of the joint, , as the response of the query point at , by using the given n training data, , in which and . Since the problem can be considered as a supervised learning problem, any supervised learning technique can be employed for the learning process, as shown in

Deep learning methods are representation-learning methods with multiple levels of representation, obtained by composing simple but nonlinear modules, each transforming the representation at one level (starting with the raw input) into a representation at a higher, slightly more abstract level. With the composition of enough such transformations, very complex robotic dynamics functions can be learned [36, 40]. Therefore, the application cases of deep learning are too numerous, such as [41–45].

The sequential nature of manipulator inverse dynamics suggests that, to predict the joint torque, it is important to model the relationship among sequential data points [39]. RNNs, a type of deep learning network, can be seen as very deep feedforward network, where all the layers share the same weights. Although their main purpose is to determine long-term dependencies, theoretical and empirical evidence shows that it is difficult to learn to store information for very long time [46]. LSTM networks have subsequently proved to be more effective than conventional RNNs, especially when there are several layers at each time step [48], enabling an entire speech recognition system that goes all the way from acoustics to the sequence of characters in the transcription. LSTM networks or related forms of gated units are also currently used for the encoder and decoder networks, performing very well in machine translation [47–49]. Moreover, studies presented in [38] and [50] confirmed the validity of applying LSTM to the prediction of manipulator inverse dynamics. Therefore, in this section, the LSTM network is proposed as the nonparametric learning technique for modeling the inverse dynamics of manipulator.

2.2.2. NDL Model Architecture

In this paper, the proposed architecture of the Nonparametric Deep Learning network has one input layer, one LSTM layer, one full-connected layer, one dropout layer, and one output layer, as shown in Figure 1. Only 1 LSTM layer is used here, because it has been verified in our previous studies that, with the same number of neurons, the fewer the layers, the better the prediction performance [38].

The input layer has 18 neurons (manipulator’s 6 joint positions, 6 velocities, and 6 accelerations, as shown in Figure 2).

The state activation functions of LSTM cells are set to “tanh,” while the gate activation functions are set to “sigmoid.” The input weights are initialized according to the Glorot initializer. The forget gate bias is initially set to 1 and the remaining biases are set to 0. The training algorithm adopts back-propagation through time.

2.3. Proposed Semiparametric Deep Learning (SDL) Model

In this section, the proposed semiparametric model, based on deep learning and RBD, is described in detail. The method is formalized in the framework of the so-called Semiparametric Deep Learning (SDL), which can be used to predict the joint torque of a robotic arm more accurately. First, formulation of SDL is introduced in Section 2.3.1, while the specific model architecture of SDL is described in Section 2.3.2.

2.3.1. SDL Formulation

Using the Nonparametric Deep Learning (DL) framework, the robot dynamics can be modeled by , in which is the input and is the output of the Deep Learning Model. Consequently, the DL model does not make use of any prior knowledge, which allows reproducing arbitrary functions. One way to include the RBD model, as shown in equation (5), is to set the as input to the DL model. This approach is equivalent to a semiparametric model:

The resulting dynamics model, as described in equation (5), is a semiparametric frame which consists of a parametric part, i.e., the RBD model. When comparing equation (5) to the robot dynamics in equation (1), it becomes evident that the main purpose of the nonparametric term is absorbing the unmodeled dynamics . In order to approximate the unmodeled dynamics with an appropriate DL, a model can be used, such as DNN or LSTM. Key properties of this semiparametric learning method are (1) employment of appropriate deep learning frame as nonparametric part and (2) features that can be optimized simultaneously for parametric and nonparametric model; i.e., the value of will also be updated by weight changes as the learning process evolves.

If the RBD model perfectly describes the robot dynamics, the error in equation (1) will disappear and the prediction will depend only on the RBD part; i.e., it is very easy to train deep learning networks. Equation (5) also shows that if the query point is far away from the training data, the resulting torque prediction will mainly depend on the RBD part. This property is important, as the complete state space can never be completely included using finite (and possibly small) training data sets. If the robot moves to the regions of the state space, not considered by the sampled data (i.e., the learned nonparametric models may not generalize well in these state space regions), the torque prediction will rely on the parametric RBD part.

2.3.2. SDL Model Architecture

The effectiveness of the NDL model has been verified in previous work presented in [40]. The SDL model proposed in this article adds an RBD term to the NDL architecture. Its specific model architecture is shown in Figure 3. The input of the SDL architecture is still . However, unlike NDL, the input passes through the RBD term, forming the new input vector . Next, the new input vector enters the LSTM hidden layer. The advantage of this architecture is that the parametric and nonparametric parts can be optimized simultaneously; i.e., the weight of in the feature vector will also be updated during network training. The grid search method is used to optimize the hyperparameters of the SDL model.

3. Evaluation

The proposed SDL method will be verified on a collaborative robot UR5, while the torque prediction results will be compared to the ones provided by NDL methods. The prediction performance for training and for generating predictions in rhythmic motor tasks is evaluated. The joint angles, the joint velocities, the joint accelerations, and the joint torques are recorded using a GUI (Graphical User Interface), i.e., PolyScope, making it easy to program the robot to move the tool along a desired trajectory path.

3.1. Experimental Setup

UR5 is a 6-DoF collaboration robot with extruded aluminum tubes and joints. It has six rotary joints, and its structure is shown in Figure 4. The UR5 robot has a joint rotation range of [−2π, 2π] (rads) and a joint acceleration range of [0, π] (rads/s²). The UR5 robot is very popular in the robot research field.

According to the robot rotation angle and installation restrictions, the robot workspace is selected to be a hemisphere with an approximate radius of 850 mm above the installation plane. The range of joints motion is shown in Table 1. In order to best approximate the actual working situation of the robot, within the selected robot workspace, 1000 points are randomly selected. According to the actual use requirements of the robot, the joint running speed range is [0.8–2] rads/s, while the acceleration range is [1–1.8] rads/s.

The robot is ordered to run in a rhythmic way, according to the set trajectory. The joint position, speed, and servo motor current data, along the robot trajectory, is delivered from the robot controller at a frequency of 100 Hz. Since the UR5 robot is not equipped with a torque sensor, the measured torque is obtained indirectly through the motor current, at each joint. The relationship between torque and current is as follows [51]:in which is the gear ratio, ; motor constant, ,, ; and is the motor current (A).

During the actual operation, the robot is affected by noise, making the sampling data fluctuate. In that case, there will be large fluctuations and ripples in the actual measured current, which seriously affects the accuracy of the torque prediction. The average data method can increase the signal-to-noise ratio of the data [52], reduce the influence of noise, and improve the prediction accuracy. The average joint position can be expressed as follows:in which M is the number of running trajectories, is the k-th sampling point of one running trajectory, and is the position after M times of averaging. The same method is used to deal with speed and current. The zero-phase low-pass Butterworth filter (forward and reverse IIR Butterworth filters) with a cutoff low-pass frequency of 1 Hz is used to process the averaged position and velocity (). Acceleration is obtained by the central difference method [53]. Data processing is important for the accuracy of parameter identification, making the above processing very appropriate, as it avoids large deviations in identification.

A total of 1,000 groups (a total of 108,008) of valid samples were obtained. According to the ratio of 80% to 20%, they were divided into training and testing sets, serving in K-fold cross-validation. In addition, the test data is ensured to be sufficiently different from the training data, highlighting the generalization ability of the learned models. The above sample set is used to train and test the NDL model and SDL model, respectively, while it also analyzes and compares the prediction performance.

All input and output data are normalized to match the consistency of the learning model. After the prediction of inverse dynamics, the real value is restored. The normalized equation is as follows:in which represents the normalized value; denotes the real value; and and are the minimum and maximum real values, respectively.

The performance of manipulator inverse dynamics predictions is evaluated using Root Mean Square Error (RMSE), which is defined as follows:in which and represent the i-th predicted value and real value, respectively, and N is the total number of the data sets.

4. Results

The training and prediction in this paper were performed with MATLAB 2019a, using an ordinary personal computer. Computer hardware has a high influence on training time. In this work, the models are trained on a CPU with a clock speed of 2.7 GHz. The structure and hyperparameters of the NDL and SDL models were initially set according to previous work, while the final settings were determined based on the fivefold cross-validation method.

The prediction results of the RBD, NDL, and SDL models are listed in Table 2. The data in the table shows the RMSE of the RBD, NDL, and SDL models, on different robot axes and under different cross situations. Based on Table 2, the following conclusions apply:(1)The results of “cross average” (Figure 5) indicate that the prediction accuracy of SDL is generally more accurate than the one of NDL and NDL is generally more accurate than RBD. Also, the prediction accuracy of the SDL model for the first 3 axes of the robot is significantly improved.(2)The results of “all axes” (Figure 6) indicate that the prediction accuracy of the NDL model is sometimes better than the one of the RBD model (cross 3, 4, 5), while sometimes it is worse (cross 1, 2). However, the NDL model is better than the RBD model (mean) in general, while the prediction accuracy of the SDL model is always better than in the case of the other two models.(3)All the data in Table 2 shows that the semiparametric models are able to combine the strengths of both models, i.e., the parametric RBD model and the Nonparametric Deep Learning model. The prediction accuracy of the SDL model is always better than that of the RBD and NDL models.

RMSE is not sufficient to fully represent the performance of torque prediction, because the range of torque variation for each joint of the robot varies greatly. Therefore, the ratio of cross average RMSE to the range of measured torque values was used to further analyze the predictive performance of different joints. As shown in Table 3, the torque prediction performance of the first three (elbow) joints is better than that of the last three (wrist) joints.

Part of the measured values of each joint torque, RBD predicted value, NDL predicted value, and SDL predicted value are all plotted in Figure 7. Figures 7(a)–7(f) are the predicted moments of axis 1 to axis 6, respectively; Figures 7(g)–7(l) are the predicted errors of moments of axis 1 to axis 6, respectively; the purple curve represents the measured torque value, the blue represents the calculated torque value using RBD method, the red represents the DL predicted torque value, and the yellow represents the SDL predicted torque value. Figure 7 shows that the SDL model combines the advantages of the RBD model and the NDL model. For example, as shown by the red dashed box in Figure 7, when the torque prediction error of the RBD is large, the nonparametric part works, which greatly improves the prediction accuracy of the SDL model. As another example, shown by the green dotted box in Figure 7, when the learned nonparametric models do not generalize well to the state space regions, the torque prediction will rely on the parametric RBD part.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

(i)

(j)

(k)

(l)

5. Conclusion

In this work, Semiparametric Deep Learning (SDL) method is proposed to model robot inverse dynamics, for smart city and industrial applications. The SDL model takes advantage of the global characteristics of classic RBD and the powerful fitting capabilities of deep learning methods. Moreover, SDL model can be optimized simultaneously for the parametric and nonparametric model, instead of separate optimizations. The results on the UR5 robot show that the SDL models provide higher accuracy and better generalization, compared to RBD and NDL. The essence of the SDL model is to fully utilize the a priori information encoded in the parameterized model, overcome the limitations of the NDL method, and always show good learning performance. As far as future work is concerned, the flexible factors in dynamics will be considered as addition to the SDL model, in order to improve the accuracy prediction performance.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported by the National Key Research and Development Program of China (no. 2017YFB1302100).

References

J. Jiang, F. Lin, J. Fan et al., “A destination prediction network based on spatiotemporal data for bike-sharing,” Complexity, vol. 2019, Article ID 7643905, 14 pages, 2019.
View at: Publisher Site | Google Scholar
G. Li, L. Zhang, Y. Sun, and J. Kong, “Towards the sEMG hand: internet of things sensors and haptic feedback application,” Multimedia Tools and Applications, vol. 78, no. 21, pp. 29765–29782, 2019.
View at: Publisher Site | Google Scholar
Y. He, G. Li, Y. Liao et al., “Gesture recognition based on an improved local sparse representation classification algorithm,” Cluster Computing, vol. 22, no. S5, pp. 10935–10946, 2019.
View at: Publisher Site | Google Scholar
J. Qi, G. Jiang, G. Li, Y. Sun, and B. Tao, “Intelligent human-computer interaction based on surface EMG gesture recognition,” IEEE Access, vol. 7, pp. 61378–61387, 2019.
View at: Publisher Site | Google Scholar
B. Siciliano and O. Khatib, Dynamics, Springer Handbook of Robotics, Springer, Berlin, Germany, 2008.
K. Yamane, “Practical Kinematic and Dynamic Calibration Methods For Force-Controlled Humanoid Robots,” in Proceedings of 11th IEEE-RAS International Conference on Humanoid Robots, pp. 269–275, ICML, Bled, Slovenia, 2011.
View at: Google Scholar
S. Traversaro, A. D. Prete, R. Muradore, L. Natale, and F. Nori, “Inertial Parameter Identification Including Friction and Motor Dynamics,” in Proceedings of 13th IEEE-RAS International Conference on Humanoid Robots, pp. 68–73, Atlanta, GA, USA, 2013.
View at: Google Scholar
Y. Ogawa, G. Venture, and C. Ott, “Dynamic Parameters Identification Of A Humanoid Robot Using Joint Torque Sensors and/or Contact Forces,” in Proceedings of 14th IEEE-RAS International Conference on Humanoid Robots, pp. 457–462, Atlanta, GA, USA, 2014.
View at: Google Scholar
J. Hollerbach, W. Khalil, and M. Gautier, “Model Identification,” Springer Handbook of Robotics, Springer, Berlin, Germany, 2008.
R. Camoriano, S. Traversaro, L. Rosasco et al., “Incremental semiparametric inverse dynamics learning,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 544–550, IEEE, Paris, France, 2016.
View at: Google Scholar
Y.-P. Zhao, B. Li, Y.-B. Li, and K.-K. Wang, “Householder transformation based sparse least squares support vector regression,” Neurocomputing, vol. 161, pp. 243–253, 2015.
View at: Publisher Site | Google Scholar
D. Nguyen-Tuong, B. Scholkopf, and J. Peters, “Sparse online model learning for robot control with support vector regression,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3121–3126, IEEE, Madrid, Spain, 2009.
View at: Google Scholar
Y. Choi, S.-Y. Cheong, and N. Schweighofer, “Local online support vector regression for learning control,” in Proceedings of the 2007 IEEE International Symposium on Computational Intelligence in Robotics and Automation, pp. 13–18, IEEE, Jacksonville, FL, USA, June 2007.
View at: Google Scholar
H. Mori, Y. Ohama, N. Fukumura, and Y. Uno, “Learning of real robot's inverse dynamics by a forward-propagation learning rule,” Electrical Engineering in Japan, vol. 161, no. 4, pp. 38–48, 2007.
View at: Publisher Site | Google Scholar
N. Ishibashi and Y. Maeda, “Learning of inverse-dynamics for SCARA robot,” in Proceedings of the SICE Annual Conference, pp. 1300–1303, Takamatsu, Japan, September 2011.
View at: Google Scholar
O. Ken and M. Yutaka, “Learning of inverse-dynamics and inverse-kinematics for two-link SCARA robot using neural networks,” in Proceedings of the SICE Annual Conference, pp. 1031–1034, Takamatsu, Japan, September 2011.
View at: Google Scholar
S. Vijayakumar, A. D’Souza, and S. Schaal, “Incremental online learning in high dimensions,” Neural Computation, vol. 17, no. 12, pp. 2602–2634, 2005.
View at: Publisher Site | Google Scholar
S. Vijayakumar and S. Schaal, “Fast and efficient incremental learning for high-dimensional movement systems,” in Proceedings of the IEEE International Conference on Robotics and Automation, vol. 2, pp. 1894–1899, IEEE, Montreal, Canada, 2000.
View at: Google Scholar
J. S. d. l. Cruz, Learning Inverse Dynamics for Robot Manipulator Control, University of Waterloo, Waterloo, Canada, 2011.
T. T. Um, M. S. Park, and J. Park, ““Independent Joint Learning: a novel task-to-task transfer learning scheme for robot models,” 2014,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 5679–5684, IEEE, Paris, France, 2014.
View at: Google Scholar
K. Caluwaerts and J. J. Steil, “Independent joint learning in practice: local error estimates to improve inverse dynamics control,” in Proceedings of the 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 643–650, IEEE, Seoul, South Korea, November 2015.
View at: Google Scholar
Z. Shareef, P. Mohammadi, and J. Steil, “Improving the inverse dynamics model of the KUKA LWR IV+ using independent joint learning∗∗Z. Shareef received funding from the German federal ministry of education and research (BMBF) within the leading-edge cluster competition. P. Mohammadi received funding from the European community's horizon 2020 robotics program ICT-23-2014 under grant agreement 644727—CogIMon,” IFAC-PapersOnLine, vol. 49, no. 21, pp. 507–512, 2016.
View at: Publisher Site | Google Scholar
K. Chai, Multi-task Learning with Gaussian Processes, Institute for Adaptive and Neural Computation, School of Informatics, University of Edinburgh, Edinburgh, Scotland, 2010.
M. Deisenroth, J. Peters, and C. Rasmussen, “Approximate dynamic programming with Gaussian processes,” in Proceedings of the American Control Conference, pp. 4480–4485, Denver, Colorado, 2008.
View at: Google Scholar
M. Deisenroth and C. R. Pilco, “A model-based and dataefficient approach to policy search,” in Proceedings of the Twenty Eighth International Conference on Machine Learning, ICML, Bellevue, WA, USA, 2011.
View at: Google Scholar
D. Nguyen-Tuong and J. Peters, “Local Gaussian process regression for real-time model-based robot control,” in Proceedings of the International Conference on Intelligent Robots and Systems, pp. 380–385, Macau, China, 2008.
View at: Google Scholar
A. Rottmann and W. Burgard, “Learning non-stationary system dynamics online using Gaussian processes,” Pattern Recognition of Lecture Notes in Computer Science, vol. 6376, pp. 192–201, 2010.
View at: Google Scholar
D. Nguyen-Tuong, J. Peters, and M. Seeger, “Computed torque control with nonparametric regression models,” in Proceedings of the 2008 American Control Conference, ACC, Seattle, DC, USA, 2008.
View at: Google Scholar
D. Nguyen-Tuong and J. Peters, “Using model knowledge for learning inverse dynamics,” in Proceedings of the 2010 IEEE International Conference on Robotics and Automation, pp. 2677–2682, Anchorage, AK, USA, May 2010.
View at: Google Scholar
C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning, MIT Press, Cambridge, MS, USA, 2006.
T. Wu and J. Movellan, Semi-Parametric Gaussian Process for Robot System Identification, IROS, Bengaluru, India, 2012.
J. Sun de la Cruz, D. Kulic, W. Owen, E. Calisgan, and E. Croft, “On-line dynamic model learning for manipulator control,” IFAC Robot Control, vol. 10, no. 1, pp. 869–874, 2012.
View at: Publisher Site | Google Scholar
S. Vijayakumar and S. Schaal, “Locally weighted projection regression,” in Incremental Real Time Learning in High Dimensional Space.” ICML, pp. 1079–1086, Morgan Kaufmann, Burlington, MS, USA, 2000.
View at: Google Scholar
A. Gijsberts and G. Metta, “Incremental Learning Of Robot Dynamics Using Random Features,” in Proceedings of the 2011 IEEE International Conference on Robotics and Automation, pp. 951–956, Shanghai, China, May 2011.
View at: Google Scholar
L. Zhang, C. P. Lim, and J. Han, “Complex deep learning and evolutionary computing models in computer vision,” Complexity, vol. 2019, Article ID 1671340, 2 pages, 2019.
View at: Publisher Site | Google Scholar
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015.
View at: Publisher Site | Google Scholar
N. Liu, L. Li, B. Hao et al., “Inverse dynamic modeling and simulation of multiple-degree-of-freedom heavy-duty hydraulic manipulator,” International Journal of Mechatronics and Applied Mechanics, vol. 2, no. 6, pp. 87–96, 2019.
View at: Google Scholar
N. Liu, L. Li, B. Hao et al., “Modeling and simulation of robot inverse dynamics using LSTM-based deep learning algorithm for smart cities and factories,” IEEE Access, vol. 7, pp. 173989–173998, 2019.
View at: Google Scholar
M. W. Spong, S. Hutchinson, and M. Vidyasagar, Robot Dynamics and Control, John Wiley & Sons, New York. NJ, USA, 2006.
A. Hernandez-Blanco, B. Herrera-Flores, D. Tomas et al., “A systematic review of deep learning approaches to educational data mining,” Complexity, vol. 2019, Article ID 1306039, 22 pages, 2019.
View at: Publisher Site | Google Scholar
G. Li, J. Li, Z. Ju, Y. Sun, and J. Kong, “A novel feature extraction method for machine learning based on surface electromyography from healthy brain,” Neural Computing and Applications, vol. 31, no. 12, pp. 9013–9022, 2019.
View at: Publisher Site | Google Scholar
W. Cheng, Y. Sun, G. Li, G. Jiang, and H. Liu, “Jointly network: a network based on CNN and RBM for gesture recognition,” Neural Computing and Applications, vol. 31, no. S1, pp. 309–323, 2019.
View at: Publisher Site | Google Scholar
G. Li, D. Jiang, Y. Zhou, G. Jiang, J. Kong, and G. Manogaran, “Human lesion detection method based on image information and brain signal,” IEEE Access, vol. 7, pp. 11533–11542, 2019.
View at: Publisher Site | Google Scholar
D. Jiang, G. Li, Y. Sun, J. Kong, and B. Tao, “Gesture recognition based on skeletonization algorithm and CNN with ASL database,” Multimedia Tools and Applications, vol. 78, no. 21, pp. 29953–29970, 2019.
View at: Publisher Site | Google Scholar
F. P. An, “Pedestrian re-recognition algorithm based on optimization deep learning-sequence memory model,” Complexity, 2019.
View at: Google Scholar
Y. Bengio, P. Simard, and P. Frasconi, “Learning long-term dependencies with gradient descent is difficult,” IEEE Transactions on Neural Networks, vol. 5, no. 2, pp. 157–166, 1994.
View at: Publisher Site | Google Scholar
I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to sequence learning with neural networks,” Advances in Neural Information Processing Systems, pp. 3104–3112, 2014.
View at: Google Scholar
K. Cho, B. Van Merrienboer, C. Gulcehre et al., “Learning phrase representations using RNN encoder-decoder for statistical machine translation,” in Proccedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp. 1724–1734, Doha, Qatar, October 2014.
View at: Google Scholar
D. Bahdanau, K. Cho, and Y. Bengio, “Neural machine translation by jointly learning to align and translate,” in Proceedings of the 3rd International Conference on Learning Representations, ICLR, San Diego, CA, USA, 2015.
View at: Google Scholar
E. Rueckert, M. Nakatenus, S. Tosatto et al., “Learning Inverse Dynamics Models in on Time with LSTM Networks,” 2017,” in Proceedings of the IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids), pp. 811–816, Santa Monica, CA, USA, November 2017.
View at: Google Scholar
N. Kovincic, A. Müller, H. Gattringer et al., “Dynamic parameter identification of the universal robots UR5,” in Proceedings of the ARW & OAGM Workshop, pp. 44–53, Steyr, Austrian, May 2019.
View at: Google Scholar
S. Jiang, M. Jiang, Y. Cao et al., “A typical dynamic parameter identification method of 6-degree-of-freedom industrial robot,” Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol. 231, no. 9, pp. 740–752, 2017.
View at: Publisher Site | Google Scholar
J. Jin and N. Gans, “Parameter identification for industrial robots with a fast and robust trajectory design approach,” Robotics and Computer-Integrated Manufacturing, vol. 31, pp. 21–29, 2015.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2020 Nan Liu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

476

Downloads

1016

Citations