Table of Contents Author Guidelines Submit a Manuscript
Journal of Robotics
Volume 2018 (2018), Article ID 1018086, 9 pages
Research Article

Stabilization of Teleoperation Systems with Communication Delays: An IMC Approach

School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China

Correspondence should be addressed to Yuling Li

Received 9 November 2017; Accepted 17 January 2018; Published 20 February 2018

Academic Editor: Brady King

Copyright © 2018 Yuling Li. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


The presence of time delays in communication introduces a limitation to the stability of bilateral teleoperation systems. This paper considers internal model control (IMC) design of linear teleoperation system with time delays, and the stability of the closed-loop system is analyzed. It is shown that the stability is guaranteed delay-independently. The passivity assumption for external forces is removed for the proposed design of teleoperation systems. The behavior of the resulting teleoperation system is illustrated by simulations.

1. Introduction

Teleoperation systems enable humans to extend their capacity to manipulate interfaces with better safety, at less cost, and even with better accuracy. A typical teleoperation system is composed of five parts: a human operator, a master robot which is operated by the human operator, a slave robot, the environment interacting with the slave, and the communication channel between the master and the slave. The main objectives of control design for a bilateral system are the stability of the closed-loop system, position coordination between the master and the slave, and the haptic force display of environment to the human operator.

When there exist significant delays in the communication channel of the teleoperation system, one major issue is the stability of the system [1]. The passivity-based control approaches which are based on scattering theory [1] or wave variable [2] concept are widely used to design stable teleoperation system with time delays. These controllers render the communication link passive and, thus, guarantee stable bilateral teleoperation of any passive environment by any passive user; see [3] and the references therein. For passivity-based controlled teleoperation system, passivity assumption for external forces is required. However, in reality, it is not so easy to satisfy this assumption, and thus this control strategy has its own limitation in real applications.

Realizing the disadvantages in applying passivity-based control schemes in controlling teleoperation systems, we propose an alternative method in which internal model control (IMC) structure is introduced to linear teleoperation system design in this work. IMC was a well-established control strategy around the 1980s and its original configuration and several modified structures have been successfully applied to various applications from chemical processes to automotive systems (see [47] and many references therein). The extension to nonlinear systems has also been reported as it shows attractive properties beyond linear system design [8]. Some intelligent methods were introduced to the modification of IMC structures and nonlinear extensions [912]. Moreover, there have been some efforts on extending the IMC design method to nonlinear systems in the linear parameter varying (LPV) framework [13, 14] in recent years. The application of IMC in teleoperation systems is also not prior art. Hayn and Schwarzmann have employed IMC structure to design positions controllers for a teleoperation system with a hydraulic manipulator as the slave and a haptic device as the master [15]. However, the authors in [15] assume that no delay exists in the communication. The authors in [16] proposed an IMC design for teleoperation systems with time-varying delays, while, actually, it is a smith-predictor-based design of teleoperation systems. In this work, an IMC-based control structure for delayed teleoperation systems is proposed and no restrictive assumptions are made on this structure. The passivity assumption is not required for the proposed control scheme.

The arrangement of the remainder of this paper is as follows. In Section 2 the system modeling and some preliminaries are given. In Section 3, a control architecture is given and its stability is analyzed in Section 4. A simple DOF teleoperation system is given as an example to show the effectiveness of the proposed method in Section 5. Finally, the summary and conclusion of this paper are given in Section 6.

2. Preliminaries

A single-DOF linear master/slave manipulator can be written as [17]where are the joint positions, velocities, and acceleration values of the master and slave devices with or representing master or slave robot manipulators, respectively. Similarly, are the effective mass, damping, and spring coefficients of the master and slave devices. External forces applied to the devices by the human operator and the environment are represented by , , respectively, while , stand for control signals.

For simplicity, the transfer functions of the master and the slave are given as follows:

In this work, the following assumptions are required.

Assumption 1. The forward and backward delays through the communication channel denoted by , respectively, are assumed to be constant, but of arbitrary value.

Remark 2. Assumption 1 is made for simplicity. The main results in this paper are also valid for teleoperation systems with time-varying delays. In Section 5, we also provide some simulation study for the case with time-varying delays.

3. IMC Structure for Teleoperation Systems

This section proposes an IMC-based control structure which guarantees the delay-independent stability of the closed-loop system.

Let us start with the controller design process from one side of the teleoperation system, that is, from the master side, if no confusion arises. Inspired by the traditional IMC structure, we postulate the IMC structure for the master in Figure 1 where represents the master dynamics as in (2) and represents the model of the master manipulator. Note that the two-degree-of-freedom IMC structure [4] is utilized since the dynamic characteristics of the two inputs are substantially different. To describe the transparency, the reference signal should be the signals from the slave. Considering the communication delay between the master and the slave, the reference is delayed; that is, Obviously, the controllers are an operator of , respectively; that is, and . The human operator seems to be a kind of “disturbance” from the original IMC design interpretation; however, we may find that it should not be canceled in our design. The detailed discussion will be given later.

Figure 1: IMC structure of the master subsystem.

Analogically, the IMC structure for the slave side is depicted in Figure 2, where are linear operators of and ; that is, and , and

Figure 2: IMC structure of the slave subsystem.

The coordinating torques are given as

Equations (6) can also be represented by their -functions:

The control architecture is shown in Figure 3.

Figure 3: IMC structure of teleoperation systems.

Remark 3. From Figure 3 and compared with the classical IMC structure [4], we may find that the external forces are the “disturbances” according to the classical IMC interpretation. The difference is that these “disturbances” act on the master and the slave directly. In reality, these forces are kind of “excitation signals” and should not be canceled.

Remark 4. Actually, the output can be positions or velocities, or even the states of the master and the slave. In this paper, we assume that only the position is available for measurement; that is, and .

4. Stability Analysis

In this section, the stability of the closed-loop system is discussed.

Suppose , , , and ; then the closed-loop system in Figure 3 can be redrawn as in Figure 4 where and .

Figure 4: Equivalent IMC structure of teleoperation systems.

Let be the Laplace transform of ; then the controllers (7) can be rewritten as where From the block diagram of the IMC structure shown in Figure 4, the output is related to the input as

Since , (10) can be rewritten as

When the system model matches the plant perfectly, that is, , one has

It can be seen that the internal stability is always ensured as long as a stable parameter is used to control the stable plant . Like the traditional IMC system, we have the following important property.

Theorem 5 (dual stability). Assume that the master/slave model and the master/slave manipulator dynamics match perfectly; that is, . Then the stability of is sufficient for the stability of the overall closed-loop system.

Remark 6. In the proposed control design, there are no passivity assumptions for human forces and environmental forces . These forces can be any bounded signals from the IMC interpretation.

Remark 7. Actually, when , the system is basically open loop. Hence this IMC-based design of teleoperation systems provides the open-loop advantages. When the perfect model is not available, that is, , the overall system is a closed-loop system. Thus, the IMC control strategy has the advantages of both the open-loop and the closed-loop structures [18]. However, the stability condition for the case that becomes complex, since the subdiagonal delays exist in , and this will be a subject of ongoing research.

Remark 8. For the case , the benefit of this structure is that the communication time delays do not enter into the feedback channel. Hence the stability of the overall system can be simplified given the stable controllers , , , and . In another way, it means that this control structure can guarantee the stability of the overall system with the communication delays varying from 0 to arbitrary value. This implies a way to choose suitable , , , and with sound performance.

Remark 9. Theorem 5 is also applicable to teleoperation systems with time-varying delays since the communication delays do not enter into the feedback loop.

5. Simulation and Results

We consider a simple single-DOF teleoperation system with the dynamics (1) with kg, kg,  Ns/m,  Ns/m,  N/m, and  N/m.

The operator is assumed to be with the following dynamics: where is a rectangle signal depicted in Figure 5, , and . The environmental force is chosen as .

Figure 5: External force .

We first implement the control in Figure 3 assuming that there are no delays in communication channel and obtain the simulation results shown in Figures 7 and 8. The chosen control parameters are represented by their step responses, which are depicted in Figure 6. It can be seen that the master and the slave respond stably. As shown in Figure 7, the slave’s motion follows the master’s quickly with no delay; however, there is a bit of oscillation in the position of the master, which means the control parameters could be better chosen. Even though the positions between the masters and the slaves achieve perfect tracking, there is static error between the human force and the environmental force (Figure 8). This error may not be canceled since the position tracking and the force tracking are two objectives which require trade-offs.

Figure 6: Step responses of , , , and .
Figure 7: Position tracking performance when there are no delays in the communication channel.
Figure 8: Force tracking performance when there are no delays in the communication channel.

Now we make simulations for the case when there exist delays in the communication channel. Let us firstly assume that the time delays in the forward channel and backward channel are symmetric; that is, . The system performance with the designed controller under this case is depicted in Figures 9 and 10. It can be seen from Figure 10 that when the operator exerted the force to the master around  s, the slave contacted the environment after the delay of 1 second and then received an active force . The (delayed) position tracking performance depicted in Figure 9 is similar to the one when there are no delays in the communication channel.

Figure 9: Position tracking performance ( s).
Figure 10: Force tracking performance ( s).

We furthermore make simulations for the system with sudden appearing communication delays and sudden disappearing communication delays (both around ), but the delays are symmetric. For simplicity, we only provide the position tracking performances which are depicted in Figures 11 and 12. It is easy to see that the closed-loop system stays stable in this case. For the time interval with communication delays, the slave follows the master’s motion after corresponding delays.

Figure 11: Position tracking performance with sudden appearing delays.
Figure 12: Position tracking performance with sudden disappearing delays.

We further concern ourselves with the system’s performance when the forward and backward communication delays are not the same. We decrease the forward communication delay to 0.5 s and increase the backward communication delay to 2 s and implement the control in Figure 3, and then we obtain the simulation results as in Figures 13 and 14. These figures implied that the closed-loop system’s stability is guaranteed with unsymmetrical communication delays. Hence, it showed that the designed controller is a delay-dependent stable controller.

Figure 13: Position tracking performance ().
Figure 14: Force tracking performance ().

Finally, we make simulations for the teleoperation system with varying communication delays. The forward and backward time delays in the communication channel are modeled as , where are random variables with normal distribution characterized by its mean and standard deviation , denoted by standard notation . The forward and backward time delays in the communication channel are chosen with . The position tracking performance and force tracking performance are depicted in Figures 15 and 16. It is shown that the system is stable with good tracking performance even with bounded stochastic communication delays. This means that our method is also valid for teleoperation systems with varying delays.

Figure 15: Position tracking performance ().
Figure 16: Force tracking performance ().

6. Conclusion

In this paper, we investigate the IMC-based control design of linear teleoperation system with communication delays. The stability of the overall system is guaranteed if the perfect model is available. This method removes the passivity assumption for external forces. Simulations of a single-DOF linear teleoperation system show that the stability is guaranteed when the designed controller is applied. Good tracking performance can be achieved if the parameters are chosen suitably. Extensions to the case when the models and the plants are not perfectly matched and to nonlinear teleoperation systems are under study and the research results will be reported in the near future.

Conflicts of Interest

The author declares that there are no conflicts of interest regarding the publication of this paper.


This work was jointly supported by the National Natural Science Foundation of China (no. 61333002), the Fundamental Research Funds for the Central Universities (nos. FRF-TP-16-024A1 and FPR-BD-16-005A), and the Beijing Key Discipline Development Program (no. XK100080537).


  1. R. J. Anderson and M. W. Spong, “Bilateral control of teleoperators with time delay,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 34, no. 5, pp. 494–501, 1989. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  2. G. Niemeyer and J.-E. Slotine, “Stable adaptive teleoperation,” IEEE Journal of Oceanic Engineering, vol. 16, no. 1, pp. 152–162, 1991. View at Publisher · View at Google Scholar · View at Scopus
  3. E. Nuño, L. Basañez, and R. Ortega, “Passivity-based control for bilateral teleoperation: A tutorial,” Automatica, vol. 47, no. 3, pp. 485–495, 2011. View at Publisher · View at Google Scholar · View at Scopus
  4. M. Morari and E. Zafiriou, Robust process control, Prentice hall, Englewood Cliffs, NJ, USA, 1989.
  5. D. Schwarzmann, Nonlinear Internal Model Control with Automotive Applications, Logos-Verlag, 2008.
  6. D. Kim, D. Lee, and K. C. Veluvolu, “Accommodation of actuator fault using local diagnosis and IMC-PID,” International Journal of Control, Automation, and Systems, vol. 12, no. 6, pp. 1139–1149, 2014. View at Publisher · View at Google Scholar · View at Scopus
  7. T. N. L. Vu, J. Lee, and M. Lee, “Design of multi-loop PID controllers based on the generalized IMC-PID method with Mp criterion,” International Journal of Control, Automation, and Systems, vol. 5, no. 2, pp. 212–217, 2007. View at Google Scholar · View at Scopus
  8. C. G. Economou, M. Morari, and B. O. Palsson, “Internal model control: extension to nonlinear system,” Industrial & Engineering Chemistry, Process Design and Development, vol. 25, no. 2, pp. 403–411, 1986. View at Publisher · View at Google Scholar · View at Scopus
  9. D. W. C. Hot and Z. Ma, “Multivariable internal model adaptive decoupling controller with neural network for nonlinear plants,” in Proceedings of the 1998 American Control Conference, ACC 1998, pp. 532–536, Philadelphia, Pa, USA, June 1998. View at Publisher · View at Google Scholar · View at Scopus
  10. K. Hunt and D. Sbarbaro, “Neural networks for nonlinear internal model control,” IEE Proceedings Part D: Control Theory and Applications, vol. 138, no. 5, pp. 431–438, 1991. View at Publisher · View at Google Scholar
  11. E. P. Nahas, M. A. Henson, and D. E. Seborg, “Nonlinear internal model control strategy for neural network models,” Computers & Chemical Engineering, vol. 16, no. 12, pp. 1039–1057, 1992. View at Publisher · View at Google Scholar · View at Scopus
  12. I. Rivals and L. Personnaz, “Nonlinear internal model control using neural networks: application to processes with delay and design issues,” IEEE Transactions on Neural Networks and Learning Systems, vol. 11, no. 1, pp. 80–90, 2000. View at Publisher · View at Google Scholar · View at Scopus
  13. W. Xie and T. Eisaka, “Generalized internal model architecture for gain-scheduled control,” IMA Journal of Mathematical Control and Information, vol. 25, no. 4, pp. 447–459, 2008. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  14. J. Mohammadpour, J. Sun, A. Karnik, and M. Jankovic, “Internal model control design for linear parameter varying systems,” in Proceedings of the 1st American Control Conference (ACC '13), pp. 2409–2414, Washington, DC, USA, June 2013. View at Scopus
  15. H. Hayn and D. Schwarzmann, “Control concept for a hydraulic mobile machine using a haptic operating device,” in Proceedings of the 2nd International Conferences on Advances in Computer-Human Interactions, ACHI 2009, pp. 348–353, Mexico, February 2009. View at Publisher · View at Google Scholar · View at Scopus
  16. P. Jian and Q.-Q. Li, “Internal model control for force-reflecting teleoperation systems with varying time-delay,” Kongzhi Lilun Yu Yingyong/Control Theory and Applications, vol. 24, no. 1, pp. 13–18, 2007. View at Google Scholar · View at Scopus
  17. P. F. Hokayem and M. W. Spong, “Bilateral teleoperation: An historical survey,” Automatica, vol. 42, no. 12, pp. 2035–2057, 2006. View at Publisher · View at Google Scholar · View at Scopus
  18. I. Kaya, “IMC based automatic tuning method for PID controllers in a Smith predictor configuration,” Computers & Chemical Engineering, vol. 28, no. 3, pp. 281–290, 2004. View at Publisher · View at Google Scholar · View at Scopus