Mathematical Problems in Engineering

Volume 2010 (2010), Article ID 107538, 16 pages

http://dx.doi.org/10.1155/2010/107538

## Biologically Inspired Robotic Arm Control Using an Artificial Neural Oscillator

^{1}Center for Cognitive Robotics Research, Korea Institute of Science and Technology, P.O. Box 131, Cheongryang, Seoul 130-650, South Korea^{2}School of Information Science, Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi, Ishikawa 923-1292, Japan

Received 2 August 2009; Accepted 29 December 2009

Academic Editor: Stefano Lenci

Copyright © 2010 Woosung Yang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

We address a neural-oscillator-based control scheme to achieve biologically inspired motion generation. In general, it is known that humans or animals exhibit novel adaptive behaviors regardless of their kinematic configurations against unexpected disturbances or environment changes. This is caused by the entrainment property of the neural oscillator which plays a key role to adapt their nervous system to the natural frequency of the interacted environments. Thus we focus on a self-adapting robot arm control to attain natural adaptive motions as a controller employing neural oscillators. To demonstrate the excellence of entrainment, we implement the proposed control scheme to a single pendulum coupled with the neural oscillator in simulation and experiment. Then this work shows the performance of the robot arm coupled to neural oscillators through various tasks that the arm traces a trajectory. With these, the real-time closed-loop system allowing sensory feedback of the neural oscillator for the entrainment property is proposed. In particular, we verify an impressive capability of biologically inspired self-adaptation behaviors that enables the robot arm to make adaptive motions corresponding to an unexpected environmental variety.

#### 1. Introduction

Recently biologically inspired systems and control methods have been studied widely, in particular in robotics field. Thus, a number of virtual human or animal-like robots and control approaches have been yielded for the last decade. Owing that such approaches enable robots to embody autonomous dynamic adaptation motion against unknown environmental changes, its attraction has become generally gained and issued. This is because the musculoskeletal system is activated like a mechanical spring by means of the central pattern generators (CPGs) and their entrainment property [1–3]. The CPGs consist in the neural oscillator network and produce a stable rhythmic signal. Entrainment of the neural oscillator plays a key role to adapt the nervous system to the natural frequency of the interacted environments incorporating a sensory feedback. Hence, the neural oscillator in the nervous system offers a potential controller, since it is known to be robust and have an entrainment characteristic as a local controller in humans or animals.

Relating these previous works, the mathematical description of a neural oscillator was presented in Matsuoka’s works [1]. He proved that neurons generate the rhythmic patterned output and analyzed the conditions necessary for the steady state oscillations. He also investigated the mutual inhibition networks to control the frequency and pattern [2], but did not include the effect of the feedback on the neural oscillator performance. Employing Matsuoka’s neural oscillator model, Taga et al. investigated the sensory signal from the joint angles of a biped robot as feedback signals [3, 4], showing that neural oscillators made the robot robust to the perturbation through entrainment. This approach was applied later to various locomotion systems [5–7]. In addition to the studies on robotic locomotion [8], more efforts have been made to implement the neural oscillator to a real robot for various applications. Williamson showed the system that had biologically inspired postural primitives [9]. He also proposed the neuromechanical system that was coupled with the neural oscillator for controlling its arm [10]. Arsenio [11] suggested the multiple-input describing function technique to evaluate and design nonlinear systems connected to the neural oscillator.

As above, existing works in field of biologically inspired system based on neural oscillators have yielded notable results in many cases. However approaches for a proper behavior generation and complex task were not clearly described due to the difficulty in application considering a real robotic manipulator coupled with the neural oscillator. Yang et al. has presented simulation and experimental results in controlling a robot arm and humanoid robot incorporating neural oscillators [12–15]. Apart from such the proposed parameter optimization method, we newly address an intuitive and efficient approach for a desired task of the neural-oscillator-based control. In addition, this work addresses how to control a real system coupled with the neural oscillator for a desired task. For this, real-time feedback is implemented to exploit the entrainment feature of the neural oscillator against unpredictable disturbances.

In the following section, a neural oscillator is briefly explained and its entrainment property is described and verified. Details of the dynamic stability of the developed methodology are discussed in Section 3. The experimental results are presented in Sections 4 and 5. Finally, conclusion is drawn in Section 6.

#### 2. Rhythmic Movement Using an Artificial Neural Oscillator

##### 2.1. Matsuoka’s Neural Oscillator

Matsuoka’s neural oscillator consists of two simulated neurons arranged in mutual inhibition as shown in Figure 1 [1, 2]. If gains are properly tuned, the system exhibits limit cycle behaviors. The trajectory of a stable limit cycle can be derived analytically, describing the firing rate of a neuron with self-inhibition. The neural oscillator is represented by a set of nonlinear coupled differential equations given as
where is the inner state of the *i*th neuron which represents the firing rate; represents the degree of the adaptation, modulated by the adaptation constant or self-inhibition effect of the *i*th neuron; the output of each neuron is taken as the positive part of and the output of the whole oscillator as (0 for and 1 for ) is the weight of inhibitory synaptic connection from the *j*th neuron to the *i*th neuron, and are also weights from the extensor neuron to the flexor neuron, respectively; represents the total input from the neurons inside the network; the input is arranged to excite one neuron and inhibit the other, by applying the positive part to one neuron and the negative part to the other; and are time constants of the inner state and the adaptation effect of the *i*th neuron, respectively; is the external input, and indicates the sensory input from the coupled system which is scaled by the gain

Figure 2 shows a simple mechanical system connected to the neural oscillator. The coupled method enables a robot to adapt to changing conditions. The desired torque signal to the *i*th joint can be given by
where is the stiffness of the joint, is the damping coefficient, is the joint angle, and is the output of the neural oscillator that produces rhythmic commands of the *i*th joint. The neural oscillator follows the sensory signal from the joints; thus the output of the neural oscillator may change corresponding to the sensory input. This is what is called “entrainment” that can be considered as the tracking of sensory feedback signals so that the mechanical system can exhibit adaptive behavior interacting with the environment.

##### 2.2. Entrainment Property of Neural Oscillator

Generally, according to Matsuoka’s work [1, 2, 16], the entrainment can be realized under stable oscillation conditions of the neural oscillator. For stable oscillations, if tonic input exists, then should be in the range for which the natural frequency of the oscillator is proportional to The magnitude of the output signal also increases as the tonic input increases. and have an effect on control of the delay time and the adaptation time of the entrained signal, respectively. Thus, as these parameters decrease, the input signal is well entrained. And the minimum gain of the input signal enlarges the entrainment capability, because the minimum input signal is needed to be entrained appropriately in the range of the natural frequency of an input signal. In this case, regardless of the generated natural frequency of the neural oscillator and the natural frequency of an input signal, the output signal of the neural oscillator locks onto an input signal well in a wide range.

Figure 3 illustrates the entrainment procedure of the neural oscillator. If we properly tune the parameters of the neural oscillator, then the oscillator exhibits the stable limit cycle behaviors. In Figure 1, the gain *k* of the sensory feedback was sequentially set as 0.02, 0.2, and 0.53 such as in Figures 3(a), 3(b), and 3(c). When *k* is 0.02, the output of the neural oscillator cannot entrain the sensory signal input as shown in Figure 3(a). The result of Figure 3(b) indicates the signal partially entrained. If the gain *k* is properly set as 0.53, the neural oscillator produces the fully entrained signal as illustrated in Figure 3(c) in contrast to the result of Figure 3(b).

##### 2.3. Verification of Entrainment Property through Experiment

In this subsection, we experimentally verify the entrainment capability of the neural oscillator and its validation addressed in above Section 2.2. Figure 4 shows the experiment setup to implement entrainment to real robotic systems. As illustrated in Figure 2, the single pendulum is tightly coupled with the neural oscillator. This means that the neural oscillator observes and entrains the encoder value of the motor in terms of the sensory feedback and the output of the neural oscillator drives the motor directly. Hence, the pendulum is excited periodically by the output generated in the neural oscillator. And also the coupled oscillator-pendulum exhibits natural adaptive motions even though we swing the pendulum arbitrary 22 s to 38 s and 56 s to 74 s sequentially as shown in Figure 5. It can be confirmed from the experimental result that entrainment of the neural oscillator enables the coupled system to show naturally self-adapting motions against unpredictable disturbances.

#### 3. Control Scheme Based on Neural Oscillator

The neural oscillator is a nonlinear system; thus it is generally difficult to analyze the dynamic system when the oscillator is connected to it. Therefore we studied the existence of singular points and their stability of the neural oscillator in time domain analysis investigating equilibrium states [16]. Also analysis of a simple mechanical system coupled with the neural oscillator through a graphical approach known as the describing function analysis has been proposed earlier [17]. The main idea is to plot the system response in the complex plane and find the intersection points between two Nyquist plots of the dynamic system and the neural oscillator. The intersection points indicate limit cycle solutions. However, even if a rhythmic motion of the dynamic system is generated by the neural oscillator, it is usually difficult to obtain the desired motion required by the task. This is because many oscillator parameters need to be tuned, and different responses occur according to the interoscillator network. Hence, we propose the control method that enables a robot system to perform a desired motion without precisely tuning parameters of the neural oscillator within the range of its well-known stable condition.

Figure 6 illustrates a schematic model of a robot arm whose each joint is coupled to the neural oscillators. And a virtual force leads the coupled robot arm to a given motion. The virtual force inducer (VFI) such as springs and dampers which is supposed to exist virtually at the end-effector of a manipulator can be transformed into equivalent torques. This causes the end-effector of a robot arm to draw according to the desired trajectory calculating position error. Also, it is shown that ill-posedness of inverse kinematics can be resolved in a natural way without using any artificial optimization criterion [12–14]. However, even in such a method, kinematic configurations including redundant joints may not be guaranteed, even though the posture of a robot arm could be set only within a certain boundary.

From this point of view, it would be advantageous if neural oscillators are hardly coupled to each joint of a robot arm. When the oscillators are implemented to a robotic arm, they provide a proper motor command considering the movements of the joints with sensory signals. Since biologically inspired motions of each joint as described in Section 2 are attained by entrainment of the neural oscillator, the coupled joint can respond intuitively with the entrainment property according to environmental changes or unknown disturbance inputs performing an objective motion. In addition, each neural oscillator can be tuned in order to give the criterion for limitation of motion within a driving range to the joints considering the amplitude of the sensory feedback signal.

In general, dynamics of a robot system with *n* DOFs could be expressed as
where *H* denotes the inertia matrix of a robot, the second term in the left-hand side of (3.1) stands for coriolis and centrifugal force, and the third term is the gravity effect. Then a control input for a rhythmic motion of the dynamic system shown in (3.1) is introduced as follows:
where
where and are the spring stiffness and damping coefficient, respectively, for the virtual components. is the joint damping. and are the stiffness gain and the output of the neural oscillator that produces rhythmic commands, respectively.

The control inputs as seen in (3.2) consist of two control schemes. One is based on Virtual spring-damper Hypothesis [18, 19] and the other is determined in terms of the output of the neural oscillator as illustrated in (2.2). In the control input of (3.2), the first term describes a joint damping for restraining a certain self-motion which could occurr in a robot system with redundancy, and the second term means PD control in task space by using of Jacobian transpose, and also a spring and a damper in the sense of physics. Appropriate selection of the parameters such as joint damping factors stiffness and damping coefficient renders the closed-loop system dynamics convergent, that is, *x *is converged into and both of and become 0 as time elapses. In general, the neural oscillators coupled to the joints perform the given motion successively interacting with a virtual constraint owing to the entrainment property if gains of the neural oscillator are properly tuned [13, 16]. In the proposed control method, the VFI is considered as a virtual constraint. Also, the coupled model enables a robotic system to naturally exhibit a biologically inspired motion employing sensory signals obtained from each joint under an unpredictable environment change.

#### 4. Experimental Verifications

For considering the possibility of the proposed control scheme described in Section 3, a real robot arm with 6 degrees of freedom (see Figure 7(b)) is employed and a real-time control system is constructed. This arm controller runs at 200 Hz and is connected via IEEE1394 for data transmission at 4 KHz. ATI industrial automation’s Mini40 sensor was fitted to the wrist joint of the arm to detect external disturbances. The appropriate parameters in Table 1 were used for the neural oscillator. Also Table 1 illustrates the parameters on the arm dynamics of the real robot. The initial parameters of the neural oscillators were basically selected under the stable oscillation condition of the neural oscillator by investigating the dynamic response of the neural oscillator. The stable oscillation condition of the population of the connected unit neuron is well described in the Matsuoka’s works [1, 2]. And then, the amplitude and period of the neural oscillator’s output for generating the desired input are determined by controlling the parameter *s* (tonic input) and (time constants), respectively. Figure 8 shows the arm kinematics of the real robot arm. Since the desired motions are generated in the horizontal plane, and are set to The initial values of and are set to respectively. and corresponding to and in Figure 7(a), respectively, are controlled by the neural oscillators.

Various tasks in cases 1 through 3 of Figures 9(a), 9(b), and 9(c) are verified with respect to adaptive motion of the arm against arbitrary forces. As drawn in Figure 9, the end-effector of the two-link robot arm follows the desired trajectories (dashed lines). Then while the robot arm shows the desired motion, arbitrary external forces are applied to the end-effector of the robotic arm according to the direction of the arrows indicated in Figures 9(a), 9(b), and 9(c). Figures 10(a) to 10(c) indicate experimental results on case 1 to case 3 of Figure 9, respectively. Through these cases, we examine whether various desired motions such as motionless status as well as linear and circular motions can be attained or not. Basically kinds of these motions were verified from the results of Figure 10. In Figure 10, the dotted lines in the center part of the figure show the desired motions and overlapping lines illustrate the motion trajectories that are drawn in terms of the end-effector of the real robot arm. In addition, we pushed and pulled the end-effector along the positive and negative *x* direction as shown in Figure 10(a). And such conditions were also applied to the robot arm along the *y* direction in order to evaluate an adaptive feature of the proposed control method under additive external disturbances. It can be verified from the experimental result of Figure 10(a) that the robot arm is moved well according to the direction of the applied force (about 10 N and below). If an arbitrary force exists, then it follows that the end-effector of the robot arm shows a compliant motion even in the linear motion and circular motion of the robot arm as seen in Figures 10(b) and 10(c).

The force and torque (F/T) sensor value in the *x* and *y* direction are measured and calculated into each joint value. By this, the joint angles are changed according to the direction of the impact of the force induced by the collision, which makes the neural oscillators entrain the joint angles for biologically inspired motion. Hence a change in the output produced intuitively from the neural oscillator causes a change in the joint torque. Finally the joint angles are modified adequately. Thus, it can be confirmed that the proposed neural-oscillator-based robot arm control approach successfully dealt with unexpected collisions sustaining desired motions.

#### 5. Case Study: Opening and Closing a Drawer

##### 5.1. Experimental System

Figure 11 conceptually illustrates the objective tasks with experimental setup for the validation of the proposed control scheme. We evaluate the entrainment capability of the neural oscillator that enables a manipulator to implement and sustain the given task under various environmental changes. Hence, in order to verify the possibility of such adaptation performance, we apply various circumstances to the coupled oscillator-robot arm with the tasks with respect to opening and closing a drawer as seen in Figure 11. We tightly joined the end-effector of the robot arm to the drawer. The end-effector’s direction of the robot arm is designed in accordance with the direction to open or close the drawer under the condition that the drawer is not rotated but fixed. In Figures 11(b) and 11(c), the drawer was rotated clockwise and counter-clockwise about for considering unknown environmental changes. Then, the end-effector of the robot arm brings about various collision problems with the drawer due to a different direction between the end-effector of the robot arm and the drawer. Now, we will examine what happens in the arm motion on performing the objective task if additive external disturbances exist.

##### 5.2. Experimental Results

Figures 12(a) and 12(b) illustrate the experimental results on each joint output of the robot arm as the sensory feedback of the neural oscillator is turned off and on, respectively. In the first case of Figure 11(a), the desired motion of robot arm is not changed owing that the drawer is immovable during 0 s to 20 s. The first joint and the second one are actuated to move to the distance corresponding to an external force as explained in above Section 3. Hence, if the drawer rotates about and as illustrated in Figures 11(b) and 11(c) during 20 s to 40 s and 40 s to 60 s, then the robot arm’s motion is autonomously altered. In Figures 12(a) and 12(b), the blue lines indicate the desired trajectories produced by means of the neural oscillators for the joints 1 and 2. The red dotted lines are the output of the joints 1 and 2 that is changed in terms of forces applied when the drawer is rotated. Comparing the result of Figure 12(a) with the neural-oscillator-based control (see Figure 12(b)) if the sensory information is fed again, it can be observed that the outputs of each joint and neural oscillator are changed whenever unknown disturbances are induced into the robot arm. Such effect could be accomplished owing that the oscillator-based control reproduces the desired joint input entraining the joint motion coupled with the neural oscillator through sensory feedback. In Figure 12(a), the output of the neural oscillator sustains a certain oscillation because the sensory feedbacks were turned off and the joint desired input is slightly changed in terms of the torque sensor feedback in comparison with Figure 12(b). Figure 13 shows the snap shots of the robot arm controlled when sensory information is not fed again. The snap shots in Figure 14 show the motion of the robot arm implementing the proposed control approach based on the neural oscillator, where we can observe that the end-effector traces the rotated drawer direction.

As shown in Figures 15(a) and 15(b), the end-effector of the robot arm draws the trajectories corresponding to the desired motion for opening and closing the drawer. The straight dotted lines indicate the desired trajectories of the robot arm generated by simulation. The blue lines show the trajectories measured at the end-effector of the robot arm in experiments related with Figures 13 and 14. In Figure 15(a), movements of the robot arm are identical with the expected performance although there are inefficient motions due to unknown disturbances. This is because the desired input of each joint is modified adequately by the impedance model measuring external forces with the F/T sensor even though sensory information of the neural oscillators is not fed again. In comparison with this, the individual trajectories drawn by the robot arm in Figure 15(b) are completely consistent with the rotated direction of the drawer. Thus, the robot arm coupled with the neural oscillator exhibits the superior potential in adaptive motion exploiting the sensory feedback of the neural oscillator for the capability of entrainment. From experiment results of Figures 12(b), 14, and 15(b), the measured trajectories and movements of real robot arm imply that the neural oscillator enables the robot arm to exhibit the self-adapting motion to enhance adaptive motion sustaining the objective task and motion stability.

#### 6. Conclusion

We have presented a control scheme for technically achieving a biologically inspired self-adapting robotic motion. In contrast to existing works that were only capable of rhythmic pattern generation for simple tasks, our approach allowed the robot arm to precisely trace a trajectory correctly through entrainment. With this, the proposed method is verified through more complex behaviors of the real robot arm under unknown environmental changes. Also our approach causes appropriate desired motions irrespective of precisely modelling with respect to external disturbances. For such reason, it was observed from experimental results that the novel adaptive motions corresponding to an external force appear clearly. This approach will be extended to a more complex task toward the realization of biologically inspired robot control architectures.

#### References

- K. Matsuoka, “Sustained oscillations generated by mutually inhibiting neurons with adaptation,”
*Biological Cybernetics*, vol. 52, no. 6, pp. 367–376, 1985. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - K. Matsuoka, “Mechanisms of frequency and pattern control in the neural rhythm generators,”
*Biological Cybernetics*, vol. 56, no. 5-6, pp. 345–353, 1987. View at Publisher · View at Google Scholar - G. Taga, Y. Yamaguchi, and H. Shimizu, “Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment,”
*Biological Cybernetics*, vol. 65, no. 3, pp. 147–159, 1991. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - G. Taga, “A model of the neuro-musculo-skeletal system for human locomotion. I. Emergence of basic gait,”
*Biological Cybernetics*, vol. 73, no. 2, pp. 97–111, 1995. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - G. Taga, “A model of the neuro-musculo-skeletal system for human locomotion. II. Real-time adaptability under various constraints,”
*Biological Cybernetics*, vol. 73, no. 2, pp. 113–121, 1995. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. Miyakoshi, G. Taga, Y. Kuniyoshi, and A. Nagakubo, “Three-dimensional bipedal stepping motion using neural oscillators-towards humanoid motion in the real world,” in
*Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems*, vol. 1, pp. 84–89, October 1998. - Y. Fukuoka, H. Kimura, and A. H. Cohen, “Adaptive dynamic walking of a quadruped robot on irregular terrain based on biological concepts,”
*International Journal of Robotics Research*, vol. 22, no. 3-4, pp. 187–202, 2003. View at Publisher · View at Google Scholar - G. Endo, J. Nakanishi, J. Morimoto, and G. Cheng, “Experimental studies of a neural oscillator for biped locomotion with QRIO,” in
*Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems*, pp. 596–602, August 2005. View at Publisher · View at Google Scholar - M. M. Williamson, “Postural primitives: interactive behavior for a humanoid robot arm,” in
*Proceedings of the 4th International Conference on Simulation of Adaptive Behavior*, pp. 124–131, MIT Press, 1996. - M. M. Williamson, “Rhythmic robot arm control using oscillators,” in
*Proceedings of the IEEE International Conference on Intelligent Robots and Systems*, vol. 1, pp. 77–83, October 1998. - A. M. Arsenio, “Tuning of neural oscillators for the design of rhythmic motions,” in
*Proceedings of the IEEE International Conference on Robotics and Automation*, vol. 2, pp. 1888–1893, April 2000. - W. Yang, N. Y. Chong, C. Kim, and B. J. You, “Optimizing neural oscillators for rhythmic movement control,” in
*Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication*, pp. 807–814, August 2007. View at Publisher · View at Google Scholar - W. Yang, N. Y. Chong, J. Kwon, and B. J. You, “Self-sustaining rhythmic arm motions using neural oscillators,” in
*Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '08)*, pp. 3585–3590, Nice, France, September 2008. View at Publisher · View at Google Scholar - W. Yang, N. Y. Chong, C. Kim, and B. J. You, “Entrainment-enhanced neural oscillator for rhythmic motion control,”
*Intelligent Service Robotics*, vol. 1, no. 4, pp. 303–311, 2008. View at Publisher · View at Google Scholar - W. Yang, N. Y. Chong, S. Ra, C. H. Kim, and B. J. You, “Self-stabilizing bipedal locomotion employing neural oscillators,” in
*Proceedings of the IEEE-RAS International Conference on Humanoid Robots*, pp. 8–15, December 2008. View at Publisher · View at Google Scholar - W. Yang, J. Kwon, J.-H. Bae, N. Y. Chong, and B. J. You, “Biologically inspired self-adapting motion control employing neural oscillator,” in
*Proceeding of the IEEE International Symposium on Industrial Electronics*, pp. 161–168, July 2009. - J.-J. E. Slotine and W. Li,
*Applied Nonlinear Control*, Prentice-Hall, Englewood Cliffs, NJ, USA, 1991. - S. Arimoto, M. Sekimoto, H. Hashiguchi, and R. Ozawa, “Natural resolution of ill-posedness of inverse kinematics for redundant robots: a challenge to bernstein's degrees-of freedom problem,”
*Advanced Robotics*, vol. 19, no. 4, pp. 401–434, 2005. View at Publisher · View at Google Scholar - S. Arimoto, M. Sekimoto, J.-H. Bae, and H. Hashiguchi, “Three-dimensional multi-joint reaching under redundancy of DOFs,” in
*Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems*, pp. 1898–1904, 2005.