Abstract

The reach-to-grasp activities play an important role in our daily lives. The developed RUPERT for stroke patients with high stiffness in arm flexor muscles is a low-cost lightweight portable exoskeleton rehabilitation robot whose joints are unidirectionally actuated by pneumatic artificial muscles (PAMs). In order to expand the useful range of RUPERT especially for patients with flaccid paralysis, functional electrical stimulation (FES) is taken to activate paralyzed arm muscles. As both the exoskeleton robot driven by PAMs and the neuromuscular skeletal system under FES possess the highly nonlinear and time-varying characteristics, iterative learning control (ILC) is studied and is taken to control this newly designed hybrid rehabilitation system for reaching trainings. Hand function rehabilitation refers to grasping. Because of tiny finger muscles, grasping and releasing are realized by FES array electrodes and matrix scan method. By using the surface electromyography (EMG) technique, the subject’s active intent is identified. The upper limb rehabilitation robot powered by PAMs cooperates with FES arrays to realize active reach-to-grasp trainings, which was verified through experiments.

1. Introduction

Nowadays, the population of patients with limb motor dysfunction is increasing, which is caused by nerve injuries associated with stroke, traumatic brain injury, or multiple sclerosis. Particularly, the prevalence rate of stroke in China is increasing rapidly. Stroke survivors with various degrees of motor dysfunction not only endure inconvenience of the daily lives but also feel great psychological pressure, in addition to economic burden on the family and society. Many types of rehabilitation robots have been developed to assist rehabilitation in individuals with stroke [19]. In order to help stroke patients to receive intensive rehabilitation trainings as much as possible, cost-efficient portable rehabilitation equipment used in the community or home should be developed for patients after discharge, which would be a major improvement of limb rehabilitation.

Many stroke rehabilitation experiments show a positive role in using FES for recovery of motor function. FES is a method for activating sensory-motor systems by delivering electrical charge in the form of bursts of electrical pulses. By surface electrodes, FES stimulates motor or sensory nerves of muscles and facilitates motor rehabilitation and function reconstruction. Wu et al. [10] adopted a hybrid method of combining bilateral arm training with FES in patients poststroke to improve hand function, and a linear guide platform with FES feedback control is developed to execute the training of bilateral reaching movements. A robotic workstation for stroke rehabilitation of upper extremity using FES is developed by Freeman et al. [11]. They use voluntary control with the addition of electrical stimulation applied to muscles in the impaired shoulder and arm. FES can also realize the inhibition of abnormal reflexes and induce active movements [12]. Freeman et al. [1315] in the University of Southampton have developed a portable upper limb exoskeleton system for reaching rehabilitation trainings. The rehabilitation system is composed of a FES stimulator and the passive Armeo Spring [16]. It uses the spring force to compensate for the gravity of the patient’s upper limb and uses FES to activate paralyzed muscles to produce driving power. Rehabilitation training is a kind of continuous training with a certain intensity, but it will not be continuous due to muscle fatigue caused by electrical stimulation. The power of this system is all generated from FES stimulating the muscle, so training time and intensity of training will depend on whether the muscle state is fatigue or not.

RUPERT, a portable upper limb exoskeleton rehabilitation robot, is developed by Arizona State University. The system with five degrees of freedom (DOFs) is activated by low-cost PAMs and controlled by adaptive sensory feedback control algorithms for smooth- and safe-guarded movements during the task-oriented training. The unique features of the proposed robotic system are that it (1) is anchored on each user’s trunk and aligned at the shoulder of the trained arm; (2) generates unidirectional assistive pulling force in each joint to encourage active participation of the user during each movement; (3) provides gravity compensation only if the user is too weak; and (4) evaluates the effectiveness of therapy by performance analysis, which includes kinematic criteria and users’ effort. The new design makes the proposed robotic device portable for the user and can be used in various positions (sitting or standing) and different locations. By using less actuators, the weight and cost of the robot have been significantly reduced. The therapeutic benefits of the robot are not limited since antigravity tasks can be carried out by the motion control system which adapts to specific gravity compensation. In comparison with our previous studies [6, 17-18], this research mainly focuses on the safety and feasibility of our latest robotic arm, which has one more DOF of humeral internal/external rotation for enlarging the reaching space. More stroke patients were enrolled, and further biometric analyses were performed including clinical laboratory therapy sessions and in-home therapy sessions for the purpose of enabling frequent training at home. Despite all this, RUPERT with one way actuator of the joint is not suitable for stroke patients with weak muscles in the flaccid paralysis period. In order to expand the range of RUPERT rehabilitation application including reaching exercises for ordinary patients with flaccid paralysis, FES is used to activate paralyzed muscles. FES induced muscle force, and a pneumatic muscle pull force is a new kind of combination actuation, which can produce muscle torque and compensate the drawbacks of RUPERT. They cooperate together and realize the robotic joint two-way movement. Our proposed hybrid system in this research can allow patients to receive more lasting endurance rehabilitation trainings than the system developed by C.T. Freeman et al. As both the exoskeleton robot driven by PAMs and neuromuscular skeletal system under FES possess the highly nonlinear and time-varying characteristics, which add control difficulty to the hybrid dynamic system, ILC is studied and taken to control this newly designed hybrid rehabilitation system to realize repetitive task trainings. The transfer of ILC to rehabilitation is based on the patient making repeated attempts to complete a task, such as reaching out over a table top to an object.

The ability of grasping and releasing the object plays an important role in our daily lives. Most patients with stroke suffer from the hand dysfunction, the symptoms of which are that finger flexor muscle tone is high and patients cannot open their own hands actively. The hand rehabilitation includes two kinds of intelligent strategies: robot-assisted and FES. Heo et al. summarized the existing multi-DOF hand rehabilitation exoskeletons [19]. The number of the hand’s joints is up to 22 DOF, which will make the mechanical and electrical designs of the hand exoskeleton very complicated. As stroke patients’ hands show the phenomenon of abnormal nerve reflex, the rehabilitation exoskeleton is hard for patients to wear, even patients experiencing the secondary damage in the process of putting it on. FES can activate paralyzed muscles to produce joint movement through stimulus pulses conducted by use of surface-adhesive electrodes, but the precise finger joint movement by FES is not realized and therefore it is difficult to produce FES-induced functional grasping and releasing. The reasons are that the shapes of ordinary self-adhesive electrodes are bigger and their stimulus selectivity is not enough and yet it can activate many finger muscles at the same time. Westerveld et al. [20] invented an artificial way to paste small pad electrodes above the motor points of finger flexors and extensors and implemented the hand grasping and releasing with the help of FES and model predict control. The shortcomings of this method are that it takes much time of the therapist to place small electrodes accurately on the corresponding motor points. Malešević et al. [21] developed a 4 × 4 electrode array, which can achieve the intelligent trainings of hand grasping and releasing by virtue of FES, but it cannot implement reach-to-grasp trainings. In order to realize reach to grasp trainings, Westerveld et al. added a 3-DOF end-effector rehabilitation robot to the FES system with pad electrode [22]. They used robot and FES to achieve reaching and grasping, respectively [23], but this end-effector rehabilitation system guided the patient’s upper limb movement only through his/her hand but the shoulder, elbow, and wrist joints could not be rehabilitated individually. RUPERT upper limb rehabilitation exoskeleton integrated with FES can overcome the above shortcomings by the search algorithm. The surface electrode array is composed of many small electrodes arranged in matrix 4 × 6 form, which can realize each finger selective stimulation. This setup can solve the time-consuming problem of self-adhesive electrode placement while RUPERT can realize the multijoint coordination trainings.

Active training involves motion intention recognition, and now these sensors most widely used include two categories: electromechanical and bioelectrical. Electromechanical sensors mainly include position and force/torque ones, and this kind of sensors has electromagnetic mechanical time delay, especially expensive high-performance multiaxis force/torque sensors. Bioelectric sensors collect biological signals such as ECG, EMG, and EEG, and the time delay of this kind is shorter than the previous kind. EMG occurs 20–30 milliseconds ahead of muscles producing joint movement. Many rehabilitation devices use surface EMG to extract biological information as a way of identifying human motion intention. It is also used in the intention-based FES to actively activate the muscles to produce movement, but surface EMG is buried in stimulus artifact and induced muscle response (M wave). Comb filter and blanking window methods are used to extract intention information for the active intent.

In this paper, it introduces that upper limb rehabilitation robot powered by PAMs cooperates with FES arrays to realize active reach-to-grasp trainings for stroke patients. In Section 2, the dynamic models of a pneumatic muscle and FES-induced muscle are built for reaching trainings. In Section 3, the subject’s active intent is identified using EMG and grasping and releasing are realized by FES array electrodes. Section 4 introduces the ILC control strategy and its practical application to reach-to-grasp trainings by virtue of robot and FES. Section 5 reports the experimental results of PAMs in cooperation with FES arrays to realize active reach-to-grasp trainings. Conclusion and future work are shown in Section 6.

2. Dynamic Models of PAMs and FES Muscle for Reaching Trainings

2.1. The Modeling and Identification of RUPERT

The RUPERT upper limb rehabilitation robot has 5 DOFs: shoulder flexion/extension, humeral internal/external rotation, elbow flexion/extension, forearm pronation/supination, and wrist flexion/extension shown in the Figure 1(a). Figure 1(b) shows the mechanical design of the RUPERT robot. For each DOF, a pneumatic muscle is used as a unidirectional actuator to generate a joint pulling force. This accords with the stroke patients’ symptoms and that means the muscle is in a condition of high muscular tension while flexor muscles will produce involuntary contraction. As FES can stimulate paralyzed muscles to move against a PM-driving direction, RUPERT can achieve two-way joint movement with the help of FES, which enables more patients to use RUPERT to do rehabilitation trainings in different recovering phases. The depiction of a subject wearing the RUPERT robot is shown in Figure 2.

The hybrid dynamic system of RUPERT exoskeleton and FES neuromuscular model is shown in (1) and in which ,, are joint angle, angular velocity, and angular acceleration of 5-DOF RUPERT, respectively. is symmetric positive definite inertia matrix, and , are damping matrix and stiffness matrix, respectively. is the gravity moment. Based on the previous work [17, 18, 24, 25], it is known that , , and are diagonal matrix and and are set to a constant value shown in (2). The values of and vary according to the different subjects by use of the specific calculation method according to the literature [17]. is torque generated by patients’ muscle forces and other disturbances. is the torque generated by pneumatic muscle, and is torque generated by neuromuscular electrical stimulation. The dynamic models of pneumatic muscle play an important role in this hybrid combination. So this chapter introduces the modeling and identification of pneumatic muscle.

By virtue of the physical model, the controlling of the pneumatic system would become more complex, as some parameters are not easy to be detected. After linear simplification, damping-related items are omitted, which are not conducive to the relatively rapid real-time control of the lower limb gait. The phenomenon model is taken from the external observation, which is usually represented by a mass-stiffness-damping dynamic system. This kind of model is also called the three-element model of pneumatic muscle, and its equations can be described as shown in the following:

Three elements include inertia M, damping B, and stiffness K shown in Figure 3. The only input control variable is pneumatic pressure P, and F (P) is active contraction force. Damping B has different values according to the process of inflation and deflation, respectively. is the viscous force impeding the pneumatic muscle movement itself, and is the spring force impeding the pneumatic muscle shortening. is the driving force for the load, of which M is the load mass, is the gravity acceleration, and x is the axial contraction length of the pneumatic muscle. is marked as the initial position of the pneumatic muscle in a completely bleeding state. The contraction coefficient and stiffness coefficient are obtained by using different pressures and least square method (LSM) through the static force balance experiments. Damping system is obtained through the static disturbance experiment, and for their specific identification process, please refer to the literature [26]. Pneumatic muscle experimental platform is shown in Figure 4 while the identification results are shown in Table 1.

2.2. Modeling and Identification of FES Muscle

Neuromuscular electrical stimulation models are widely used in various fields of researches, which can explore the characteristics of isometric and nonisometric contraction of muscles. In the case of nonisometric contraction, the force produced by the muscle is not only related to the length of contraction, but also the rate of muscle contraction. If the muscle lies in the condition of equal length changes such as elongation or shortening in the case of isometric contraction, the muscle produces the maximum contraction force and then the maximum muscle contraction force will be reduced. Hill model is the most commonly used model for muscle modeling, by use of mass-spring-damping to describe the dynamic behavior of muscle. Durfee model [27] is expanded on the basis of the Hill muscle model.

is the input variable of electrical stimulation signal, and is the th sampling. is the “static nonlinear” function of the discrete-time Hammerstein model shown in Figure 5, and linear dynamic function is . is delay factor, and m and n are the poles and zeroes of the transfer function , respectively. d is the sample number of time delay. is disturbance, and is the output of the neuromuscular electrical stimulation of muscle force or torque. Nonlinear function is the cubic spline function; ,,,…, are cubic spline interpolation points shown in the following [28]:

Therefore, (9) can be regarded as the problem of least square shown in (10) to (11). Hammerstein structure nonlinear function and linear system parameter identification are taken by the use of an iterative algorithm using the ARX model.

The surface electrical stimulator (Hasomed, Rehastim2) is a constant current source with eight stimulus channels. Real-time control can be realized based on the ScienceMode2 communication protocol by the use of RS232 serial port with Simulink xPC Target.

The process of generating test data is called TR (triangular ramp). The value of pulse width is linear from 0 to 350 and then back to 0 value. Its range has been distributed while the stimulus frequency is 20 Hz, and the stimulus amplitude is 20 mA. Nonlinear (6) of this proposed electrical stimulation model is rewritten as (12). Neuromuscular electrical stimulation dynamic contraction process can be expressed with the two order system [28], so the parameter values of linear expression (4) are , respectively. The electrical stimulation model parameters of the biceps are shown in Table 2, and the functional equation of identification is shown in (13) to (14). Consider

3. EMG Triggered Active Grasping and Releasing Trainings

3.1. Surface Array Electrodes Used in the Grasping and Releasing

Surface finger muscles related with grasping and releasing include flexor pollicis longus (FPL), extensor digitorum communis (EDC), and thumb thenar muscle. Grasping is generally divided into two categories: power grasping and precision grip. To test the effectiveness of grasping and releasing by using the exoskeleton and FES, “power grasping” under electrical stimulation is relatively simple and taken as the research paradigm. To be simplified, flexor pollicis longus (FPL) and extensor digitorum communis (EDC) are selected as the stimulus objects shown in Figure 6. 42% of hand movement only needs four fingers, including the index finger, middle finger, ring finger, and little finger. Metacarpal phalangeal (MCP) is the metacarpophalangeal joint, and proximal interphalangeal (PIP) is the proximal interphalangeal joint. is the angle of the palm and finger joint while is the proximal interphalangeal joint angle, and represent the index finger, middle finger, ring finger, and little finger, respectively, as shown in Figure 7. 4 × 6 array electrodes in Figure 8were used while stimulation system adopted German Rehastim2, which used the Omron G3MB solid-state relay with switch frequency 5 kHz. MCP and PIP joint angles were measured by using Cyberglove.

The desired hand gesture was realized by matrix scanning method applied to array electrodes. The joint angle errors were kept within the plus or minus 3 degrees. Electrical stimulation frequency was 20 Hz, and stimulating pulse width 350 was constant. Stimulating pulse width 0–15 mA was regarded as the stimulus variable, and was the electrical stimulation amplitude. Root mean square error in (15) was taken as a performance optimization goal. When was the smallest, the corresponding combination of electrode array targets was selected by trials and errors. The range of stimulus amplitude was from 2 mA to 15 mA while electrode array target number was from to , as shown in Figure 9.

3.2. Real-Time Intention Extraction of Surface EMG under FES

Intention-based EMG can be taken as the trigger signal of robot and FES, but it is contaminated by FES stimulus artifact in this research. A strategy was developed that real-time intention surface EMG was extracted from FES stimulus signals. Surface EMG sensor was using the model SX230 of Biometrics Corporation. Simulink xPC target system was used, as shown in Figure 10.

Electrical stimulation artifact was detected using Simulink Comb filter [29], shown in (16) to (17). is the th sample of the original signal, and is the sampling number of two adjacent stimulus intervals. is the energy matching coefficient, and is the filter EMG. In order to make the active intention EMG suitable for trigger control, it needs to be normalized. is the actual electrical amplitude while is the envelope line. is the envelope line in the condition of muscle isometric contraction. presents the active intent coordination coefficient, and its arrange is [0-1]. 0 means no intention output while 1 stands for maximum active power.

4. Iterative Learning Control

Rehabilitation training is a kind of repetitive training. Body state of patients will improve with an increase in the number of training while the auxiliary level of robot and electrical stimulation will be reduced. In addition, it becomes more difficult to control the exoskeleton system because of its highly nonlinear and time-varying characteristics, which are caused in the existence of nonlinear actuators including PMAs and FES. Iterative learning control improves the dynamic system control performance by use of the previous errors and control inputs, which is consistent with the process of rehabilitation training. Patients try to complete the appointed tasks with the help of RUPERT and FES, and the desired trajectory and the actual trajectory will produce movement error. After the one training finishes, the robot returns to the initial position and the motion error information can be used as a prior knowledge of the next training. Iterative learning control is in line with this repetitive training mode shown in Figure 11.

With an increase of assisted rehabilitation trainings, patients’ upper limb motor function will improve gradually, so the contribution of patients’ active muscular force will increase and the assistance of RUPERT and FES will reduce. Newton’s iterative learning control (ILC Newton) is applied in this hybrid rehabilitation system [30, 31]. is the number of iterations, and , , , and are the expected angle, the actual angle, the angle error, and the control input of the times iterations, respectively, shown in the following:

Newton method is well known for searching approximate real roots of nonlinear functions through successive approximation, and the specific process is to develop the real valued function by using the Taylor series. By selecting a few terms of the Taylor approximation series of real valued functions and using iterative method for solving , approximate roots are gotten. Given a function and its derivative , the root of the iterative estimation is shown in the following equations. is the iteration estimates of k times, and is the iteration estimates of the k + 1 times. Newton method converges fast, because the mathematical expression of its convergence rate is the second order rather than linear, and the premise is the existence of inverse that means the existence of .

5. Experiments of Reach-to-Grasp

When the angle error of elbow joint is more than zero, the error value is set to . When the angle error of elbow joint is less than zero, the error value is set to which shown in (20). The elbow joint motion is controlled by the proportional valve and FES by use of iterative learning controller as shown in Figure 12.

, , and are damping coefficient, stiffness coefficient, and inertia coefficient of elbow joint, respectively. is the gravity moment of elbow joint, and is the active muscular torque and other bounded disturbances. and are the torques the pneumatic muscle and FES produce in (21), (22), and (23), respectively. , , and are the contraction coefficient, stiffness coefficient, and damping coefficient of pneumatic muscle, respectively. is the pneumatic muscle contraction length, and is the radius of elbow joint. and are the torque coefficients of the pneumatic muscle and FES, respectively. is the effect of the elbow angle and angular velocity on the FES-induced torque shown in (24). , , and are 0.02, 0.03, and 0.01, respectively. In order to facilitate the calculation, is set to zero and the linearization of is equal to . Equation (25) is the expression combination of elbow joint drivers. The sampling time is 1 millisecond. and are the control inputs of pneumatic muscle and FES, respectively, both of which use P-type iterative learning control to update the input. In the process of iterative learning control, when the angle error is within 2 degrees, the iterative process is stopped.

This experiment uses the Simulink xPC target real-time control platform, communicating with the surface electrical stimulator Rehastim2 through RS232 serial port to achieve the real-time control. The sampling frequency of xPC target real-time system is 20 kHz, and a PCI-6229 NI acquisition card can output 4-channel DA and control 4-way electromagnetic proportional valves. Pressure signal, force sensor signal, and absolute angle sensors are feedback to the real-time system through the PCI-6229 AD acquisition card. Incremental angle sensors are feedback to the control system through NI PCI-6602. Shoulder joint and elbow joint target angles were . The task time was seconds, and was less than 2 degrees.

After the approval of the ethics committee of Huazhong University of Science and Technology, three healthy subjects were recruited to the treadmill-based exoskeleton gait training experiments (subject 1, male, 32 years old; subject 2, female, 34 years old; and subject 3, male, 29 years old). Before the trainings began, three subjects were informed of the experimental content and purpose shown in Figure 13. In the process of robot and FES-assisted trainings, the subjects were asked to relax as much as possible. The task time is for grasping, and active coordination intention parameter is . In order to reduce the experimental difficulty, the external/internal rotation was fixed to 30 degrees, and only the shoulder and elbow joints were executed. When is less than 0.3, it means hand releasing. When is more than 0.3, it means hand grasping. Stimulus intensity is calculated according to (26). For the above three subjects, and were set as 14 and 43, 13 and 43, 17 and 47, respectively.

6. Experimental Results

For the same desired hand posture, mapping targets of the three subjects’ grasping and releasing under array electrical stimulation are different, shown in Figure 14. Grasping targets of subject 1 are a total of 6 targets with stimulation current amplitude of , A1, A4, B2, B3, B4, and C2, respectively. Releasing targets of subject 1 are a total of 9 targets with stimulation current amplitude of , E3, E4, F2, F3, F4, G1, G2, G3, and H2, respectively. Grasping targets of subject 2 are a total of 7 targets with stimulation current amplitude of , A2, A4, B2, B3, B4, C1, and C3, respectively. Releasing targets of subject 2 are a total of 9 targets with stimulation current amplitude of , E3, F1, F2, F3, F4, G1, G2, G3, and H2, respectively. Grasping targets of subject 3 are a total of 7 targets with stimulation current amplitude of , A4, B2, B3, B4, C1, C2, and C3, respectively. Releasing targets of subject 3 are a total of 9 targets with stimulation current amplitude of , E2, E3, F1, F2, F3, F4, G2, G3, and H2, respectively. About hand grasping and releasing experiments, it can be concluded that each subject’s stimulus threshold currents are not the same. These differences are caused by several aspects, including arm morphology, locations of array electrode placement, neuromuscular activation depth, and so on.

From Figure 15, it shows that the tracking errors of shoulder and elbow joint movement become smaller and smaller with the increasing of times. For the same error performance indicator, the number of iterations of three subject is 7 times, 8 times, and 9 times, respectively. This difference in the number of iterations may be caused by individual variations of the subjects.

Figure 16 shows the angle errors of trajectory tracking in the process of iterations. The tracking errors of shoulder joint have not changed obviously. The elbow joint errors greatly vary between the first time and the last time, and finally the error gradually decreases.

As is shown in Figure 17, for all the three subjects in the first iteration of the training process, intention-based grasping task is not activated, which indicates that it may be related to the adaptability of experiments. When it is in the fourth iteration of the training process, grasping intention is detected and grasping task of each subject is activated, but the duration that each subject spent was different. The last iteration is compared with the fourth iteration, which indicates that grasping movement is activated in advance for each subject. This adaptation to intention-based rehabilitation training can help patients to actively participate in trainings and promote the motor function rehabilitation.

7. Conclusions and Future Work

In this research, it is presented that upper limb rehabilitation robot powered by PAMs cooperates with FES arrays to realize active reach-to-grasp trainings. FES is taken to activate paralyzed muscles and achieve two-way joint movement targeted for reaching trainings. Modeling of PMA and neuromuscular system under FES and ILC methods is used. The array electrode by virtue of matrix scanning method can solve the problem of the traditional self-adhesive electrode which is time consuming in searching optimum stimulation target. Intention-based FES actively activates the muscles to produce movement. The experimental results validated the effectiveness of this hybrid rehabilitation of robot and FES to realize active reach-to-grasp trainings.

In consideration of their own characteristics of stroke subjects, our proposed integrative strategy is using RUPERT exoskeleton with FES electrically evoked paralyzed ankle muscles to realize reach-to-grasp trainings, which is a promising approach to alleviate the size and mechanical complexity of the robot, thereby the cost of the rehabilitation robot. The future research is discussed for design principle of how to take advantage of each technique in developing a more functional effective hybrid FES and robot-assisted system for upper limb rehabilitation trainings.

Conflicts of Interest

The authors declare no competing interests.

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 61233015 and Grant 61473130 and by the “Green Industry Technology Leading Program Project” of Hubei University of Technology (Grant no. ZZTS2017008).