Abstract

Human motion capture is widely used in exoskeleton robots, human-computer interaction, sports analysis, rehabilitation training, and many other fields. However, soft-sensor-based wearable dynamic measurement has not been well achieved. In this paper, the dynamic measurements of legs were investigated by using dielectric elastomers as stain sensors, and an alternating signal was applied to detect the dynamic rotational angles of the legs. To realize a quick response, parameters of the sensors were optimized by circuit analysis. The sensor can detect hip, knee, and ankle joint motions with a sample frequency of 200 Hz. The measurements of the sensors were compared with a commercial motion capture system from PhaseSpace, and dynamic errors between them were smaller than 3° when squatting and walking at low speed and smaller than 5° when walking at high speed. Experiments therefore demonstrate the feasibility of the integrated wearable stretch sensors with pants.

1. Introduction

Motion capture systems for tracking leg motion are widely applied in many fields, such as rehabilitation [13], competitive training [4], human-computer interaction [5], movie, animation [6], and exoskeleton assist systems [7]. The measurement of joint motion can ensure safe and effectual rehabilitation of leg motion [8]; several systems for leg rehabilitation have been developed that are applied to rehabilitation of spinal cord injury and neurological or orthopedic lesions [911]. In addition, the capture and analysis of joint motions can improve the competitiveness of some sports. For example, swimming requires proper leg posture to obtain optimal performance, and accurate feedback of leg motion can guide training for the sport [12]. Moreover, precise measurements of joint angles can make exoskeletons more comfortable.

The current measurement methods mainly include optical dynamic motion capture system based on vision technology [13], ultrasound based [14], electromagnetic based [15], linkage measurement based on mechanism, and IMUs (inertial measurement unit) [16, 17]. The first three methods require a system to generate a specialized peripheral signal, and the system cannot be fully integrated into the human body, so the first three methods are not applicable to measure the joint motions of mobile human body. The linkage measurement system is bulky and extremely inconvenient to wear. The inertial sensor obtains the angle value through integral operations, which can cause a large drifting. Therefore, soft strain sensor is a good candidate to measure the motion of human joint, because of its flexibility, comfort, compliance, low cost, and large strain.

The soft strain sensor mainly consists of a soft substrate and stretchable conductive electrodes. The general materials of the substrate are rubber [1820], PDMS [2124], cotton-based materials [2527], etc.; the conductive electrode materials mainly include carbon black [28], carbon nanotubes [25], metal nanowires [29], and grapheme [30]; the measurement principles include capacitance-based type and resistance-based type. Repeatability of the resistance-based type is not good, so high precision is hard to be guaranteed [20, 25]. Therefore, the capacitive strain sensor is more suitable for human motion measurement, and the capacitive soft sensor based on the dielectric layer of silicone rubber is more advantageous in terms of performance indicators, stability, and lifetime [31]. The group of Prof. Anderson has made significant progress with the dielectric elastomer sensor (DES) based on silicone rubber as applied to detect finger motion [3234] and the leg motion of a diver [35], but the measurement errors are still high. Therefore, in this paper, we demonstrate the dynamic measurements of leg motion by utilizing optimized wearable DESs, and precision of the DESs is better than the published data of dynamic measurements [3537].

2. Motion Analysis of Legs in Sagittal Plane and the Measurement Principle

Typical movements such as lifting and walking of the lower extremities mainly occur in the sagittal plane, including the pitching motion of the hips, knees, and ankles. When the human body stands in a neutral position, the hip joint performs flexion/extension in the sagittal plane around the frontal axis. The movement of the thigh to the front of the body has a flexion range of 0-125 degrees, and the backward movement has a range of 0-15 degrees, as shown in Figure 1(a). The knee joint performs flexion/extension in the sagittal plane with a range of 0 to 130 degrees, as shown in Figure 1(b). The ankle joint performs a dorsiflexion/plantarflexion movement in the sagittal plane around the frontal axis. The movement to the back of the foot is dorsiflexion with a range of 0 to 20 degrees. Movement to the sole is a plantar flexion with a range of 0 to 45 degrees.

To measure the rotational angle of the hip, knee, and ankle joints, the soft strain sensors were mounted on these regions as diagrammed in Figure 2. The strain sensor was fixed to a pair of athletic pants at points A and B; the pants can deform with the rotation of the joints, and the strain sensor is sufficiently soft, so the distance between points A and B will vary. Relationship was determined between the rotation angle and the sensor strain, which is approximately linear if the strain sensor is suitably placed.

3. Design and Optimization of the Strain Sensor for Dynamic Measurements

Silicone has large stretchability and tensile strength, so silicone was chosen as the material of the dielectric layer of the strain sensor, and integrated silicone and carbon powder were chosen for the electrodes. The strain sensor consists of three layers of silicone membranes and two layers of electrodes, as shown in Figure 3(a). The middle layer is the dielectric, while the outer layers are used for protection. The protective layers should cover the electrode areas and should also be as soft as possible so as not to restrict the deformation of the sensor. This DES structure creates an electrically flexible capacitor. The simplified equivalent electrical circuit is a variable capacitor in a series with two variable resistors to account for the resistance of the electrodes, as shown in Figure 3(b).

Both the capacitance and the resistance change with the deformation of the DES, and these changes can be used to infer the deformations. Compared to the series resistance, measuring changes in capacitance with deformation is more straightforward and reliable because the resistance is extremely dependent on the electrode uniformity and environmental temperature [38]. Capacitance of the DES can be calculated by Equation (1): where is the vacuum permittivity, is the relative permittivity of the dielectric layer material, is the area of the overlapping electrodes, is the thickness of the dielectric layer, is the width of the electrode area, and is the length of the electrode area. , , and are strains of the length, width, and thickness, respectively, and is equal to because both directions are free of constraint. Therefore, Equation (1) can be simplified to

From Equation (2), variations in the strain of the DES length can be linearly converted to variations in capacitance, and then we can detect the capacitance and calculate the DES length.

The principle of capacitance detection can be divided into frequency response-based methods, charge integration-based methods, and impedance matching-based methods, but these methods cannot balance detection speed and accuracy [33], so the principle of capacitance detection should be selected according to engineering requirements. Since the lower limb motion measurement requires a fast response, in this paper, a frequency-based method was applied: setting a sinusoidal voltage impulse ( in Figure 4), and the sensor capacitance can be detected by variation of its voltage amplitude as shown in Figure 4. Here, is the capacitance of the soft sensor, is the equivalent resistance of the soft sensor electrodes, is a setting constant resistance, is the sine wave excitation signal, and is the response signal to be collected.

The amplitude of the response signal can be derived as follows: where is the amplitude of the excitation signal , is the amplitude of the voltage of sensor, and is the amplitude of the voltage of . In the process of stretching the soft sensor, the capacitance and resistance of the sensor can be expressed by and . Therefore, Equation (4) can be rewritten as

The sensitivity of the DES can be calculated as Equation (6), where is the stretching velocity of the sensor and is the slope of during stretching.

When the DES is stretched at a constant speed, the capacitance of the sensor increases linearly and the voltage of the sensor decreases exponentially, so the instantaneous slope of decreases all the time. Therefore, in this approach, we use the average slope to represent , where is the initial value of during stretching and is the time when the drops to 80% . As a result, Equation (6) can be replaced by Equation (7).

Parameters of the sensor measured by an LCR meter (Tonghui, TH26011BS) are shown in Table 1.

Figure 5 shows a good fit between the theoretical model of the sensor (Equation (4)) and the measured voltage of the sensor.

Fitting the data in Table 1, we can obtain Equation (8). Variation in capacitance and resistance of the sensor with the time during stretching are given in Equation (9), which is derived from Equation (8):

Sensitivity is the most significant parameter when the voltage amplitude is limited. From Equations (5) and (6), we know that all the parameters , , and will influence the sensitivity of the sensor, so they should be optimized. In this approach, we used a genetic algorithm to find the optimal solution because it has no limitation of step length and the stretch is fast. According to the performance characteristics of the microcontrollers and amplifier circuit, the optimum parameter range was set to , , and . (Specific parameter ranges can be selected according to specific conditions.) Their optimized values are shown in Table 2.

4. Placement of the DES and Integration of the DES with Pants

The system should measure the joint angle of the hip, knee, and ankle joints in the sagittal plane, so there are in total six degrees of freedom, including flexion/extension movements of the hip and knee joints and dorsiflexion/plantarflexion movements of the ankle joint. The movement of the hip, knee, and ankle in the sagittal plane can be simplified to a hinge mechanism, and the joint angle can be simplified to the angle between the two parts of the limb in the sagittal plane.

The hip joint is composed of the femur and hip bone, as shown in Figure 6(a). The hip joint has three degrees of freedom, namely, flexion/extension, abduction/adduction, and internal/external rotation. According to the International Society of Biomechanics (ISB), the flexion/extension movements in the sagittal plane can be simplified to a hinge mechanism composed of the femur and the hip bone. The -axis of the hinge motion is required to cross the center point of the hip joint and parallel to the line formed by points and of the anterior superior iliac spine (ASIS) on both sides of the hip; the rotational angle of flexion/extension movements of the hip is denoted as as shown in Figure 6(a). The biceps femoris is located on the posterior side of the thigh, which belongs to the posterior muscle groups, as shown in Figure 6(b). The biceps femoris can flex the knee joint and extend the hip joint, which are fundamental movements of the thigh. Therefore, the soft sensor was placed at the biceps femoris, and its two ends were sewn to the pants as shown in Figure 6(c).

The knee joint is composed of the lower end of the femur and the upper end of the tibia and the patella. The flexion/extension is the primary movement of the knee during gait. According to the ISB general standard, as shown in Figure 7, the flexion/extension movements of the knee joint in the sagittal plane can be simplified to the hinge mechanism composed of the femur, tibia, and fibula. The -axis of hinge motion is across the motion axis of the knee joint and perpendicular to the sagittal plane. The relative rotation angle of flexion/extension movements is expressed as , as shown in Figure 7. The ideal position of the sensor on the knee joint is to cover all the patella if the patella only rotates; however, the patella not only rotates but also slides on the femur, as shown in Figure 7(b). Therefore, the better design is covering only half of the patella to obtain a convenient calculation. Specifically, the lower end of the sensor is placed at the middle of patella, and the upper end is located on the quadriceps, as shown in Figure 7(c).

The skeletal structure of the ankle joint consists of the lower end of the fibula and the lower end of the tibia and the talus (Figure 8(a)). The ankle joint has three degrees of freedom, namely, dorsiflexion/plantarflexion, inversion/eversion, and internal/external rotation. During walking, the ankle joint performs dorsiflexion/plantarflexion movement almost entirely in the sagittal plane, so it can be simplified into a hinge mechanism composed of the lower leg and the foot. According to the ISB general standard, in the coronal plane, the line connecting the inner apex and the outer apex is the axis of the ankle joint moving in the sagittal plane. The relative rotation angle of the ankle joint is denoted as as shown in Figure 8(a). The Achilles tendon is located between the heel and the lower leg; it would be stretched if the ankle joint performs dorsiflexion/plantarflexion movement. The movement of the Achilles tendon can well reflect the movement of the ankle joint, so a soft sensor for measuring the ankle joint motion can be placed at the Achilles tendon as shown in Figures 8(b) and 8(c).

5. Measurements of Leg Motion by Using the Integrated Wearable Strain Sensor

Typical motions of the leg are squatting and walking; in this experiment, squatting was detected first. In order to test the accuracy of the system proposed in this paper, a popular commercial motion capture system PhaseSpace was employed, and the leg motions were captured by both systems simultaneously. Comparing measurements from both systems, performance of the proposed system can be evaluated. The measurements and the error between them are shown in Figure 9. It can be seen from the data that the dielectric elastomer sensors track the leg motion during squatting and the root-mean-square errors of the joint angles of the hip, knee and ankle are within 3°.

Next, the angles of the joints during walking were measured with a speed of 0.22 m/s, 0.5 m/s, 0.75 m/s, and 1.25 m/s, and the corresponding step frequencies were 0.33 Hz, 0.56 Hz, 0.67 Hz, and 0.83 Hz, respectively. Two sets of experiments were performed for each walking speed, and the root-mean-square error (RMSE) of the join angle measured by DES and PhaseSpace was calculated in each set of experiments. Among them, the comparison between the DES system and PhaseSpace at 0.33 Hz are shown in Figure 10.

There are four groups of measurement data for each joint (two sets of experiments for each leg); by averaging the root-mean-square errors of each joint under the same step frequencies, we can obtain the average root-mean-square errors (RMSE) of each joint at different speeds as shown in Table 3.

As can be seen from Figure 10 and Table 3, the hip and knee joints performed well in the walking test, but the ankle joint performed poorly because the ankle joint has internal/external rotation and inversion/eversion movement in the nonsagittal plane in order to reduce its motion impact and adjust its center of gravity. To be specific, plantarflexion of the ankle induces internal rotation and inversion; dorsiflexion of ankle induces external rotation and eversion. The movements in nonsagittal planes also influence length variations of the DES, introducing error. However, during a squatting motion, the sole of the foot maintains contact to the ground at all times, limiting the nonsagittal motion of the ankle joint, and thereby reducing the measurement error.

It can be seen from Table 3 that the measurements of the hip joint have varying accuracy at different walking speeds. For the knee joint, if the walking speed does not exceed 0.75 m/s (0.67 Hz), the detection results maintain a high accuracy. However, the detection accuracy decreases when the walking speed reaches 1.25 m/s; this decrease of accuracy may be from the impact between the leg and the ground. To explain the reason more clearly, data with a walking speed of 1.25 m/s is given in Figure 11, and it can be found that there is an irregular fluctuation when the angle value is at a minimum (when the leg is almost straight). This is because the posture of leg is almost straight when the foot contacts the ground, and the leg adjusts its posture to reduce impact by contacting. The compensation is often to produce a fast flexion and extension movement to extend the duration of the contraction. However, this fast flexion-extension makes a fast elongation-shortening of the DES that introduces a larger measurement error when walking with higher speed. For the ankle joint, the detection is worse than that of the other joints at most walking speeds due to the out-of-plane motion mentioned above. However, measurement accuracy did improve at a speed of 1.25 m/s, which may indicate less out-of-plane coupling at higher walking speeds.

6. Discussion

Compared to commercial motion capture system such as PhaseSpace, the proposed integrated sensing pants is a wearable detection system, and the measurement results can be quickly obtained. The measurement errors of the dynamic detection are better than the published data of dynamic measurements [3537]. However, there are still some issues that need to be improved. First, the sensors need to be wired into the pants as the wires may influence the reliability and lifetime of the sensors; the best design would be to achieve wireless transmission. Second, the integrated pants with the DES are not very convenient to wear, and it may be better to let the sensors remain independent modules that can be mounted and removed.

In the future, the accuracy of joint rotation can be improved by the following measures: (1) establishing a more precise system model and optimizing relevant parameters to increase the sensitivity of the DES, and (2) measuring the motion in both the sagittal and nonsagittal planes synchronously to limit any influence from coupling.

7. Conclusions

In this paper, we proposed a dynamic measurement system for leg motion based on dielectric elastomer sensors, which can detect squatting with an accuracy of 3° and walking with an accuracy of 5°. The sampling frequency of the system reached 200 Hz. The accuracy and response of the proposed system can meet majority of applications to measure human motion. In order to achieve high detection speed and sensitivity, a circuit system model was established and verified, and the circuit parameters were optimized by using the model. Based on the physiological characteristics of the human body, the characteristics of the hip, knee, and ankle joint movement were analyzed. According to the muscle distribution, the position and posture that are more favorable to the strain of the sensor are found: The hip joint sensor is arranged above the ischial tubercle and biceps femoris; the knee joint sensor is arranged above the patella and the quadriceps femoris; and the ankle joint sensor is arranged above the calcaneus and the Achilles tendon. Finally, the sensor is integrated and packaged with a pair of pants.

The DES is soft, flexible, and customizable, so it can be easily fitted to the surface of the skin and is well-suited to be worn on the human body. This DES system can be applied to rehabilitation training, analysis of athletic performance for training, and virtual reality systems. It can also be integrated into exoskeleton robotic systems to detect joint motions.

Data Availability

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare no conflict of interest.

Authors’ Contributions

Yaqing Feng and Yongze Li designed the DES. David McCoul revised the manuscript. Shihao Qin performed the experiments. Tao Jin improved the system model. Bo Huang improved performance of the sensors. Jianwen Zhao proposed the idea and methods of the measurements. Yaqing Feng and Yongze Li contributed equally to this work.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant No. 91648106) and the Primary Research & Development Plan of Shandong Province (Grant No. 2017GGX10128).