Abstract

In industrial automation, an important task of robot system is to grasp moving objects. In order to grasp the moving target on the conveyor belt in the shortest time, this paper proposes a method of location prediction and interception grasping of the target object, and puts forward the corresponding time-optimal grasping point search algorithm. In order to reduce the motion impact of the manipulator and meet the kinematic constraints, the velocity planning curve of the normalized quintic polynomial was adopted to plan the motion of the manipulator in the joint space. In order to express the algorithm more clearly, the position-time function of the moving object and the position-time virtual function of the robot are introduced, and the time optimal grasping point appears at the intersection of the two functions. Finally, the method is verified by simulation analysis.

1. Introduction

With the rapid development of industrial robot technology, robots have become the core supportive equipment in intelligent manufacturing. In industrial automation, it is an important task of robot system to grasp target objects quickly, and grasping the target objects on the conveyor belt has become a routine task in automated production. In recent years, many scholars have proposed different studies on grasping moving objects with robots, and these studies can be divided into three methods.

The first method is vision-based control or visual servo tracking of moving objects. Vision-based control or vision servos are used as solutions in the robotics industry to improve the flexibility and intelligence of robotic systems, especially in unstructured environments. Visual servo control for tracking and intercepting maneuvering targets consists mainly of two different approaches, namely position-based visual servo (PBVS) and image-based visual servo (IBVS) [1, 2]. Vision servo systems are ideal for tracking maneuverable targets. Krishnan and Sankar [3] proposed an image-based visual servo which completes the tracking of two-dimensional image features. Keshmiri and Xie [4] proposed a new semioffline trajectory planning method with image-based visual servos, which expanded the operating space of the system compared with traditional visual servos. Stogl and Zumkeller [5] proposed a moving object tracking method using external depth sensors to carry out 3D reconstruction and capture of unknown objects.

The second approach is based on the prediction, planning, and execution (PPE) methodology. In the PPE method, the motion of the object is first predicted. Then, the robot motion trajectory is planned and the planned trajectory is executed to intercept the object. The PPE method is employed to intercept nonmaneuvering target objects (A target object is considered to be nonmaneuvering if it moves on a continuous path with constant velocity or acceleration). Adaptive prediction planning and execution (APPE) [6] technology is an improvement based on PPE technology, which can continuously adjust the grasping point according to changes in the target trajectory. Croft et al. [7] proposed an adaptive planning algorithm to search for the best grasping points, and the potential grasping points are not limited to a small number of candidate points. Fernandes and Lima [8] employed the APPE method to capture ping pong balls rolling on the table. Keshmiri et al. [9] proposed an online trajectory planning method based on APPE for robotic manipulators considering velocity and torque constraints. Wong and Chien [10] designed a moving object prediction and grasping system that enables a robot manipulator using a two-finger gripper to grasp moving objects on a conveyor and a circular rotating platform. Islam et al. [11] proposed a constant time motion planning algorithm applied to the belt grab so that the manipulator can complete the grab in constant time. Borangiu et al. [12] presented a correlation algorithm for visual robot tracking moving objects on a conveyor belt. Ye and Liu [13] proposed a velocity decomposition algorithm to capture objects whose transport trajectory cannot be predicted in the long time.

The third approach is based on navigation and guidance theory to intercept moving objects. Navigation-guided interception has been harnessed for nearly 50 years to track and intercept maneuvering objects, such as guided missiles that track and intercept rockets. Due to its simplicity, proportional navigation guidance (PNG) has become the most widely used guidance law [14]. In recent years, researchers have tried to involve the laws of guidance in allowing robots to intercept moving objects. Unlike missile interception, robot interception needs to be carried out smoothly. The velocities of the robot and the moving object must match at the rendezvous to achieve the smooth interception of moving objects. Mehrandezh et al. [15, 16] proposed a hybrid interception scheme that combines navigation-based interception techniques with traditional trajectory tracking methods. Su and Xi [17] also proposed a guidance-based strategy for moving target interception. Yuan and Chern [18] proposed a new guidance scheme for ideal proportional navigation guidance (IPNG). Compared to PNG-based navigation techniques, IPNG exhibits better mathematical process ability and lower sensitivity to track and circumvent the initial conditions of the problem. IPNG is a more suitable method for robots capturing and intercepting mobile objects. Keshmiri and Xie [19] proposed a strategy combining the navigation algorithm with augmented image-based visual services (AIBVS), which can quickly capture moving objects. Keshmiri [20] conducted a comparative analysis of various navigation guidance methods and proposed an improved version of the AIPNG method to solve two-dimensional problems and three-dimensional problems.

In industrial automation, it has become an important research direction to effectively shorten the movement time of robotic manipulators, improve working efficiency, and realize the grasping of moving objects on the conveyor belt in the shortest time. Almost all current algorithms have the problem of path limitation: the algorithm constantly searches for the optimal motion time of the robotic manipulator on a particular motion path. For example, Kim and Elizabeth [21] proposed an online near time-optimal trajectory planning for industrial robots. The time optimal planning of the known path is completed by combining T-shaped velocity curve with dynamic constraints. In the known research results, scholars mostly use the tracking capture method to grasp moving objects. This method has a long grasping cycle and is not suitable for rapid industrial production.

Therefore, this paper proposes a method to predict the position of the target object and later intercept as well grasp the target object. Hence, the corresponding intersection search algorithm is put forward to greatly reduce the period of completion of the capture task. In order to avoid large motion impact during operation and satisfy motion constraints in joint space, normalized quintic polynomial velocity curve was adopted in this paper. Considering that the robot arrival function of time cannot be exhaustive through inverse kinematics, a fast convergent search algorithm is proposed.

The rest of this paper is organized as follows. Section 2 introduces the composition of the grasping system. Section 3 introduces the trajectory planning of normalized quintic polynomial. Section 4 introduces the position-time functions of the robot and the target object. Section 5 introduces two intersection search algorithms, respectively. In Section 6, the application of time optimal intersection search algorithm in grasping system is simulated and analyzed. The conclusion is given in Section 7.

2. Conveyor Belt Automated Production Line Grasping System

Figure 1 shows a typical conveyor belt automated production line, where objects are supplied in a continuous manner on the conveyor belt. An automated production line system that completes the automatic sorting work requires the following systems:(1)The vision system, with a fixed CCD camera, acquires images of target objects(2)The image processing system, which processes images of target objects, acquires of the poses of the target objects and communication with the robot control system(3)The control system, which generates the robotic movement trajectory, controls the robot moving(4)The execution system, a robot(5)The conveyor belt platform

In practical applications, in order to avoid cable winding problems on constraints near the robot base, most robot manufacturers usually apply a motion limit on the axis of rotation, allowing only one direction, clockwise (CW) or counterclockwise (CCW). Therefore, object-capture systems are divided into two types, interception-based capture and tracking-based capture, which are shown in Figure 2. In order to achieve the capture of the target object with the robot in the shortest possible time, it is necessary to search for the best grasping point of the target object on the conveyor belt. This paper focuses on interception-based capture and proposed a time-optimal search algorithm for the grasping point.

3. Trajectory Planning

The point-to-point motion control of the robot, referred to as PTP control, only needs to perform path planning according to the pose information of the starting point and the target point, and does not concern the intermediate trajectory. This control method is relatively simple and has been widely applied to handing robots. Common velocity planning includes trapezoidal profile, S-Curve/Profile, and polynomial profile.

The acceleration curve of trapezoidal profile is discontinuous so that the acceleration, uniform velocity, and deceleration process cannot achieve a smooth transition. The jump phenomenon leads to a large mechanical impact when the joint motors working. The feed drive system’s vibrating not only causes damage to the motors but also wears down the robot joints and affects its service life. Therefore, trapezoidal profile is usually used in low-velocity, low-cost motion control processes.

Compared with the trapezoidal profile, the S-Profile has more stable acceleration and deceleration, and has less impact on the motor and transmission system, but at the same maximum speed, it takes longer to travel the same distance. In the S-Profile, its acceleration curve is T-shaped; in other words, when the jerk in the S-Profile is large enough, the S-Profile becomes a trapezoidal profile. And S-Profile takes more time in operation.

The mathematical expressions of trapezoidal profile and S-Profile are both piecewise functions, while polynomial profile generally refers to a curve that can be expressed by a single expression. According to different constraints, 3rd and 5th degree polynomials are commonly used. In the robot system, the simple polynomial programming has a very serious problem: there is no uniform velocity segment. As can be seen from Figure 3, simple polynomial programming cannot provide uniform speed control according to the desired speed, and in most robot applications, speed control processing is required. For multiaxis systems without coupling, since the motor capacity and load are known, a maximum achievable acceleration can be calculated so that traditional trapezoidal or S-shaped acceleration planning can be used to achieve very satisfactory results. For a multiaxis coupled system such as a robot, the load inertia of each joint is constantly changing during the movement process. Hence, traditional trapezoidal or parabolic planning cannot meet the needs well. With comprehensive consideration, the normalized quintic polynomial is adopted to carry out the time-optimized trajectory planning of the robot.

For the joint axis i, the joint displacement θi is obtained through the inverse kinematics of the robot. A normalized quintic polynomial is given: s (u) (u = t/T, is a normalized variable); speed limit is represented by ωlim; acceleration limit is represented by alim; the movement time of joint i represented by T is obtained.The normalized quintic polynomial is expressed in (1).

The first derivative of (1) is (2).

The second derivative of (1) is (3).

According to the constraints of the joint axis at t = 0 and t = T, (4) can be obtained.

According to equation (4), equation (5) can be obtained.

As per equation (5), b0 = 0, b1 = 0, b2 = 0, b3 = 10, b4 = 15, and b5 = 6; the normalized quintic polynomial is obtained.

With the second derivative of (1) equaling one, sʹ(u) = 60u − 180u2 + 120u3 = 0, u = 0,1/2,1 is obtained. Since the velocity is 0 at the beginning and end, that is sʹ (0) = sʹ (1) = 0, the motor reaches maximum speed at u = 1/2, sʹmax (u) = sʹmax (1/2) = 1.875.

With the third derivative of (2) equaling 0, sʹʹ(u) = 6 − 360u + 360u2 = 0, is obtained. The maximum acceleration value of the normalized quintic polynomial is

The maximum velocity ωmax and maximum acceleration amax of the quintic polynomial trajectory θ (t) should satisfy equation (7).

Because θ(t)/θi = s (u), if we take the first derivative of both sides of this equation, we get ; the second derivative function is also obtained as .

According to equation (8), for all

The previous calculations only consider the case of single-axis motion. When multiaxis synchronization is required, the axis with the longest motion time (related to factors such as the maximum speed and motion displacement of each axis) should be considered, and the longest motion time will be used as the time for synchronous motion time.

The synchronized movement time is T = max (Ti).

4. Position-Time Functions

To describe the minimum time that the robot takes to grasp the target object, and to search for the best grasping point, the position-time function of the robot is defined as tr (x): the time required for the manipulator to reach any point on the conveyor belt. The position-time function of the target object is defined as to (x): the time for target object takes to reach any point on the conveyor belt, as is shown in Figure 4.

Typically, the target object moves at a uniform velocity on the conveyor belt, and the conveyor’s velocity is known. Therefore, the target object’s position-time function can be expressed as a polynomial, which is described by equation (9).

The robot’s time function of arrival, tr (x), is usually preunknown. Of course, if enough midpoints are obtained and interpolated to approximate the robot’s position-time function, the exact form of the robot’s position-time function can be identified. However, the midpoints need to be calculated via inverse kinematics, which is complex and cannot be performed in real time. In this paper, a real-time search algorithm for time-optimal capture points is proposed and an improved version is given.

To grasp the object in the shortest possible time, the robot should arrive the grasping point at the same time as the object. If the robot’s time curve and the object’s time curve are both monotonically increasing or decreasing, there is a unique intersection point, which is the best place for the robot to capture the object in the minimum time [2224].

5. The Algorithm for Searching Grasping Point

A time optimal search algorithm is proposed for grasping point [25]. To use the time optimal search algorithm, two factors need to be fully considered.

(1) The position time curve of manipulator and the position-time curve of target have monotony to ensure the existence of intersection point; (2) the speed of the robot is generally faster than the speed of the conveyor belt guaranteeing the difference in the velocities of the robot and the target object.

5.1. The Pyramid-Shaped Time Optimal Search Algorithm

Firstly, the appropriate working area is selected. When the robot reaches , the target object reaches the point ; is the midpoint between [,]; and  = (+)/2. There is a unique intersection point in [,]. Since the robot’s velocity is faster than the velocity of the conveyor belt, the robot reaches the midpoint of [,] before the target object, and when the time difference between the robot and the target object reaches a certain point is less than or equal to the specified threshold, we identify this point as the best grasping point , as is shown in Figure 5. The operation steps of the search algorithm are as follows. (Algorithm 1)

In step 1, set k = 1, and select . The arrival time t1 is obtained according to inverse kinematics, and is calculated via the equation,  = c1 + c2 (c1, c2 R).
In step 2, if , the algorithm is stopped and the intersection point does not exist; if , go to step 3.
In step 3, calculate .
In step 4, if , set , and stop the algorithm; otherwise skip to step 5.
In step 5, set , and is calculated; then go to step 3.

In the process of searching intersections, the accuracy of the discriminant, , affects the search process of the algorithm. If the value of δ is too small, then a more accurate intersection can be obtained, but at the same time, the search time is increased. If δ is too large, the accuracy of the best grasping point obtained is reduced.

5.2. The Improved Time Optimal Search Algorithm

The improved time optimal search algorithm introduces an approximate robot position-time curve of the robot, as is shown in Figure 6, which is a straight line connecting the point and . The expression of is shown in equation (11).

The intersection point of approximate position-time curve and object position-time curve is denoted as , and it is assumed to be the approximate solution of the kth iteration, so it is expressed as follows:

Hence, the improved algorithm is as follows. (Algorithm 2)

In step 1, set k = 1, and an appropriate is selected. The arrival time t1, is obtained according to inverse kinematics, and is calculated via the equation .
In step 2, if , stop the algorithm and the intersection point does not exist; if , go to step 3.
In step 3, calculate and calculate the intersection point between the robot’s approximate position-time curve , and the target object’s position-time curve .
In step 4, , set  =  and stop the algorithm. If , go to step 5.
In step 5, set , and calculate the position of the target object at the same time; go to step 3.

Similarly, the algorithm terminates when the difference of the robot arrival time and object arrival time is less than δ, a predefined value. Threshold δ will affect the search time of the search algorithm.

6. Simulation

To verify the performance of the above-mentioned algorithm, a simulation experiment was conducted. In the experiment, a 6-DOF robot was utilized (The model of the robot is TA6-R10. The parameters of the robot are as shown in Table 1). Since the first three axes of the 6-DOF robot mainly affect the arrival time during which the end effector of the 6-DOF robot reaches the target point, and the last three axes mainly affect the pose of end effector and does not affect the arrival time, in the experiment, only the first three axes of the 6-DOF robot were considered. In the simulation, parameters of the 6-DOF robotic manipulator were set. The maximum angular velocity of the robotic joint is 150 degrees/s, and the velocity of the conveyor belt was set to 200 mm/s, which moved along the x-axis direction. The standby position of the end effector is [1000, 0, 500].

When the 6-DOF robotic end effector is ready for operation, the target object can be at any positions in the grasping area. The starting and final positions of the target object’s position-time curve will change, but the gradient will not change. As shown in Figures 7 and 8, the position-time curves under different scenarios are described.

As it takes some time for the robotic manipulator to arrive the grasping interval, the target object may still be captured in the grasping interval although the target object’s initial position is outside the grasping interval such as position 1. When the initial position of the target object is close to the final edge of the grasping interval, the robotic manipulator cannot complete the grasping of the target object which is inside the grasping interval, such as position 4. Therefore, we proposed a new concept: candidate interval. The candidate interval varies according to the speed difference between the conveyor belt and the robot.

To demonstrate the performance of the proposed improved search algorithm, we use the two algorithms to simulate several times, and the simulation results are compared. The simulation results of the pyramid search algorithm are shown in Table 2, and the simulation results of the improved time optimal search algorithm are shown in Table 3. Under different error thresholds, the operation time of the two algorithms is shown in Figure 9.

By comparing the data in Tables 2 and 3, three inferences can be made.(1)When the initial location of the target object is near the final edge of the grasping interval, the search algorithm can locate the pickup point faster(2)When the error requirement is not strict or errors are high, the running time of pyramid optimization algorithm is shorter than the improved search algorithm(3)The running time of pyramid optimization algorithm decreases with the increase of error, but the error values of the improved algorithm are always in the state of high precision, and the running time is relatively fixed.

Therefore, in order to study the advantages of the optimized algorithm, when the initial position of the target object (200 mm) and the speed of the conveyor belt (200 mm/s) are fixed, the two algorithms are respectively used to intercept and capture the target, and the errors after each iteration of the two search algorithms are recorded and compared.

As shown in Figure 10, although the improved time optimal search algorithm has a complex calculation formula and each iteration takes longer time, the improved algorithm has a larger search step distance and higher iteration efficiency during each iteration; the improved algorithm can complete the search for the grasping points in a shorter time within the high-precision error range, and is more suitable for the application in high-precision grasping tasks.

7. Conclusions

To complete the grasping of the objects on the conveyor belt in the shortest possible time, a real-time search algorithm for the best grasping point is proposed. The robot’s arrival function of time and the target object’s arrival function of time were introduced. Simulation experiments were carried out on the pyramid-shaped search algorithm and the improved time optimal search algorithm; the optimal grasping point, which is the intersection where the robot’s position-time curve and the object’s position-time curve meet, was successfully found. The experiment results show that the improved search algorithm is more efficient.

The interception grasping method and intersection searching algorithm proposed in this paper can be applied to the tasks such as the classification of known parts or the sorting of defective parts. Compared with tracking grab, interception grasping method is more suitable for industrial automation production line. Due to the lack of tracking process of the object to be captured in the interception grasping method, there is a velocity difference between the robot’s claw for capturing the object and the object. When the speed of the conveyor belt is too high, the capturing process may failure. In the actual application process, the time of the image processing and the time of the claw’s closure should be fully considered.

Data Availability

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors’ Contributions

Kai Zhang, Mingquan Yang, Xuwei Zhang, and Fei Liang contributed equally to this work.