Research Article  Open Access
Freeway Traffic Density and OnRamp Queue Control via ILC Approach
Abstract
A new queue length information fused iterative learning control approach (QLIFILC) is presented for freeway traffic ramp metering to achieve a better performance by utilizing the error information of the onramp queue length. The QLIFILC consists of two parts, where the iterative feedforward part updates the control input signal by learning from the past control data in previous trials, and the current feedback part utilizes the tracking error of the current learning iteration to stabilize the controlled plant. These two parts are combined in a complementary manner to enhance the robustness of the proposed QLIFILC. A systematic approach is developed to analyze the convergence and robustness of the proposed learning scheme. The simulation results are further given to demonstrate the effectiveness of the proposed QLIFILC.
1. Introduction
Freeway traffic control [1–3] is an important area in the field of traffic engineering and intelligent transportation systems. Frequent congestion on freeway during rush hours deteriorates traffic conditions. The most common reasons causing freeway congestion include traffic demand being greater than capacity, as well as traffic accidents, road works, and weather [3]. For better utilization of freeway capacity, ramp metering [2, 4–7] is a commonly implemented strategy. The purpose of ramp metering is to regulate the amount of traffic entering a given freeway at its entry ramps to maximize throughput by maintaining a desired (or optimal) occupancy on the downstream mainline freeway.
Recently, various modelbased control methods were developed to solve the problem, for instance, numerical methods [4, 5], function approximation based on neural network [6, 8], linearization method [2], onestep ahead prediction and multiple prediction adaptive control [7], and so forth. A limitation of modelbased control is its sensitivity to modeling accuracy. Note that the scale of freeway traffic system expands with its dynamics becoming more complex nowadays. Consequently, an accurate freeway traffic model is hardly available in practice and it is highly nonlinear. Thus, modelbased control methods may not be able to produce satisfactory performance. It is desirable to develop a new control method that is less dependent on the model accuracy.
It is noted that traffic flow patterns are in general repeated every day. For instance, the traffic flow will start from a very low level at midnight and increase gradually up to the first peak of morning rush hour, which is often from 7 to 9 a.m., and the second one, which is from 5 to 7 p.m. [9]. Congestion typically starts at the same locations every day. Based on this observation, the iterative learning control (ILC) based ramp metering strategy has been proposed for the freeway density control [9–11]. Iterative learning control was first proposed in [12] for the control of a system that repeats the same task in a finite interval and has been extensively studied and achieved significant progress in both theory and applications [13–17]. ILC has a very simple structure and requires very little system knowledge, which is a very desirable feature in traffic control since the traffic model and the exogenous factors may not be well known in practice.
In [9], only the pure ILC based ramp metering and speed control were discussed. In [10], the learning mechanism combined with an error feedback in a complementary manner was studied and the simulation results have shown its superiority to the pure ILC scheme. Recently, the ILC based ramp metering and the modified modularized ramp metering based on ILC and ALINEA in the presence of input constraints were also analyzed to enhance the robustness of the proposed methods [11].
It is worth pointing out that the control input signals in [9–11] are updated based on the error information of the freeway traffic density only. Actually, the queue length of onramp is a significant factor [18]. Whenever the onramp demand exceeds the desired metering rate, a queue will form. However, the storage capacity of an onramp is often very limited. Therefore, if without proper control, the vehicle queue length will quickly exceed this capacity, causing the vehicles to spill over into the surface streets and interfere with street traffic.
Note that the current work is to consider the queuing demands as a constraint on the ramp metering [9–11]; that is, the onramp volumes cannot exceed the current demands plus the existing waiting queues at onramps. However, it is a queueoverride scheme in nature [18]. If the queue detector occupancy is above the threshold, the metering rate is increased by a certain level. When the queue detector occupancy falls below the threshold, the metering rate is reset to the value determined by the controller. It has been noted [19, 20] that this queueoverride scheme leads to oscillatory behavior and underutilization of onramp storage capacities.
In this paper, we present a new queue length information fusion based iterative learning control approach (QLIFILC) for freeway traffic responsive rampmetering by using the repeated traffic patterns. The proposed control scheme consists of a feedforward learning part, used to learn from the past control data in the previous trial to meet the performance requirement, and a feedback stabilizing parts, designed to restrain the state error and input disturbance such that the closedloop output tracking error is within a reasonable bound. A most distinct feature of the proposed QLIFILC is that the error information of the onramp queue length is used to prevent excessively long queues from interfering with surface street traffic and achieve a better performance. Both the rigorous analysis and the simulation results are given to demonstrate the efficiency and applicability of the proposed QLIFILC.
The rest of this paper is organized as follows. Section 2 introduces the traffic flow model and gives the problem formulation. The iterative learning controller based on the queue length information is designed and analyzed in Section 3. Section 4 provides some simulation results to illustrate the applicability and effectiveness of the proposed approach. Finally, some conclusions are given in Section 5.
2. Traffic Flow Model and Problem Formulation
The macroscopic traffic flow model [21] of a section is shown in Figure 1, where is the traffic flow entering the section (veh/hour), is the traffic flow leaving the section (veh/hour), is the traffic flow density at time (veh/lane/km), is the flow rate entering the mainline from the ramp (veh/hour), is the queue length in the ramp, is the inflow entering the ramp (veh/hour), is the length of the section, and is the time instant.
Let the total number of vehicles in the section at time instant be given by . At time , the number of vehicles is given by . Accordingly, the traffic density is changed to be and thus we have where is the number of lanes of the freeway mainline.
In addition, the change in the number of vehicles in the section can be expressed as where is the sampling time.
Apparently, it is easy to obtain from (1) and (2) that or
According to Greenshield’s model [22], one has where is the maximum possible density per lane and is the free speed. Thus, the relationship among traffic flow, density, and velocity can be expressed as
Substituting (6) into (4) yields
According to the conservation law, the number of vehicles that stay in the onramp at time is equal to the difference between the inflow volume and outflow volume; that is,
From (7) and (8), we have the macroscopic traffic model as follows:
Let , , , , and ; we can rewrite (9) as where is a corresponding vectorvalued function and is the system output.
To show the repeatable property and the strong uncertainties of the freeway traffic system, we denote the above macroscopic traffic flow model as follows: where and are added as the bounded state disturbances and output noises, respectively, denotes the iteration number, belongs to a finite time interval, and is regarded as an unknown repeatable disturbance in the following controller design and analysis.
The control objective of this work is to find a proper control input driving the traffic flow density to track the desired traffic density and the desired queue length of the onramp, .
Remark 1. In this paper, the control objective considered is only for some idea cases, where the traffic demand is not too heavy and one can manipulate the flow rate entering the mainline from the onramp to achieve the desired traffic density and to arrive at the desired queue length meanwhile.
Remark 2. In fact, there are more practical cases where the traffic demands of the mainline and onramp are heavy but not causing congestion. For such cases, it is better to consider a balance between the traffic density of the mainline and the queue length of the onramp by setting their proper desired values. Then, the control objective is to make the traffic density and the queue length track the desired values, respectively, as much as possible and the final tracking errors may not be zeros but some minimum values.
3. Controller Design and Convergence Analysis
3.1. Controller Design
Design a PDtype ILC law based on the queue length information fusion (QLIFILC) as follows: where and are learning gain vectors and with being the desired output at time .
Remark 3. Expand control law (12) as where is the tracking error of the traffic density and is the tracking error of the queue length of the onramp. Hence, the weighted sum of the tracking errors of the traffic density and the queue length is utilized in the QLIFILC to achieve a better performance.
Remark 4. The proposed ILC approach consists of a feedforward learning part and a feedback stabilizing part . The feedforward learning part is designed to meet the performance requirement. And the feedback stabilizing part is designed to accommodate the uncertainties and disturbances.
3.2. Convergence Analysis
Before the convergence analysis, some assumptions should be given as follows for the rigorous analysis.
Assumption 5. There exists a control input such that the system output can be driven to track the desired trajectory for the system (11) over the finite time interval .
Assumption 6. The reinitialization condition is satisfied throughout the repeated iterations; that is, where and are the initial values of the desired states.
Assumption 7. The function is Lipschitz continuous; that is, where is the Lipschitz constant.
Assumption 8. All of , , , and are bounded; that is, where , , , and are some positive constants.
Remark 9. Assumption 5 is very common in the control theory field. Assumption 6 is the standard condition for ILC analysis using contraction mapping approach. Although there exists a quadratic term in , it is noted that is always less than . So, Assumption 7 is automatically satisfied for the freeway traffic system. Note that, in Assumption 8, we just need the existence of the positive constants instead of their exact values.
The validity of the above presented optimal terminal ILC is verified by the following theorem.
Theorem 10. Under Assumptions 5–8, choosing the learning gain matrix such that and applying the proposed QLIFILC law (12) to the freeway traffic system (11), one can guarantee that for some positive constant depending on , , , , , , , and . If and , one can guarantee that the tracking error converges to zero as iteration number approaches to infinity; that is, , .
Proof. Let , ; then,
According to Assumption 7, taking norm on both sides of (17) yields
In terms of Assumption 6, (18) can be rewritten as
From (11), the error dynamics is given as
It is easy to obtain from (11), (12), and (20) that
Select such that ; is a positive constant. Let , , , , . In terms of Assumption 8, we know that ,, and are bounded. Taking norm on both sides of (21) and using (19) and (20), we have
Define norm as
Multiplying for both sides of (22), one obtains
Selecting , one can obtain from (24) that
Rearranging (25) yields
Let ; then (26) becomes
where
It is obvious from (27) that
By selecting such that , then we have
When and , then . It is easy to obtain
which implies .
Similarly, multiplying for both sides of (19), one has
Because , then . Hence, (32) implies that
Since , multiplying for both sides of (20), we can derive that
Substituting (30) into (34) and taking the limit of yield
when , , and . Hence, (35) implies
that is, .
Remark 11. It is noticeable from the analysis that the convergence of the learning system can be guaranteed under some sufficient conditions, which are independent of the stabilizing controller. This means that the feedforward learning mechanism can still work in the uncertain environment without the stabilizing controller, but the learning rate can be improved if a suitable one is used.
4. Simulation Study
Consider a long segment of freeway with the length of 3 km, and there is only one onramp located in the segment. The maximum traffic density veh/lane/km. The traffic flow entering the mainline and the inflow entering the ramp are given in Figure 2, respectively.
Consider an onramp with about 100 m length; the desired queue length is veh. The free speed km/hour, the sampling time s, and the finite sampling time instants .
In the simulation, considering the inevitable initial resetting error, we assume that both the initial traffic density, (veh/lane/km), and the queue length, veh, are nonstrictly repeatable. In addition, to show the robustness of the proposed approach, we set
Applying the proposed QLIFILC approach (12) with and , the simulation results are shown as the red solid lines in Figures 3 and 4, respectively. Figure 3 shows the learning convergence of traffic density with respect to the iteration number . The horizon is the iteration number and the vertical axis is the maximum absolute values of the traffic density tracking error . Figure 4 shows the learning convergence of queue length with iterations, where the vertical axis is the maximum absolute values of the queue length tracking error .
From Figures 3 and 4, the asymptotic learning convergence along iteration axis of traffic density and queue length can be clearly seen, and the fluctuation in mainline flow and queue length is considerably reduced with iterations. Further, the proposed approach is robust for the uncertain disturbances that existed in system states, outputs, and initial conditions.
For the purpose of comparison, we design a PDtype ILC law similar to (12) according to [9] as follows: where is the traffic density error only and and are constants denoting the learning gains. The only difference between (12) and (38) is that the latter does not contain information of the queue length directly in the control law and the queue length is used as the constraints exposed on the control input signals.
Applying the ILC scheme (38) with and , the simulation results are shown as the blue dash lines in Figures 3 and 4, respectively. It is noticeable that the proposed QLIFILC approach has a better performance than the ILC scheme (38) without using queue length information.
To further assess the control performance of the proposed QLIFILC approach (12) and the ILC without explicitly using queue length information (38), define a performance index of mean speed MS (km/hour) as where denotes the total travel time (veh·hour) and denotes the total travel distance (veh·km). Apparently, a larger mean speed means a better working of the traffic system.
When applying the proposed QLIFILC law (12) and the ILC law (38), respectively, the mean speed values are presented in Table 1. It can be seen that the proposed QLIFILC achieves an improved performance over the traditional iterative learning ramp metering schemes [9–11].

5. Conclusion
In this paper, a discrete iterative learning control based on the queue length information fusion (QLIFILC) is proposed for the nonlinear freeway traffic systems with input disturbance and output measurement noise, where a feedforward learning part is combined with a feedback stabilizing part. The onramp queue length is explicitly fused into the designed ILC mechanism to achieve a better performance. A systematic approach is developed to analyze the convergence and robustness of the proposed learning scheme. It is shown that the uniform boundedness between the system output and the desired output is achieved in each iteration. When all the uncertainties tend to zero, the system output will converge uniformly to the desired one. The simulation study on a macroscopic level freeway model confirms the validity of the proposed QLIFILC.
Conflict of Interests
The authors declare that they have no conflict of interests regarding the publication of this paper.
Acknowledgment
This work is supported by the National Natural Science Foundation of China (61120106009, 61374102, and 60974040).
References
 E. Smaragdis, M. Papageorgiou, and E. Kosmatopoulos, “A flowmaximizing adaptive local ramp metering strategy,” Transportation Research B: Methodological, vol. 38, no. 3, pp. 251–270, 2004. View at: Publisher Site  Google Scholar
 T.H. Chang and Z.Y. Li, “Optimization of mainline traffic via an adaptive coordinated rampmetering control model with dynamic OD estimation,” Transportation Research C: Emerging Technologies, vol. 10, no. 2, pp. 99–120, 2002. View at: Publisher Site  Google Scholar
 X. Zhao, D. Srinivasan, and J. Xu, “Iterative learning control of freeway flow via ramp metering and simulation on PARAMICS,” in Proceedings of the IEEE Region 10 Conference (TENCON '09), pp. 1–6, Singapore, November 2009. View at: Publisher Site  Google Scholar
 M. Papageorgiou and A. Kotsialos, “Freeway ramp metering: an overview,” IEEE Transactions on Intelligent Transportation Systems, vol. 3, no. 4, pp. 271–281, 2002. View at: Publisher Site  Google Scholar
 A. Kotsialos, M. Papageorgiou, M. Mangeas, and H. HajSalem, “Coordinated and integrated control of motorway networks via nonlinear optimal control,” Transportation Research C: Emerging Technologies, vol. 10, no. 1, pp. 65–84, 2002. View at: Publisher Site  Google Scholar
 H. M. Zhang, S. G. Ritchie, and R. Jayakrishnan, “Coordinated trafficresponsive ramp control via nonlinear state feedback,” Transportation Research C: Emerging Technologies, vol. 9, no. 5, pp. 337–352, 2001. View at: Publisher Site  Google Scholar
 H. B. Ji, “Freeway traffic systems: prediction and control,” in Proceedings of the IEEE 46th Vehicular Technology Conference on “Mobile Technology for the Human Race”, vol. 3, pp. 1815–1819, Atlanta, Ga, USA, 1996. View at: Publisher Site  Google Scholar
 F.S. Ho and P. Ioannou, “Traffic flow modeling and control using artificial neural networks,” IEEE Control Systems Magazine, vol. 16, no. 5, pp. 16–26, 1996. View at: Publisher Site  Google Scholar
 Z. Hou, J.X. Xu, and H. Zhong, “Freeway traffic control using iterative learning controlbased ramp metering and speed signaling,” IEEE Transactions on Vehicular Technology, vol. 56, no. 2, pp. 466–477, 2007. View at: Publisher Site  Google Scholar
 Z. Hou, J.X. Xu, and J. Yan, “An iterative learning approach for density control of freeway traffic flow via ramp metering,” Transportation Research C: Emerging Technologies, vol. 16, no. 1, pp. 71–97, 2008. View at: Publisher Site  Google Scholar
 Z. Hou, X. Xu, J. Yan, J.X. Xu, and G. Xiong, “A complementary modularized ramp metering approach based on iterative learning control and ALINEA,” IEEE Transactions on Intelligent Transportation Systems, vol. 12, no. 4, pp. 1305–1318, 2011. View at: Publisher Site  Google Scholar
 S. Arimoto, S. Kawamura, and F. Miyazaki, “Bettering operation of robots by learning,” Journal of Robotic Systems, vol. 1, pp. 123–140, 1984. View at: Google Scholar
 C.J. Chien, “A discrete iterative learning control for a class of nonlinear timevarying systems,” IEEE Transactions on Automatic Control, vol. 43, no. 5, pp. 748–752, 1998. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 M. Sun and D. Wang, “Initial shift issues on discretetime iterative learning control with system relative degree,” IEEE Transactions on Automatic Control, vol. 48, no. 1, pp. 144–148, 2003. View at: Publisher Site  Google Scholar  MathSciNet
 H.S. Ahn, Y. Q. Chen, and K. L. Moore, “Iterative learning control: brief survey and categorization,” IEEE Transactions on Systems, Man and Cybernetics C: Applications and Reviews, vol. 37, no. 6, pp. 1099–1121, 2007. View at: Publisher Site  Google Scholar
 J.X. Xu and Y. Tan, Linear and Nonlinear Iterative Learning Control, vol. 291 of Lecture Notes in Control and Information Sciences, Springer, Berlin, Germany, 2003. View at: MathSciNet
 R. Chi, Z. Hou, and J. Xu, “Adaptive ILC for a class of discretetime systems with iterationvarying trajectory and random initial condition,” Automatica, vol. 44, no. 8, pp. 2207–2213, 2008. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 X. Sun and R. Horowitz, “A localized switching rampmetering controller with a queue length regulator for congested freeways,” in Proceedings of the American Control Conference (ACC '05), pp. 2141–2146, Portland, Ore, USA, June 2005. View at: Google Scholar
 R. L. Gordon, “Algorithm for controlling spillback from ramp meters,” Transportation Research Record, no. 1554, pp. 162–171, 1996. View at: Google Scholar
 E. Smaragdis and M. Papageorgiou, “Series of new local ramp metering strategies,” Transportation Research Record, no. 1856, pp. 74–86, 2003. View at: Google Scholar
 P. Kachroo and K. Ozbay, Feedback Ramp Metering in Intelligent Transportation Systems, Kluwer Academic/Plenum Publishers, New York, NY, USA, 2003.
 B. D. Greenshields, “A study of highway capacity,” in Proceedings of Highway Research Record, vol. 14, pp. 448–477, Washington, Wash, USA, 1935. View at: Google Scholar
Copyright
Copyright © 2014 Ronghu Chi et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.